00000020:00200000:2.0:1787826422.029127:0:26353:0:(cl_io.c:1853:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining.
00010000:00010000:2.0:1787826422.029131:0:26353:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff9ee003c8f000 lock: 00000000561243e5/0x8a0e38c306a5db4f lrc: 5/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020080000000 nid: local remote: 0xc8d45dcf026db7c4 expref: -99 pid: 26062 timeout: 0 lvb_type: 1 lru_score: 254 lru_type: 1
00010000:00010000:2.0:1787826422.029140:0:26353:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff9ee003c8f000 lock: 00000000561243e5/0x8a0e38c306a5db4f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020080000000 nid: local remote: 0xc8d45dcf026db7c4 expref: -99 pid: 26062 timeout: 0 lvb_type: 1 lru_score: 254 lru_type: 1
00000020:00200000:2.0:1787826422.029148:0:26353:0:(cl_io.c:1853:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining.
00000080:00200000:2.0:1787826422.029157:0:26353:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000401:0x2f:0x0] updating i_size 3684611072 i_blocks 7196528
00000020:00010000:2.0:1787826422.029161:0:26353:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff9edf78e99b28 (ffff9edf7d4dac68/0) at cl_lock_release():245
00000020:00010000:2.0:1787826422.029165:0:26353:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9edf78e99b28 (ffff9edf7d4dac68/0) at cl_lock_cancel():142
00000020:00010000:2.0:1787826422.029168:0:26353:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9ee004f43930 (ffff9ee00550d6c8/1) at cl_lock_cancel():142
00000020:00010000:2.0:1787826422.029172:0:26353:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9ee004f43970 (ffff9edf7d4da6c8/1) at cl_lock_cancel():142
00000020:00010000:2.0:1787826422.029175:0:26353:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9edf78e99b28 (ffff9edf7d4dac68/0) at cl_lock_fini():72
00000020:00010000:2.0:1787826422.029178:0:26353:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9ee004f43930 (ffff9edf7d4dac68/1) at cl_lock_fini():72
00000020:00010000:2.0:1787826422.029182:0:26353:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9ee004f43970 (ffff9edf7d4dac68/1) at cl_lock_fini():72
00000080:00200000:2.0:1787826422.029193:0:26353:0:(vvp_io.c:304:vvp_io_fini()) [0x200000401:0x2f:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0
00000080:00200000:2.0:1787826422.029229:0:26353:0:(file.c:6208:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9ee00b1100c8),name=/
00000002:00010000:2.0:1787826422.029237:0:26353:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0
00010000:00010000:2.0:1787826422.029245:0:26353:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9ee003c8f000 lock: ffff9ee005866000/0x8a0e38c306a5db64 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xc8d45dcf026db7e0 expref: -99 pid: 26350 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0
00010000:00010000:2.0:1787826422.029255:0:26353:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9ee003c8f000 lock: ffff9ee005866000/0x8a0e38c306a5db64 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xc8d45dcf026db7e0 expref: -99 pid: 26350 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0
00000080:00200000:2.0:1787826422.029262:0:26353:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1
00000080:00010000:2.0:1787826422.029266:0:26353:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9ee00b1100c8)
00000080:00010000:2.0:1787826422.029269:0:26353:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9ee00b1100c8) for lock 0x8a0e38c306a5db64
00000080:00010000:2.0:1787826422.029274:0:26353:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a0e38c306a5db64 from it ffffb65402c0bc10
00010000:00010000:2.0:1787826422.029278:0:26353:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9ee003c8f000 lock: ffff9ee005866000/0x8a0e38c306a5db64 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xc8d45dcf026db7e0 expref: -99 pid: 26350 timeout: 0 lvb_type: 0 lru_score: 2 lru_type: 0
00010000:00010000:2.0:1787826422.029286:0:26353:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9ee003c8f000 lock: ffff9ee005866000/0x8a0e38c306a5db64 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xc8d45dcf026db7e0 expref: -99 pid: 26350 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0
00000080:00200000:2.0:1787826422.029295:0:26353:0:(file.c:6689:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9ee00b1100c8), inode mode 41ff mask 1
00000080:00200000:2.0:1787826422.029301:0:26353:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=oosfile, flags=0
00000080:00200000:2.0:1787826422.029306:0:26353:0:(file.c:6208:ll_inode_revalidate()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9ee00b1100c8),name=/
00000002:00010000:2.0:1787826422.029311:0:26353:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000007:0x1:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0
00010000:00010000:2.0:1787826422.029340:0:26353:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9ee003c8f000 lock: ffff9ee005866000/0x8a0e38c306a5db64 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x0 nid: local remote: 0xc8d45dcf026db7e0 expref: -99 pid: 26350 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0
00010000:00010000:2.0:1787826422.029349:0:26353:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9ee003c8f000 lock: ffff9ee005866000/0x8a0e38c306a5db64 lrc: 2/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xc8d45dcf026db7e0 expref: -99 pid: 26350 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0
00000080:00200000:2.0:1787826422.029356:0:26353:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1
00000080:00010000:2.0:1787826422.029360:0:26353:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9ee00b1100c8)
00000080:00010000:2.0:1787826422.029362:0:26353:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9ee00b1100c8) for lock 0x8a0e38c306a5db64
00000080:00010000:2.0:1787826422.029366:0:26353:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a0e38c306a5db64 from it ffffb65402c0bd68
00010000:00010000:2.0:1787826422.029369:0:26353:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9ee003c8f000 lock: ffff9ee005866000/0x8a0e38c306a5db64 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xc8d45dcf026db7e0 expref: -99 pid: 26350 timeout: 0 lvb_type: 0 lru_score: 3 lru_type: 0
00010000:00010000:2.0:1787826422.029377:0:26353:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9ee003c8f000 lock: ffff9ee005866000/0x8a0e38c306a5db64 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xc8d45dcf026db7e0 expref: -99 pid: 26350 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0
00000080:00200000:2.0:1787826422.029385:0:26353:0:(file.c:6689:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9ee00b1100c8), inode mode 41ff mask 3
00000080:00200000:2.0:1787826422.029391:0:26353:0:(namei.c:2418:ll_unlink()) VFS Op:name=oosfile, dir=[0x200000007:0x1:0x0](ffff9ee00b1100c8)
00010000:00010000:2.0:1787826422.029414:0:26353:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9ee003c8f000 lock: ffff9ee005866000/0x8a0e38c306a5db64 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x8400000000 nid: local remote: 0xc8d45dcf026db7e0 expref: -99 pid: 26350 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0
00010000:00010000:2.0:1787826422.029437:0:26353:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9ee003c8f000 lock: ffff9ee005867c00/0x8a0e38c306a5db6b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xc8d45dcf026db7fc expref: -99 pid: 26350 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0
00000080:00200000:2.0:1787826422.029448:0:26353:0:(vvp_object.c:117:vvp_conf_set()) [0x200000401:0x2f:0x0]: losing layout lock
00010000:00010000:2.0:1787826422.029458:0:26353:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9ee003c8f000 lock: ffff9edf47880000/0x8a0e38c306a5db5d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x2f:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x28400000000 nid: local remote: 0xc8d45dcf026db7d2 expref: -99 pid: 26062 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0
00000080:00200000:2.0:1787826422.029465:0:26353:0:(vvp_object.c:117:vvp_conf_set()) [0x200000401:0x2f:0x0]: losing layout lock
00010000:00010000:2.0:1787826422.029492:0:26353:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9ee003c8f000 lock: ffff9ee005867c00/0x8a0e38c306a5db6b lrc: 1/0,0 mode: --/PR res: [0x200000401:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xc8d45dcf026db7fc expref: -99 pid: 26350 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0
00010000:00010000:2.0:1787826422.029500:0:26353:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9ee003c8f000 lock: ffff9edf47880000/0x8a0e38c306a5db5d lrc: 1/0,0 mode: --/CR res: [0x200000401:0x2f:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xc8d45dcf026db7d2 expref: -99 pid: 26062 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0
00010000:00010000:2.0:1787826422.029507:0:26353:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9ee003c8f000 lock: ffff9ee005866000/0x8a0e38c306a5db64 lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0xc8d45dcf026db7e0 expref: -99 pid: 26350 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0
00010000:00010000:2.0:1787826422.029513:0:26353:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 3 locks packed
00010000:00010000:2.0:1787826422.029516:0:26353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9ee003c8f000 lock: ffff9ee005867c00/0x8a0e38c306a5db6b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xc8d45dcf026db7fc expref: -99 pid: 26350 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0
00010000:00010000:2.0:1787826422.029603:0:26353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9ee003c8f000 lock: ffff9edf47880000/0x8a0e38c306a5db5d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2f:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x4829400000020 nid: local remote: 0xc8d45dcf026db7d2 expref: -99 pid: 26062 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0
00010000:00010000:2.0:1787826422.029618:0:26353:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9ee003c8f000 lock: ffff9ee005866000/0x8a0e38c306a5db64 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x4809400000020 nid: local remote: 0xc8d45dcf026db7e0 expref: -99 pid: 26350 timeout: 0 lvb_type: 0 lru_score: 4 lru_type: 0
00000020:00100000:2.0:1787826422.029643:0:26353:0:(genops.c:2423:obd_get_mod_rpc_slot()) lustre-MDT0000-mdc-ffff9ee003c8f000: modify RPC slot 1 is allocated opc 36, max 7
00000100:00100000:2.0:1787826422.029653:0:26353:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid  req@ffff9ee0056b5e00 x1874670272701184/t0(0) o36->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 496/624 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787826422.029677:0:26353:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056b5e00 pname:cluuid:pid:xid:nid:opc:job rm:b03e141c-10d0-4012-b9b8-d9632d4e5a26:26353:1874670272701184:192.168.203.121@tcp:36:rm.0
00000100:00100000:2.0:1787826422.029825:0:26353:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee004f43900 going to sleep for 11 seconds
00010000:00010000:2.0:1787826422.036555:0:5453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:2.0:1787826422.036563:0:5453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-MDT0000-mdc-ffff9ee00c190000 lock: ffff9ee0058ad000/0x8a0e38c306a5db72 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x400000000000 nid: local remote: 0xc8d45dcf026db80a expref: -99 pid: 26351 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0
00010000:00010000:2.0:1787826422.036572:0:5453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ee0058ad000 already unused, calling callback (ffffffffc1aa1990)
00010000:00010000:2.0:1787826422.036577:0:5453:0:(ldlm_request.c:1732:ldlm_cli_convert()) ### client lock convert START ns: lustre-MDT0000-mdc-ffff9ee00c190000 lock: ffff9ee0058ad000/0x8a0e38c306a5db72 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x13 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0xc8d45dcf026db80a expref: -99 pid: 26351 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0
00010000:00010000:2.0:1787826422.036586:0:5453:0:(ldlm_request.c:1742:ldlm_cli_convert()) ### client lock convert END ns: lustre-MDT0000-mdc-ffff9ee00c190000 lock: ffff9ee0058ad000/0x8a0e38c306a5db72 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x13 rrc: 2 type: IBT gid 0 flags: 0x400400000000 nid: local remote: 0xc8d45dcf026db80a expref: -99 pid: 26351 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0
00010000:00010000:2.0:1787826422.036594:0:5453:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-MDT0000-mdc-ffff9ee00c190000 lock: ffff9ee0058ad000/0x8a0e38c306a5db72 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x13 rrc: 2 type: IBT gid 0 flags: 0x408400000000 nid: local remote: 0xc8d45dcf026db80a expref: -99 pid: 26351 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0
00010000:00010000:2.0:1787826422.036648:0:5453:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-MDT0000-mdc-ffff9ee00c190000 lock: ffff9ee0058ad000/0x8a0e38c306a5db72 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x13 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0xc8d45dcf026db80a expref: -99 pid: 26351 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0
00010000:00010000:2.0:1787826422.036655:0:5453:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed
00010000:00010000:2.0:1787826422.036683:0:5453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-MDT0000-mdc-ffff9ee00c190000 lock: ffff9ee0058ad000/0x8a0e38c306a5db72 lrc: 1/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x13 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0xc8d45dcf026db80a expref: -99 pid: 26351 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0
00010000:00010000:2.0:1787826422.036695:0:5453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-MDT0000-mdc-ffff9ee00c190000 lock: ffff9ee0058ad000/0x8a0e38c306a5db72 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x13 rrc: 2 type: IBT gid 0 flags: 0x4c09400000020 nid: local remote: 0xc8d45dcf026db80a expref: -99 pid: 26351 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0
00010000:00010000:2.0:1787826422.036712:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1787826422.036714:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1787826422.036716:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787826422.043668:0:26353:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056b5e00 pname:cluuid:pid:xid:nid:opc:job rm:b03e141c-10d0-4012-b9b8-d9632d4e5a26:26353:1874670272701184:192.168.203.121@tcp:36:rm.0
00000080:00200000:2.0:1787826422.043729:0:26353:0:(vvp_io.c:1889:vvp_io_init()) [0x200000401:0x2f:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0
00020000:00200000:2.0:1787826422.043743:0:26353:0:(lov_io.c:1253:lov_io_iter_init()) component[0] flags 0x10
00000080:00200000:2.0:1787826422.043776:0:26353:0:(vvp_io.c:304:vvp_io_fini()) [0x200000401:0x2f:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0
00000100:00100000:2.0:1787826425.544886:0:26353:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0b40 pname:cluuid:pid:xid:nid:opc:job rm:5176db3c-915a-436c-ad43-aac0fc9a0dfe:26353:1874670272702336:192.168.203.121@tcp:101:rm.0
00010000:00010000:2.0:1787826425.544911:0:26353:0:(ldlm_request.c:759:ldlm_cli_enqueue_fini()) ### server returned different mode PR ns: lustre-MDT0000-mdc-ffff9ee00c190000 lock: ffff9ee005a3ae00/0x8a0e38c306a5db80 lrc: 4/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xc8d45dcf026db850 expref: -99 pid: 26353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787826425.544924:0:26353:0:(ldlm_request.c:787:ldlm_cli_enqueue_fini()) ### client-side enqueue, new policy data ns: lustre-MDT0000-mdc-ffff9ee00c190000 lock: ffff9ee005a3ae00/0x8a0e38c306a5db80 lrc: 4/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xc8d45dcf026db850 expref: -99 pid: 26353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787826425.544935:0:26353:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: lustre-MDT0000-mdc-ffff9ee00c190000 lock: ffff9ee005a3ae00/0x8a0e38c306a5db80 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xc8d45dcf026db850 expref: -99 pid: 26353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787826425.544946:0:26353:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: lustre-MDT0000-mdc-ffff9ee00c190000 lock: ffff9ee005a3ae00/0x8a0e38c306a5db80 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xc8d45dcf026db850 expref: -99 pid: 26353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787826425.544958:0:26353:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9ee00c190000 lock: ffff9ee005a3ae00/0x8a0e38c306a5db80 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xc8d45dcf026db850 expref: -99 pid: 26353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787826425.544971:0:26353:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: lustre-MDT0000-mdc-ffff9ee00c190000 lock: ffff9ee005a3ae00/0x8a0e38c306a5db80 lrc: 5/2,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xc8d45dcf026db850 expref: -99 pid: 26353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787826425.544978:0:26353:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: lustre-MDT0000-mdc-ffff9ee00c190000 lock: ffff9ee005a3ae00/0x8a0e38c306a5db80 lrc: 4/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xc8d45dcf026db850 expref: -99 pid: 26353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000002:00100000:2.0:1787826425.544989:0:26353:0:(mdc_locks.c:835:mdc_finish_enqueue()) @@@ op=0x8 disposition=0xb, status=0  req@ffff9ee0056a0b40 x1874670272702336/t0(0) o101->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 576/688 e 0 to 0 dl 1787826441 ref 1 fl Complete:RQU/600/0 rc 0/0 job:'rm.0' uid:0 gid:0 projid:0
00000002:00010000:2.0:1787826425.545002:0:26353:0:(mdc_locks.c:1359:mdc_finish_intent_lock()) ### matching against this ns: lustre-MDT0000-mdc-ffff9ee00c190000 lock: ffff9ee005a3ae00/0x8a0e38c306a5db80 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xc8d45dcf026db850 expref: -99 pid: 26353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787826425.545015:0:26353:0:(ldlm_lock.c:1539:ldlm_lock_match_with_skip()) ### not matched ns ffff9ee005ae5400 type 13 mode 4 res 8589934599/1 (0 0)
00000080:00200000:2.0:1787826425.545021:0:26353:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 0
00000080:00200000:2.0:1787826425.545048:0:26353:0:(llite_lib.c:3119:ll_update_inode()) inode=[0x200000007:0x1:0x0], updating i_size 4096
00000080:00010000:2.0:1787826425.545054:0:26353:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000007:0x1:0x0](ffff9ee00b18c2c8) for lock 0x8a0e38c306a5db80
00000080:00010000:2.0:1787826425.545059:0:26353:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000007:0x1:0x0](ffff9ee00b18c2c8)
00000080:00010000:2.0:1787826425.545062:0:26353:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a0e38c306a5db80 from it ffffb65402c0bb58
00010000:00010000:2.0:1787826425.545065:0:26353:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9ee00c190000 lock: ffff9ee005a3ae00/0x8a0e38c306a5db80 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x10000000000000 nid: local remote: 0xc8d45dcf026db850 expref: -99 pid: 26353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1787826425.545074:0:26353:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9ee00c190000 lock: ffff9ee005a3ae00/0x8a0e38c306a5db80 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x0 nid: local remote: 0xc8d45dcf026db850 expref: -99 pid: 26353 timeout: 0 lvb_type: 0 lru_score: 1 lru_type: 0
00000080:00200000:2.0:1787826425.545098:0:26353:0:(file.c:6689:ll_inode_permission()) VFS Op:inode=[0x200000007:0x1:0x0](ffff9ee00b18c2c8), inode mode 41ff mask 1
00000080:00200000:2.0:1787826425.545111:0:26353:0:(dcache.c:276:ll_revalidate_dentry()) VFS Op:name=oosfile2, flags=8
00000080:00200008:2.0:1787826425.545122:0:26353:0:(file.c:6313:ll_getattr_dentry()) START file oosfile2:[0x200000402:0x11:0x0](ffff9ee00b1f9988), request_mask 2047, flags 0, foreign 0
00000080:00200000:2.0:1787826425.545128:0:26353:0:(file.c:6208:ll_inode_revalidate()) VFS Op:inode=[0x200000402:0x11:0x0](ffff9ee00b1f9988),name=oosfile2
00000002:00010000:2.0:1787826425.545145:0:26353:0:(mdc_locks.c:1508:mdc_intent_lock()) (name: ,[0x200000402:0x11:0x0]) in obj [0x200000007:0x1:0x0], intent: getattr flags 0
00010000:00010000:2.0:1787826425.545156:0:26353:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: lustre-MDT0000-mdc-ffff9ee00c190000 lock: ffff9ee0058ac200/0x8a0e38c306a5db79 lrc: 2/1,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xc8d45dcf026db826 expref: -99 pid: 26351 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0
00010000:00010000:2.0:1787826425.545167:0:26353:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 0) ns: lustre-MDT0000-mdc-ffff9ee00c190000 lock: ffff9ee0058ac200/0x8a0e38c306a5db79 lrc: 2/1,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xc8d45dcf026db826 expref: -99 pid: 26351 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0
00000080:00200000:2.0:1787826425.545174:0:26353:0:(namei.c:952:ll_intent_lock()) intent lock 8 on i1 [0x200000007:0x1:0x0] suppgids 0 0: rc 1
00000080:00010000:2.0:1787826425.545178:0:26353:0:(dcache.c:255:ll_lookup_finish_locks()) setting l_data to inode [0x200000402:0x11:0x0](ffff9ee00b1f9988)
00000080:00010000:2.0:1787826425.545180:0:26353:0:(llite_internal.h:1989:ll_set_lock_data()) setting l_data to inode [0x200000402:0x11:0x0](ffff9ee00b1f9988) for lock 0x8a0e38c306a5db79
00000080:00010000:2.0:1787826425.545184:0:26353:0:(dcache.c:152:ll_intent_drop_lock()) releasing lock with cookie 0x8a0e38c306a5db79 from it ffffb65402c0bcb8
00010000:00010000:2.0:1787826425.545199:0:26353:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: lustre-MDT0000-mdc-ffff9ee00c190000 lock: ffff9ee0058ac200/0x8a0e38c306a5db79 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x10020000000000 nid: local remote: 0xc8d45dcf026db826 expref: -99 pid: 26351 timeout: 0 lvb_type: 3 lru_score: 2 lru_type: 0
00010000:00010000:2.0:1787826425.545207:0:26353:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-MDT0000-mdc-ffff9ee00c190000 lock: ffff9ee0058ac200/0x8a0e38c306a5db79 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x11:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x20000000000 nid: local remote: 0xc8d45dcf026db826 expref: -99 pid: 26351 timeout: 0 lvb_type: 3 lru_score: 3 lru_type: 0
00000080:00200000:2.0:1787826425.545228:0:26353:0:(vvp_io.c:1889:vvp_io_init()) [0x200000402:0x11:0x0] ignore/verify layout 0/1, layout version 0 restore needed 0
00000001:00010000:2.0:1787826425.545238:0:26353:0:(glimpse.c:73:cl_glimpse_lock()) Glimpsing inode [0x200000402:0x11:0x0]
00000008:00010000:2.0:1787826425.545258:0:26353:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a
00000008:00010000:2.0:1787826425.545261:0:26353:0:(osc_lock.c:1320:osc_lock_init()) ### lock ffff9ee004f43930, osc lock ffff9ee00a740138, flags 0x400001002
00000008:00010000:2.0:1787826425.545268:0:26353:0:(lustre_osc.h:162:osc_enq2ldlm_flags()) flags: a
00000008:00010000:2.0:1787826425.545270:0:26353:0:(osc_lock.c:1320:osc_lock_init()) ### lock ffff9ee004f43970, osc lock ffff9ee00a741380, flags 0x400001002
00010000:00010000:2.0:1787826425.545297:0:26353:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0000-osc-ffff9ee00c190000 lock: 0000000049acf5ad/0x8a0e38c306a5db3a lrc: 2/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020080000000 nid: local remote: 0xc8d45dcf026db7a8 expref: -99 pid: 26063 timeout: 0 lvb_type: 1 lru_score: 254 lru_type: 1
00010000:00010000:2.0:1787826425.545308:0:26353:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0000-osc-ffff9ee00c190000 lock: 0000000049acf5ad/0x8a0e38c306a5db3a lrc: 2/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020080000000 nid: local remote: 0xc8d45dcf026db7a8 expref: -99 pid: 26063 timeout: 0 lvb_type: 1 lru_score: 254 lru_type: 1
00000020:00200000:2.0:1787826425.545360:0:26353:0:(cl_io.c:1853:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining.
00010000:00010000:2.0:1787826425.545364:0:26353:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0000-osc-ffff9ee00c190000 lock: 0000000049acf5ad/0x8a0e38c306a5db3a lrc: 5/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020080000000 nid: local remote: 0xc8d45dcf026db7a8 expref: -99 pid: 26063 timeout: 0 lvb_type: 1 lru_score: 254 lru_type: 1
00010000:00010000:2.0:1787826425.545372:0:26353:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0000-osc-ffff9ee00c190000 lock: 0000000049acf5ad/0x8a0e38c306a5db3a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020080000000 nid: local remote: 0xc8d45dcf026db7a8 expref: -99 pid: 26063 timeout: 0 lvb_type: 1 lru_score: 254 lru_type: 1
00010000:00010000:2.0:1787826425.545389:0:26353:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: lustre-OST0001-osc-ffff9ee00c190000 lock: 00000000f349fa23/0x8a0e38c306a5db48 lrc: 2/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020080000000 nid: local remote: 0xc8d45dcf026db7bd expref: -99 pid: 26063 timeout: 0 lvb_type: 1 lru_score: 254 lru_type: 1
00010000:00010000:2.0:1787826425.545398:0:26353:0:(ldlm_lock.c:1522:ldlm_lock_match_with_skip()) ### matched (0 18446744073709551615) ns: lustre-OST0001-osc-ffff9ee00c190000 lock: 00000000f349fa23/0x8a0e38c306a5db48 lrc: 2/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020080000000 nid: local remote: 0xc8d45dcf026db7bd expref: -99 pid: 26063 timeout: 0 lvb_type: 1 lru_score: 254 lru_type: 1
00000020:00200000:2.0:1787826425.545406:0:26353:0:(cl_io.c:1853:__cl_sync_io_note()) Noting completion of 1 items, 1 items remaining.
00010000:00010000:2.0:1787826425.545409:0:26353:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: lustre-OST0001-osc-ffff9ee00c190000 lock: 00000000f349fa23/0x8a0e38c306a5db48 lrc: 5/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x810020080000000 nid: local remote: 0xc8d45dcf026db7bd expref: -99 pid: 26063 timeout: 0 lvb_type: 1 lru_score: 254 lru_type: 1
00010000:00010000:2.0:1787826425.545417:0:26353:0:(ldlm_lock.c:912:ldlm_lock_decref_internal()) ### add lock into lru list ns: lustre-OST0001-osc-ffff9ee00c190000 lock: 00000000f349fa23/0x8a0e38c306a5db48 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020080000000 nid: local remote: 0xc8d45dcf026db7bd expref: -99 pid: 26063 timeout: 0 lvb_type: 1 lru_score: 254 lru_type: 1
00000020:00200000:2.0:1787826425.545425:0:26353:0:(cl_io.c:1853:__cl_sync_io_note()) Noting completion of 1 items, 0 items remaining.
00000080:00200000:2.0:1787826425.545434:0:26353:0:(file.c:1775:ll_merge_attr_nolock()) [0x200000402:0x11:0x0] updating i_size 3682353152 i_blocks 7192112
00000020:00010000:2.0:1787826425.545438:0:26353:0:(cl_lock.c:36:__cl_lock_trace()) release lock: ffff9edf78e99b28 (ffff9edf7d4dac68/0) at cl_lock_release():245
00000020:00010000:2.0:1787826425.545441:0:26353:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9edf78e99b28 (ffff9edf7d4dac68/0) at cl_lock_cancel():142
00000020:00010000:2.0:1787826425.545445:0:26353:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9ee004f43930 (ffff9ee00550d6c8/1) at cl_lock_cancel():142
00000020:00010000:2.0:1787826425.545448:0:26353:0:(cl_lock.c:36:__cl_lock_trace()) cancel lock: ffff9ee004f43970 (ffff9edf7d4da6c8/1) at cl_lock_cancel():142
00000020:00010000:2.0:1787826425.545451:0:26353:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9edf78e99b28 (ffff9edf7d4dac68/0) at cl_lock_fini():72
00000020:00010000:2.0:1787826425.545454:0:26353:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9ee004f43930 (ffff9edf7d4dac68/1) at cl_lock_fini():72
00000020:00010000:2.0:1787826425.545457:0:26353:0:(cl_lock.c:36:__cl_lock_trace()) destroy lock: ffff9ee004f43970 (ffff9edf7d4dac68/1) at cl_lock_fini():72
00000080:00200000:2.0:1787826425.545467:0:26353:0:(vvp_io.c:304:vvp_io_fini()) [0x200000402:0x11:0x0] ignore/verify layout 0/1, layout version 0 need write layout 0, restore needed 0, invalidate_lock 0
00010000:00010000:2.0:1787826426.836698:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1787826427.606263:0:5454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp.  (2 blwis in pool)
00010000:00010000:2.0:1787826427.606272:0:5454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff9ee003c8f000 lock: 00000000561243e5/0x8a0e38c306a5db4f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420080010000 nid: local remote: 0xc8d45dcf026db7c4 expref: -99 pid: 26062 timeout: 0 lvb_type: 1 lru_score: 254 lru_type: 1
00010000:00010000:2.0:1787826427.606282:0:5454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ee005a3a400 already unused, calling callback (ffffffffc1165410)
00010000:00010000:2.0:1787826427.606288:0:5454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff9ee003c8f000 lock: 00000000561243e5/0x8a0e38c306a5db4f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x428480010000 nid: local remote: 0xc8d45dcf026db7c4 expref: -99 pid: 26062 timeout: 0 lvb_type: 1 lru_score: 254 lru_type: 1
00010000:00010000:2.0:1787826427.606359:0:5454:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff9ee003c8f000 lock: 00000000561243e5/0x8a0e38c306a5db4f lrc: 2/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29480010020 nid: local remote: 0xc8d45dcf026db7c4 expref: -99 pid: 26062 timeout: 0 lvb_type: 1 lru_score: 254 lru_type: 1
00010000:00010000:2.0:1787826427.606368:0:5454:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed
00010000:00010000:2.0:1787826427.606384:0:5454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff9ee003c8f000 lock: 00000000561243e5/0x8a0e38c306a5db4f lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29480010020 nid: local remote: 0xc8d45dcf026db7c4 expref: -99 pid: 26062 timeout: 0 lvb_type: 1 lru_score: 254 lru_type: 1
00010000:00010000:2.0:1787826427.606392:0:5454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff9ee003c8f000 lock: 00000000561243e5/0x8a0e38c306a5db4f lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29480010020 nid: local remote: 0xc8d45dcf026db7c4 expref: -99 pid: 26062 timeout: 0 lvb_type: 1 lru_score: 254 lru_type: 1
00010000:00010000:2.0:1787826427.606412:0:5454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp.  (1 blwis in pool)
00010000:00010000:2.0:1787826427.606415:0:5454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff9ee00c190000 lock: 0000000049acf5ad/0x8a0e38c306a5db3a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800420080010000 nid: local remote: 0xc8d45dcf026db7a8 expref: -99 pid: 26063 timeout: 0 lvb_type: 1 lru_score: 254 lru_type: 1
00010000:00010000:2.0:1787826427.606422:0:5454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ee0058ac000 already unused, calling callback (ffffffffc1165410)
00010000:00010000:2.0:1787826427.606426:0:5454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff9ee00c190000 lock: 0000000049acf5ad/0x8a0e38c306a5db3a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800428480010000 nid: local remote: 0xc8d45dcf026db7a8 expref: -99 pid: 26063 timeout: 0 lvb_type: 1 lru_score: 254 lru_type: 1
00000080:00200000:2.0:1787826427.606444:0:5454:0:(vvp_io.c:1889:vvp_io_init()) [0x200000402:0x11:0x0] ignore/verify layout 1/0, layout version 0 restore needed 0
00000100:00100000:2.0:1787826427.616035:0:2368:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2368:1874670272702848:192.168.203.121@tcp:103:ldlm_bl.0
00000100:00100000:2.0:1787826427.616049:0:2368:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056b43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2368:1874670272702720:192.168.203.121@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1787826427.868342:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000080:00200000:2.0:1787826428.459421:0:5454:0:(vvp_io.c:304:vvp_io_fini()) [0x200000402:0x11:0x0] ignore/verify layout 1/0, layout version 0 need write layout 0, restore needed 0, invalidate_lock 1
00010000:00010000:2.0:1787826428.459486:0:5454:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff9ee00c190000 lock: 0000000049acf5ad/0x8a0e38c306a5db3a lrc: 2/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69480010020 nid: local remote: 0xc8d45dcf026db7a8 expref: -99 pid: 26063 timeout: 0 lvb_type: 1 lru_score: 254 lru_type: 1
00010000:00010000:2.0:1787826428.459499:0:5454:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed
00010000:00010000:2.0:1787826428.459678:0:5454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff9ee00c190000 lock: 0000000049acf5ad/0x8a0e38c306a5db3a lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69480010020 nid: local remote: 0xc8d45dcf026db7a8 expref: -99 pid: 26063 timeout: 0 lvb_type: 1 lru_score: 254 lru_type: 1
00010000:00010000:2.0:1787826428.459688:0:5454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff9ee00c190000 lock: 0000000049acf5ad/0x8a0e38c306a5db3a lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x804c69480010020 nid: local remote: 0xc8d45dcf026db7a8 expref: -99 pid: 26063 timeout: 0 lvb_type: 1 lru_score: 254 lru_type: 1
00010000:00010000:2.0:1787826428.459712:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1787826428.459715:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1787826428.459716:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000008:00010000:2.0:1787826428.499974:0:26353:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 4194304 blocks 8192 [cma]time: 0 0 0 by oinfo size 4194304 blocks 8192 [cma]time 0 0 0 ns: lustre-OST0001-osc-ffff9ee003c8f000 lock: 0000000031a0262b/0x8a0e38c306a5db95 lrc: 1/0,0 mode: PR/PR res: [0x280000400:0xe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0xc8d45dcf026db8b9 expref: -99 pid: 26353 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0
00000008:00010000:2.0:1787826428.500021:0:26353:0:(osc_object.c:202:osc_object_ast_clear()) ### update lock size 3009284 blocks 5880 [cma]time: 0 0 0 by oinfo size 3009284 blocks 5880 [cma]time 0 0 0 ns: lustre-OST0000-osc-ffff9ee003c8f000 lock: 00000000dd4f4c8d/0x8a0e38c306a5db9c lrc: 1/0,0 mode: PR/PR res: [0x240000400:0x10:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x800020000000000 nid: local remote: 0xc8d45dcf026db8c0 expref: -99 pid: 26353 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0
00010000:00010000:2.0:1787826430.740344:0:5453:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:2.0:1787826430.740354:0:5453:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0000-osc-ffff9ee003c8f000 lock: 00000000dd4f4c8d/0x8a0e38c306a5db9c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000010000 nid: local remote: 0xc8d45dcf026db8c0 expref: -99 pid: 26353 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0
00010000:00010000:2.0:1787826430.740366:0:5453:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ee005a3a000 already unused, calling callback (ffffffffc1165410)
00010000:00010000:2.0:1787826430.740373:0:5453:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0000-osc-ffff9ee003c8f000 lock: 00000000dd4f4c8d/0x8a0e38c306a5db9c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x428400010000 nid: local remote: 0xc8d45dcf026db8c0 expref: -99 pid: 26353 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0
00010000:00010000:2.0:1787826430.740421:0:5453:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0000-osc-ffff9ee003c8f000 lock: 00000000dd4f4c8d/0x8a0e38c306a5db9c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0xc8d45dcf026db8c0 expref: -99 pid: 26353 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0
00010000:00010000:2.0:1787826430.740428:0:5453:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed
00010000:00010000:2.0:1787826430.740460:0:5453:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0000-osc-ffff9ee003c8f000 lock: 00000000dd4f4c8d/0x8a0e38c306a5db9c lrc: 1/0,0 mode: --/PR res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0xc8d45dcf026db8c0 expref: -99 pid: 26353 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0
00010000:00010000:2.0:1787826430.740468:0:5453:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0000-osc-ffff9ee003c8f000 lock: 00000000dd4f4c8d/0x8a0e38c306a5db9c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0xc8d45dcf026db8c0 expref: -99 pid: 26353 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0
00010000:00010000:2.0:1787826430.740490:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1787826430.740492:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1787826430.740494:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1787826430.756579:0:5454:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:2.0:1787826430.756589:0:5454:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: lustre-OST0001-osc-ffff9ee003c8f000 lock: 0000000031a0262b/0x8a0e38c306a5db95 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x420000010000 nid: local remote: 0xc8d45dcf026db8b9 expref: -99 pid: 26353 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0
00010000:00010000:2.0:1787826430.756599:0:5454:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9ee005a3be00 already unused, calling callback (ffffffffc1165410)
00010000:00010000:2.0:1787826430.756605:0:5454:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: lustre-OST0001-osc-ffff9ee003c8f000 lock: 0000000031a0262b/0x8a0e38c306a5db95 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x428400010000 nid: local remote: 0xc8d45dcf026db8b9 expref: -99 pid: 26353 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0
00010000:00010000:2.0:1787826430.756648:0:5454:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: lustre-OST0001-osc-ffff9ee003c8f000 lock: 0000000031a0262b/0x8a0e38c306a5db95 lrc: 2/0,0 mode: --/PR res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0xc8d45dcf026db8b9 expref: -99 pid: 26353 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0
00010000:00010000:2.0:1787826430.756655:0:5454:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed
00010000:00010000:2.0:1787826430.756673:0:5454:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: lustre-OST0001-osc-ffff9ee003c8f000 lock: 0000000031a0262b/0x8a0e38c306a5db95 lrc: 1/0,0 mode: --/PR res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0xc8d45dcf026db8b9 expref: -99 pid: 26353 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0
00010000:00010000:2.0:1787826430.756679:0:5454:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: lustre-OST0001-osc-ffff9ee003c8f000 lock: 0000000031a0262b/0x8a0e38c306a5db95 lrc: 0/0,0 mode: --/PR res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x4c29400010020 nid: local remote: 0xc8d45dcf026db8b9 expref: -99 pid: 26353 timeout: 0 lvb_type: 1 lru_score: 1 lru_type: 0
00010000:00010000:2.0:1787826430.756701:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1787826430.756702:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1787826430.756704:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1787826434.005226:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1787826435.027555:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1787826439.123548:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1787826440.147670:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1787826444.243498:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1787826445.267516:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787826448.531610:0:2368:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056b6580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2368:1874670272707584:192.168.203.121@tcp:400:kworker.0
00000100:00100000:2.0:1787826448.531856:0:2368:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056b6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2368:1874670272707840:192.168.203.121@tcp:400:kworker.0
00000100:00100000:2.0:1787826448.531906:0:2368:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2368:1874670272708096:192.168.203.121@tcp:400:kworker.0
00000100:00100000:2.0:1787826448.531944:0:2368:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056b4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2368:1874670272708352:192.168.203.121@tcp:400:kworker.0
00010000:00010000:2.0:1787826449.363727:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1787826450.387495:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787826453.651582:0:2367:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056b5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2367:1874670272708736:192.168.203.121@tcp:400:kworker.0
00000100:00100000:2.0:1787826453.651654:0:2367:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056b43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2367:1874670272708992:192.168.203.121@tcp:400:kworker.0
00000100:00100000:2.0:1787826453.651695:0:2367:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056b7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2367:1874670272709248:192.168.203.121@tcp:400:kworker.0
00010000:00010000:2.0:1787826454.483650:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1787826454.688228:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787826454.688238:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787826454.688243:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787826454.688252:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 202
00000100:00080000:2.0:1787826454.688268:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787826454.688297:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056b6940 x1874670272709376/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787826454.695227:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787826454.695237:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787826454.695242:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787826454.695252:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 311
00000100:00080000:2.0:1787826454.695267:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787826454.695280:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787826454.695312:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00f2e83c0 x1874670272709632/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787826454.695385:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787826454.695390:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787826454.695393:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787826454.695401:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 267
00000100:00080000:2.0:1787826454.695414:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787826454.695422:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787826454.695439:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00f2e8f00 x1874670272709888/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787826454.695457:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787826454.695464:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787826454.695468:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787826454.695474:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 322
00000100:00080000:2.0:1787826454.695481:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787826454.695488:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787826454.695509:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00f2ead00 x1874670272710144/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787826454.695535:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787826454.695542:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787826454.695545:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787826454.695553:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 202
00000100:00080000:2.0:1787826454.695561:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787826454.695568:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787826454.695585:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728f00 x1874670272710272/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787826454.695611:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787826454.695615:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787826454.695617:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787826454.695621:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 434
00000100:00080000:2.0:1787826454.695627:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787826454.695630:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787826454.695638:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572bc00 x1874670272710400/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787826454.695644:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787826454.695650:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787826454.695652:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787826454.695656:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 426
00000100:00080000:2.0:1787826454.695663:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787826454.695670:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787826454.695683:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728780 x1874670272710528/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787826454.695723:0:2367:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00f2e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:b03e141c-10d0-4012-b9b8-d9632d4e5a26:0:1874670272709760:192.168.203.121@tcp:400:kworker.0
00010000:00010000:2.0:1787826455.507506:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1787826459.603519:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1787826460.627526:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1787826464.723644:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00000400:2.0:1787826464.915438:0:2368:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787826448/real 1787826448]  req@ffff9ee0056b6d00 x1874670272707840/t0(0) o400->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 224/224 e 0 to 1 dl 1787826464 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826464.932370:0:2368:0:(client.c:2547:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND:  req@ffff9ee0056b6d00 x1874670272707840/t0(0) o400->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 224/224 e 0 to 1 dl 1787826464 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826464.932385:0:2368:0:(import.c:214:ptlrpc_set_import_discon()) osc: import ffff9ee00986b800 already not connected (conn 4, was 2): CONNECTING
00000100:00000400:2.0:1787826464.932395:0:2368:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787826448/real 1787826448]  req@ffff9ee0056b4000 x1874670272708096/t0(0) o400->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 224/224 e 0 to 1 dl 1787826464 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826464.932408:0:2368:0:(client.c:2547:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND:  req@ffff9ee0056b4000 x1874670272708096/t0(0) o400->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 224/224 e 0 to 1 dl 1787826464 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826464.932416:0:2368:0:(import.c:214:ptlrpc_set_import_discon()) mdc: import ffff9ee0031e9000 already not connected (conn 3, was 1): CONNECTING
00000100:00000400:2.0:1787826464.932422:0:2368:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787826448/real 1787826448]  req@ffff9ee0056b4f00 x1874670272708352/t0(0) o400->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 224/224 e 0 to 1 dl 1787826464 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826464.932434:0:2368:0:(client.c:2547:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND:  req@ffff9ee0056b4f00 x1874670272708352/t0(0) o400->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 224/224 e 0 to 1 dl 1787826464 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826464.932440:0:2368:0:(import.c:214:ptlrpc_set_import_discon()) osc: import ffff9ee0031ec800 already not connected (conn 4, was 2): CONNECTING
00000100:00100000:2.0:1787826464.932456:0:2368:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056b6d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2368:1874670272707840:192.168.203.121@tcp:400:kworker.0
00000100:00100000:2.0:1787826464.932462:0:2368:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2368:1874670272708096:192.168.203.121@tcp:400:kworker.0
00000100:00100000:2.0:1787826464.932466:0:2368:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056b4f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2368:1874670272708352:192.168.203.121@tcp:400:kworker.0
00010000:00010000:2.0:1787826465.747580:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00000400:2.0:1787826469.011463:0:2367:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787826453/real 1787826453]  req@ffff9ee0056b5a40 x1874670272708736/t0(0) o400->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 224/224 e 0 to 1 dl 1787826469 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826469.035053:0:2367:0:(client.c:2547:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND:  req@ffff9ee0056b5a40 x1874670272708736/t0(0) o400->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 224/224 e 0 to 1 dl 1787826469 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826469.035068:0:2367:0:(import.c:214:ptlrpc_set_import_discon()) osc: import ffff9ee00986b800 already not connected (conn 4, was 2): CONNECTING
00000100:00000400:2.0:1787826469.035076:0:2367:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787826453/real 1787826453]  req@ffff9ee0056b43c0 x1874670272708992/t0(0) o400->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 224/224 e 0 to 1 dl 1787826469 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826469.035087:0:2367:0:(client.c:2547:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND:  req@ffff9ee0056b43c0 x1874670272708992/t0(0) o400->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 224/224 e 0 to 1 dl 1787826469 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826469.035094:0:2367:0:(import.c:214:ptlrpc_set_import_discon()) mdc: import ffff9ee0031e9000 already not connected (conn 3, was 1): CONNECTING
00000100:00000400:2.0:1787826469.035100:0:2367:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787826453/real 1787826453]  req@ffff9ee0056b7c00 x1874670272709248/t0(0) o400->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 224/224 e 0 to 1 dl 1787826469 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826469.035110:0:2367:0:(client.c:2547:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND:  req@ffff9ee0056b7c00 x1874670272709248/t0(0) o400->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 224/224 e 0 to 1 dl 1787826469 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826469.035116:0:2367:0:(import.c:214:ptlrpc_set_import_discon()) osc: import ffff9ee0031ec800 already not connected (conn 4, was 2): CONNECTING
00000100:00100000:2.0:1787826469.035130:0:2367:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056b5a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2367:1874670272708736:192.168.203.121@tcp:400:kworker.0
00000100:00100000:2.0:1787826469.035136:0:2367:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056b43c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2367:1874670272708992:192.168.203.121@tcp:400:kworker.0
00000100:00100000:2.0:1787826469.035140:0:2367:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056b7c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2367:1874670272709248:192.168.203.121@tcp:400:kworker.0
00010000:00010000:2.0:1787826469.843605:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1787826470.867574:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1787826474.964004:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1787826475.155933:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787826475.155941:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1787826475.155945:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787826475.155949:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1787826475.155952:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787826475.155955:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1787826475.155957:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787826475.155960:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1787826475.155961:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787826475.155963:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1787826475.155964:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787826475.155966:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1787826475.155967:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787826475.155969:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING)
00010000:00010000:2.0:1787826475.987495:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787826479.251437:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787826464/real 1787826464]  req@ffff9ee0057052c0 x1874670272711424/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787826479 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826479.251468:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057052c0 x1874670272711424/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787826479 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826479.251479:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787826464/real 1787826464]  req@ffff9ee0057070c0 x1874670272711296/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826479 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826479.251489:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057070c0 x1874670272711296/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826479 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826479.251498:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787826464/real 1787826464]  req@ffff9ee005706940 x1874670272711168/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826479 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826479.251508:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706940 x1874670272711168/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826479 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826479.251516:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787826464/real 1787826464]  req@ffff9ee005705680 x1874670272710912/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826479 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826479.251526:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705680 x1874670272710912/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826479 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826479.251534:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787826464/real 1787826464]  req@ffff9ee005707c00 x1874670272711040/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826479 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826479.251544:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707c00 x1874670272711040/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826479 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826479.251552:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787826464/real 1787826464]  req@ffff9ee005704000 x1874670272710656/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826479 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826479.251562:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704000 x1874670272710656/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826479 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826479.251571:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787826464/real 1787826464]  req@ffff9ee005706580 x1874670272710784/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826479 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826479.251583:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706580 x1874670272710784/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826479 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826479.251606:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826479.251631:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826479.251636:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272711424:192.168.203.121@tcp:250:kworker.0
00000100:00080000:2.0:1787826479.251642:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826479.251647:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826479.251650:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272711296:192.168.203.121@tcp:8:kworker.0
00000100:00080000:2.0:1787826479.251655:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826479.251664:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826479.251668:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272711168:192.168.203.121@tcp:8:kworker.0
00000100:00080000:2.0:1787826479.251673:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826479.251678:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826479.251682:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272710912:192.168.203.121@tcp:8:kworker.0
00000100:00080000:2.0:1787826479.251688:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826479.251712:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826479.251717:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272711040:192.168.203.121@tcp:38:kworker.0
00000100:00080000:2.0:1787826479.251724:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826479.251733:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826479.251740:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272710656:192.168.203.121@tcp:38:kworker.0
00000100:00080000:2.0:1787826479.251745:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826479.251750:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826479.251754:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272710784:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787826479.251978:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272711552:192.168.203.121@tcp:250:kworker.0
00000100:00100000:2.0:1787826479.252076:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272711680:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787826479.252110:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272711808:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787826479.252143:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272711936:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787826479.252185:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272712064:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787826479.252218:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272712192:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787826479.252300:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272712320:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787826480.083509:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1787826481.107487:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000800:00000100:2.0:1787826482.579518:0:2356:0:(socklnd_cb.c:2254:ksocknal_find_timed_out_conn()) A connection with 12345-192.168.203.121@tcp (192.168.203.121:988) timed out; the network or node may be down.
00000100:00080000:2.0:1787826484.371840:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787826484.371849:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1787826484.371852:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787826484.371855:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1787826484.371858:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787826484.371861:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1787826484.371863:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787826484.371865:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1787826484.371867:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787826484.371870:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1787826484.371873:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787826484.371884:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING)
00000100:00080000:2.0:1787826484.371887:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787826484.371890:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING)
00010000:00010000:2.0:1787826485.203562:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1787826486.227822:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1787826490.323701:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1787826491.347715:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1787826495.443501:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1787826496.467558:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1787826500.563679:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1787826501.587501:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787826501.845099:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826499/real 1787826501]  req@ffff9ee005704b40 x1874670272712960/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826524 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826501.845130:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704b40 x1874670272712960/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826524 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826501.845141:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826501.845146:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826501.845150:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272712960:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787826501.845158:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826499/real 1787826501]  req@ffff9ee005707480 x1874670272713088/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826524 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826501.845170:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707480 x1874670272713088/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826524 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826501.845178:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826501.845182:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826501.845186:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272713088:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787826501.845192:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826499/real 1787826501]  req@ffff9ee0057061c0 x1874670272713216/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826524 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826501.845205:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057061c0 x1874670272713216/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826524 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826501.845212:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826501.845218:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826501.845220:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272713216:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787826501.845227:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826499/real 1787826501]  req@ffff9ee005704780 x1874670272712448/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826524 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826501.845237:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704780 x1874670272712448/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826524 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826501.845243:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826501.845246:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826501.845249:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272712448:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787826501.845255:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826499/real 1787826501]  req@ffff9ee005705e00 x1874670272712576/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826524 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826501.845265:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705e00 x1874670272712576/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826524 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826501.845273:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826501.845277:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826501.845279:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272712576:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787826501.845286:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826499/real 1787826501]  req@ffff9ee005707840 x1874670272712704/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826524 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826501.845298:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707840 x1874670272712704/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826524 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826501.845305:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826501.845308:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826501.845310:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272712704:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787826501.845347:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826499/real 1787826501]  req@ffff9ee005705a40 x1874670272712832/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787826524 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826501.845359:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705a40 x1874670272712832/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787826524 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826501.845366:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826501.845370:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826501.845373:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272712832:192.168.203.121@tcp:250:kworker.0
00000100:00100000:2.0:1787826504.852031:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272713344:192.168.203.121@tcp:250:kworker.0
00000100:00100000:2.0:1787826504.852198:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272713472:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787826504.852236:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272713600:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787826504.852261:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272713728:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787826504.852304:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272713856:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787826504.852382:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272713984:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787826504.852409:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272714112:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787826504.915956:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826504/real 1787826504]  req@ffff9ee0056e8b40 x1874670272713344/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787826529 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826504.916012:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8b40 x1874670272713344/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787826529 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826504.916026:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826504.916031:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826504.916035:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272713344:192.168.203.121@tcp:250:kworker.0
00000100:00100000:2.0:1787826504.916042:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826504/real 1787826504]  req@ffff9ee0056e8000 x1874670272713472/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826529 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826504.916057:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8000 x1874670272713472/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826529 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826504.916064:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826504.916067:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826504.916071:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272713472:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787826504.916078:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826504/real 1787826504]  req@ffff9ee0056e8780 x1874670272713600/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826529 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826504.916096:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8780 x1874670272713600/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826529 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826504.916115:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826504.916119:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826504.916129:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272713600:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787826504.916139:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826504/real 1787826504]  req@ffff9ee0056e8f00 x1874670272713728/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826529 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826504.916151:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8f00 x1874670272713728/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826529 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826504.916158:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826504.916161:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826504.916165:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272713728:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787826504.916189:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826504/real 1787826504]  req@ffff9ee0056ebc00 x1874670272713856/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826529 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826504.916201:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ebc00 x1874670272713856/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826529 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826504.916209:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826504.916212:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826504.916215:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272713856:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787826504.916221:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826504/real 1787826504]  req@ffff9ee0056e9680 x1874670272713984/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826529 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826504.916233:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9680 x1874670272713984/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826529 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826504.916241:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826504.916244:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826504.916246:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272713984:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787826504.916252:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826504/real 1787826504]  req@ffff9ee0056e92c0 x1874670272714112/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826529 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826504.916263:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e92c0 x1874670272714112/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826529 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826504.916269:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826504.916272:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826504.916275:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272714112:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787826505.683511:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1787826506.707500:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1787826510.803501:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1787826511.827518:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000400:00000100:2.0:1787826512.979676:0:2354:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1021 -> 192.168.203.121:988
00000400:00000100:2.0:1787826512.979715:0:2354:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.203.121@tcp at host 192.168.203.121 was unreachable: the network or that node may be down, or Lustre may be misconfigured.
00000800:00000100:2.0:1787826512.979772:0:2354:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:2.0:1787826512.979812:0:2354:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:2.0:1787826512.979822:0:2354:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:2.0:1787826512.979832:0:2354:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:2.0:1787826512.979854:0:2354:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:2.0:1787826512.979872:0:2354:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:2.0:1787826512.979895:0:2354:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000100:00080000:2.0:1787826515.091625:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787826515.091635:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787826515.091640:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787826515.091650:0:8:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 1678
00000100:00080000:2.0:1787826515.091699:0:8:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787826515.091707:0:8:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787826515.091740:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b0c0 x1874670272715136/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787826515.091762:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787826515.091765:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787826515.091767:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787826515.091770:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 1678
00000100:00080000:2.0:1787826515.091774:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787826515.091778:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787826515.091786:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787826515.091797:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a580 x1874670272715264/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787826515.091805:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787826515.091808:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787826515.091809:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787826515.091812:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 1678
00000100:00080000:2.0:1787826515.091816:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787826515.091819:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787826515.091823:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787826515.091831:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728000 x1874670272715392/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787826515.091839:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787826515.091841:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787826515.091843:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787826515.091846:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 1678
00000100:00080000:2.0:1787826515.091848:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787826515.091851:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787826515.091855:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787826515.091863:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057283c0 x1874670272715520/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787826515.091871:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787826515.091874:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787826515.091875:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787826515.091878:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 1678
00000100:00080000:2.0:1787826515.091881:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787826515.091885:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787826515.091888:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787826515.091898:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729a40 x1874670272715648/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787826515.091913:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787826515.091916:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787826515.091918:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787826515.091922:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 1678
00000100:00080000:2.0:1787826515.091925:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787826515.091928:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787826515.091932:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787826515.091942:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572ad00 x1874670272715776/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787826515.091949:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787826515.091952:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787826515.091953:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787826515.091956:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 1678
00000100:00080000:2.0:1787826515.091959:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787826515.091962:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787826515.091966:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787826515.091974:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729e00 x1874670272715904/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00010000:00010000:2.0:1787826515.923479:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1787826516.947795:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1787826520.211462:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787826520.211469:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787826520.211473:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787826520.211480:0:8:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 1683
00000100:00080000:2.0:1787826520.211489:0:8:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787826520.211494:0:8:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787826520.211522:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a940 x1874670272716032/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787826520.211558:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787826520.211561:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787826520.211562:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787826520.211565:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 1683
00000100:00080000:2.0:1787826520.211567:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787826520.211570:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787826520.211577:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787826520.211587:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729e00 x1874670272716160/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787826520.211594:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787826520.211596:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787826520.211597:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787826520.211599:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 1683
00000100:00080000:2.0:1787826520.211601:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787826520.211603:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787826520.211606:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787826520.211623:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572ad00 x1874670272716288/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787826520.211639:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787826520.211642:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787826520.211644:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787826520.211648:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 1683
00000100:00080000:2.0:1787826520.211652:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787826520.211656:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787826520.211661:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787826520.211673:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729a40 x1874670272716416/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787826520.211682:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787826520.211684:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787826520.211686:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787826520.211689:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 1683
00000100:00080000:2.0:1787826520.211692:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787826520.211695:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787826520.211699:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787826520.211715:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057283c0 x1874670272716544/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787826520.211723:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787826520.211726:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787826520.211727:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787826520.211730:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 1683
00000100:00080000:2.0:1787826520.211734:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787826520.211737:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787826520.211740:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787826520.211749:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728000 x1874670272716672/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787826520.211756:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787826520.211763:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787826520.211766:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787826520.211769:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 1683
00000100:00080000:2.0:1787826520.211772:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787826520.211774:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787826520.211778:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787826520.211796:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a580 x1874670272716800/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00010000:00010000:2.0:1787826521.043501:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1787826522.067579:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1787826526.163485:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1787826527.187501:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1787826531.283540:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1787826532.307490:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000400:00000100:2.0:1787826533.523657:0:2355:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1021 -> 192.168.203.121:988
00000400:00000100:2.0:1787826533.523701:0:2355:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.203.121@tcp at host 192.168.203.121 was unreachable: the network or that node may be down, or Lustre may be misconfigured.
00000800:00000100:2.0:1787826533.523716:0:2355:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:2.0:1787826533.523756:0:2355:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:2.0:1787826533.523765:0:2355:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:2.0:1787826533.523778:0:2355:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:2.0:1787826533.523786:0:2355:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:2.0:1787826533.523793:0:2355:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:2.0:1787826533.523800:0:2355:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000100:00100000:2.0:1787826535.573018:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272718720:192.168.203.121@tcp:250:kworker.0
00000800:00000100:2.0:1787826535.573097:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826535.573138:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826535/real 1787826535]  req@ffff9ee0056a0f00 x1874670272718720/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787826560 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826535.573157:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0f00 x1874670272718720/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787826560 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826535.573166:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826535.573170:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826535.573173:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272718720:192.168.203.121@tcp:250:kworker.0
00000100:00100000:2.0:1787826535.573180:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272718848:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787826535.573201:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826535.573213:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826535/real 1787826535]  req@ffff9ee0056a1680 x1874670272718848/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826560 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826535.573224:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1680 x1874670272718848/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826560 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826535.573232:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826535.573235:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826535.573238:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272718848:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787826535.573246:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272718976:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787826535.573266:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826535.573276:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826535/real 1787826535]  req@ffff9ee0056a3c00 x1874670272718976/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826560 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826535.573287:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a3c00 x1874670272718976/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826560 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826535.573294:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826535.573297:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826535.573301:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272718976:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787826535.573307:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272719104:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787826535.573345:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826535.573357:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826535/real 1787826535]  req@ffff9ee0056a2940 x1874670272719104/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826560 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826535.573368:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a2940 x1874670272719104/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826560 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826535.573374:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826535.573377:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826535.573379:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272719104:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787826535.573406:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272719232:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787826535.573437:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826535.573449:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826535/real 1787826535]  req@ffff9ee0056a2d00 x1874670272719232/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826560 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826535.573468:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a2d00 x1874670272719232/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826560 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826535.573475:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826535.573478:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826535.573481:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a2d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272719232:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787826535.573486:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272719360:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787826535.573504:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826535.573515:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826535/real 1787826535]  req@ffff9ee0056a1a40 x1874670272719360/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826560 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826535.573525:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1a40 x1874670272719360/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826560 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826535.573531:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826535.573534:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826535.573536:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272719360:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787826535.573541:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272719488:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787826535.573556:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826535.573565:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826535/real 1787826535]  req@ffff9ee0056a12c0 x1874670272719488/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826560 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826535.573574:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a12c0 x1874670272719488/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826560 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826535.573586:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826535.573589:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826535.573591:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272719488:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787826536.403477:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1787826537.427494:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787826540.692047:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272719616:192.168.203.121@tcp:250:kworker.0
00000800:00000100:2.0:1787826540.692102:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826540.692170:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826540/real 1787826540]  req@ffff9ee0056e9a40 x1874670272719616/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787826565 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826540.692186:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9a40 x1874670272719616/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787826565 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826540.692196:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826540.692199:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826540.692203:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272719616:192.168.203.121@tcp:250:kworker.0
00000100:00100000:2.0:1787826540.692209:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272719744:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787826540.692229:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826540.692240:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826540/real 1787826540]  req@ffff9ee0056ea580 x1874670272719744/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826565 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826540.692250:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ea580 x1874670272719744/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826565 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826540.692256:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826540.692259:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826540.692262:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272719744:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787826540.692267:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272719872:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787826540.692286:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826540.692305:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826540/real 1787826540]  req@ffff9ee0056eb0c0 x1874670272719872/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826565 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826540.692346:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb0c0 x1874670272719872/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826565 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826540.692354:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826540.692357:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826540.692360:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272719872:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787826540.692366:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272720000:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787826540.692382:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826540.692404:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826540/real 1787826540]  req@ffff9ee0056eb480 x1874670272720000/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826565 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826540.692411:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb480 x1874670272720000/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826565 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826540.692415:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826540.692417:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826540.692419:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272720000:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787826540.692422:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272720128:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787826540.692435:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826540.692440:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826540/real 1787826540]  req@ffff9ee0056e9e00 x1874670272720128/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826565 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826540.692446:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9e00 x1874670272720128/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826565 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826540.692450:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826540.692452:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826540.692454:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272720128:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787826540.692456:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272720256:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787826540.692465:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826540.692470:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826540/real 1787826540]  req@ffff9ee0056ea940 x1874670272720256/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826565 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826540.692476:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ea940 x1874670272720256/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826565 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826540.692480:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826540.692482:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826540.692489:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272720256:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787826540.692495:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272720384:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787826540.692511:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826540.692520:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826540/real 1787826540]  req@ffff9ee0056ead00 x1874670272720384/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826565 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826540.692536:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ead00 x1874670272720384/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826565 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826540.692544:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826540.692546:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826540.692549:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272720384:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787826541.523622:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1787826542.547515:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787826545.811674:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272720512:192.168.203.121@tcp:250:kworker.0
00000800:00000100:2.0:1787826545.811727:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826545.811765:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826545/real 1787826545]  req@ffff9ee0056a0780 x1874670272720512/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787826570 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826545.811789:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0780 x1874670272720512/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787826570 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826545.811808:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826545.811814:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826545.811830:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272720512:192.168.203.121@tcp:250:kworker.0
00000100:00100000:2.0:1787826545.811861:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272720640:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787826545.811887:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826545.811900:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826545/real 1787826545]  req@ffff9ee0056a0000 x1874670272720640/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826570 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826545.811920:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0000 x1874670272720640/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826570 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826545.811926:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826545.811930:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826545.811933:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272720640:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787826545.811944:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272720768:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787826545.811972:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826545.811989:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826545/real 1787826545]  req@ffff9ee0056a1e00 x1874670272720768/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826570 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826545.812014:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1e00 x1874670272720768/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826570 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826545.812021:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826545.812025:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826545.812029:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272720768:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787826545.812035:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272720896:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787826545.812054:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826545.812063:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826545/real 1787826545]  req@ffff9ee0056a03c0 x1874670272720896/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826570 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826545.812073:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a03c0 x1874670272720896/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826570 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826545.812080:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826545.812083:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826545.812087:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272720896:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787826545.812092:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272721024:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787826545.812108:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826545.812117:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826545/real 1787826545]  req@ffff9ee0056a2580 x1874670272721024/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826570 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826545.812127:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a2580 x1874670272721024/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826570 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826545.812135:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826545.812138:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826545.812140:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272721024:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787826545.812157:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272721152:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787826545.812175:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826545.812186:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826545/real 1787826545]  req@ffff9ee0056a30c0 x1874670272721152/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826570 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826545.812197:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a30c0 x1874670272721152/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826570 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826545.812203:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826545.812206:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826545.812209:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272721152:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787826545.812215:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272721280:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787826545.812231:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826545.812242:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826545/real 1787826545]  req@ffff9ee0056a0b40 x1874670272721280/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826570 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826545.812252:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0b40 x1874670272721280/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826570 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826545.812259:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826545.812261:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826545.812264:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272721280:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787826546.643530:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787826550.931613:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272721408:192.168.203.121@tcp:250:kworker.0
00000100:00100000:2.0:1787826550.931718:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272721536:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787826550.931750:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272721664:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787826550.931778:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272721792:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787826550.931801:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272721920:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787826550.931826:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272722048:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787826550.931915:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272722176:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787826551.763537:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1787826556.883490:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1787826562.003495:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1787826566.291518:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787826566.291528:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787826566.291532:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787826566.291543:0:8:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 1730
00000100:00080000:2.0:1787826566.291553:0:8:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787826566.291560:0:8:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787826566.291595:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728b40 x1874670272724096/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787826566.291625:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787826566.291629:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787826566.291631:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787826566.291647:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 1730
00000100:00080000:2.0:1787826566.291651:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787826566.291656:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787826566.291664:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787826566.291677:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b840 x1874670272724224/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787826566.291689:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787826566.291693:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787826566.291696:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787826566.291704:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 1730
00000100:00080000:2.0:1787826566.291709:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787826566.291712:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787826566.291717:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787826566.291728:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057292c0 x1874670272724352/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787826566.291743:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787826566.291747:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787826566.291749:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787826566.291752:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 1730
00000100:00080000:2.0:1787826566.291757:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787826566.291765:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787826566.291771:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787826566.291783:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a1c0 x1874670272724480/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787826566.291792:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787826566.291795:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787826566.291797:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787826566.291804:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 1730
00000100:00080000:2.0:1787826566.291812:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787826566.291818:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787826566.291826:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787826566.291841:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728780 x1874670272724608/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787826566.291857:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787826566.291862:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787826566.291865:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787826566.291871:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 1730
00000100:00080000:2.0:1787826566.291875:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787826566.291879:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787826566.291883:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787826566.291903:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572bc00 x1874670272724736/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787826566.291914:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787826566.291918:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787826566.291920:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787826566.291928:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 1730
00000100:00080000:2.0:1787826566.291933:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787826566.291937:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787826566.291944:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787826566.291962:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728f00 x1874670272724864/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00010000:00010000:2.0:1787826567.123479:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1787826572.243551:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1787826581.651561:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787826581.651576:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787826581.651581:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787826581.651593:0:8:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 1745
00000100:00080000:2.0:1787826581.651606:0:8:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787826581.651613:0:8:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787826581.651645:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729680 x1874670272726784/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787826581.651682:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787826581.651686:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787826581.651688:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787826581.651692:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 1745
00000100:00080000:2.0:1787826581.651695:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787826581.651699:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787826581.651712:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787826581.651726:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728f00 x1874670272726912/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787826581.651735:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787826581.651738:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787826581.651740:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787826581.651743:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 1745
00000100:00080000:2.0:1787826581.651746:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787826581.651749:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787826581.651753:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787826581.651760:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572bc00 x1874670272727040/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787826581.651768:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787826581.651771:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787826581.651773:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787826581.651776:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 1745
00000100:00080000:2.0:1787826581.651779:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787826581.651782:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787826581.651786:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787826581.651794:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728780 x1874670272727168/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787826581.651803:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787826581.651806:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787826581.651808:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787826581.651812:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 1745
00000100:00080000:2.0:1787826581.651816:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787826581.651819:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787826581.651824:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787826581.651857:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a1c0 x1874670272727296/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787826581.651867:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787826581.651870:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787826581.651872:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787826581.651880:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 1745
00000100:00080000:2.0:1787826581.651884:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787826581.651889:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787826581.651896:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787826581.651918:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057292c0 x1874670272727424/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787826581.651937:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787826581.651941:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787826581.651944:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787826581.651948:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 1745
00000100:00080000:2.0:1787826581.651962:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787826581.651965:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787826581.651970:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787826581.651985:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b840 x1874670272727552/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787826586.771427:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787826586.771434:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787826586.771438:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787826586.771445:0:8:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 1750
00000100:00080000:2.0:1787826586.771454:0:8:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787826586.771461:0:8:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787826586.771497:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728b40 x1874670272727680/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787826586.771523:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787826586.771527:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787826586.771528:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787826586.771532:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 1750
00000100:00080000:2.0:1787826586.771535:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787826586.771539:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787826586.771549:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787826586.771565:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b0c0 x1874670272727808/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787826586.771582:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787826586.771585:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787826586.771587:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787826586.771591:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 1750
00000100:00080000:2.0:1787826586.771595:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787826586.771598:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787826586.771604:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787826586.771615:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b480 x1874670272727936/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787826586.771624:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787826586.771628:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787826586.771630:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787826586.771633:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 1750
00000100:00080000:2.0:1787826586.771637:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787826586.771640:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787826586.771644:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787826586.771655:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a580 x1874670272728064/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787826586.771664:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787826586.771668:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787826586.771670:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787826586.771678:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 1750
00000100:00080000:2.0:1787826586.771682:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787826586.771775:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787826586.771783:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787826586.771799:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728000 x1874670272728192/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787826586.771809:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787826586.771813:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787826586.771816:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787826586.771824:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 1750
00000100:00080000:2.0:1787826586.771828:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787826586.771833:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787826586.771838:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787826586.771854:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729e00 x1874670272728320/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787826586.771866:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787826586.771872:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787826586.771874:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787826586.771879:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 1750
00000100:00080000:2.0:1787826586.771884:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787826586.771891:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787826586.771898:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787826586.771912:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a940 x1874670272728448/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000400:00000100:2.0:1787826589.844433:0:2354:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.203.121:988
00000400:00000100:2.0:1787826589.844506:0:2354:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.203.121@tcp at host 192.168.203.121 was unreachable: the network or that node may be down, or Lustre may be misconfigured.
00000800:00000100:2.0:1787826589.844529:0:2354:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:2.0:1787826589.844586:0:2354:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:2.0:1787826589.844602:0:2354:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:2.0:1787826589.844619:0:2354:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:2.0:1787826589.844629:0:2354:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:2.0:1787826589.844638:0:2354:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:2.0:1787826589.844645:0:2354:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000100:00080000:2.0:1787826591.891490:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787826591.891504:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787826591.891509:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787826591.891522:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 1755
00000100:00080000:2.0:1787826591.891537:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787826591.891547:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787826591.891597:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a580 x1874670272728576/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787826591.891632:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787826591.891636:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787826591.891651:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787826591.891655:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 1755
00000100:00080000:2.0:1787826591.891659:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787826591.891664:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787826591.891684:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787826591.891698:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b480 x1874670272728704/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787826591.891714:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787826591.891719:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787826591.891721:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787826591.891725:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 1755
00000100:00080000:2.0:1787826591.891728:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787826591.891732:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787826591.891739:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787826591.891750:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b0c0 x1874670272728832/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787826591.891760:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787826591.891764:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787826591.891765:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787826591.891769:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 1755
00000100:00080000:2.0:1787826591.891773:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787826591.891777:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787826591.891782:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787826591.891795:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728000 x1874670272728960/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787826591.891810:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787826591.891814:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787826591.891816:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787826591.891822:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 1755
00000100:00080000:2.0:1787826591.891827:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787826591.891832:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787826591.891837:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787826591.891849:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729e00 x1874670272729088/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787826591.891858:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787826591.891861:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787826591.891863:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787826591.891867:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 1755
00000100:00080000:2.0:1787826591.891872:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787826591.891877:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787826591.891884:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787826591.891901:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a940 x1874670272729216/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787826591.891911:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787826591.891919:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787826591.891923:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787826591.891931:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 1755
00000100:00080000:2.0:1787826591.891936:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787826591.891944:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787826591.891960:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787826591.891975:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b840 x1874670272729344/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787826597.011423:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787826597.011433:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787826597.011437:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787826597.011447:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 1760
00000100:00080000:2.0:1787826597.011457:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787826597.011476:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787826597.011510:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057292c0 x1874670272729472/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787826597.011536:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787826597.011540:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787826597.011542:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787826597.011546:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 1760
00000100:00080000:2.0:1787826597.011551:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787826597.011555:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787826597.011565:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787826597.011581:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a1c0 x1874670272729600/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787826597.011592:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787826597.011596:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787826597.011598:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787826597.011602:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 1760
00000100:00080000:2.0:1787826597.011618:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787826597.011625:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787826597.011632:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787826597.011646:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728780 x1874670272729728/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787826597.011655:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787826597.011658:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787826597.011660:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787826597.011666:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 1760
00000100:00080000:2.0:1787826597.011670:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787826597.011677:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787826597.011686:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787826597.011699:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572bc00 x1874670272729856/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787826597.011725:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787826597.011733:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787826597.011737:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787826597.011742:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 1760
00000100:00080000:2.0:1787826597.011746:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787826597.011750:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787826597.011761:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787826597.011773:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728f00 x1874670272729984/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787826597.011780:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787826597.011786:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787826597.011791:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787826597.011796:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 1760
00000100:00080000:2.0:1787826597.011801:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787826597.011807:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787826597.011815:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787826597.011830:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729680 x1874670272730112/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787826597.011865:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787826597.011873:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787826597.011876:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787826597.011880:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 1760
00000100:00080000:2.0:1787826597.011885:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787826597.011889:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787826597.011894:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787826597.011911:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057292c0 x1874670272730240/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787826602.131459:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00100000:2.0:1787826603.155432:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00100000:2.0:1787826608.275461:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:2.0:1787826612.371444:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787826612.371451:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787826612.371456:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787826612.371466:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 1776
00000100:00080000:2.0:1787826612.371479:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787826612.371485:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787826612.371529:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057283c0 x1874670272732288/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787826612.371571:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787826612.371576:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787826612.371577:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787826612.371581:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 1776
00000100:00080000:2.0:1787826612.371585:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787826612.371589:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787826612.371601:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787826612.371614:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b840 x1874670272732416/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787826612.371623:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787826612.371626:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787826612.371628:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787826612.371631:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 1776
00000100:00080000:2.0:1787826612.371635:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787826612.371639:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787826612.371645:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787826612.371655:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a940 x1874670272732544/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787826612.371663:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787826612.371674:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787826612.371676:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787826612.371679:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 1776
00000100:00080000:2.0:1787826612.371682:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787826612.371686:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787826612.371690:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787826612.371700:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729e00 x1874670272732672/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787826612.371707:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787826612.371709:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787826612.371715:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787826612.371718:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 1776
00000100:00080000:2.0:1787826612.371720:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787826612.371723:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787826612.371726:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787826612.371732:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728000 x1874670272732800/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787826612.371737:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787826612.371740:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787826612.371741:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787826612.371743:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 1776
00000100:00080000:2.0:1787826612.371744:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787826612.371746:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787826612.371749:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787826612.371754:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b0c0 x1874670272732928/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787826612.371760:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787826612.371761:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787826612.371762:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787826612.371764:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 1776
00000100:00080000:2.0:1787826612.371765:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787826612.371767:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787826612.371770:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787826612.371774:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b480 x1874670272733056/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787826617.491443:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00100000:2.0:1787826618.515456:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00100000:2.0:1787826619.539452:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00100000:2.0:1787826620.563647:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00100000:2.0:1787826621.588024:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00100000:2.0:1787826622.611404:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00100000:2.0:1787826626.708161:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:2.0:1787826627.732190:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787826627.732200:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787826627.732214:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787826627.732225:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 1791
00000100:00080000:2.0:1787826627.732242:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787826627.732253:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787826627.732287:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a580 x1874670272734976/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787826627.732312:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787826627.732333:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787826627.732335:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787826627.732339:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 1791
00000100:00080000:2.0:1787826627.732343:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787826627.732348:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787826627.732357:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787826627.732369:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728b40 x1874670272735104/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787826627.732379:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787826627.732383:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787826627.732390:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787826627.732397:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 1791
00000100:00080000:2.0:1787826627.732401:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787826627.732408:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787826627.732414:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787826627.732425:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729a40 x1874670272735232/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787826627.732435:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787826627.732439:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787826627.732441:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787826627.732444:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 1791
00000100:00080000:2.0:1787826627.732448:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787826627.732452:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787826627.732457:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787826627.732480:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572ad00 x1874670272735360/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787826627.732490:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787826627.732493:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787826627.732495:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787826627.732499:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 1791
00000100:00080000:2.0:1787826627.732503:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787826627.732507:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787826627.732511:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787826627.732524:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b480 x1874670272735488/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787826627.732539:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787826627.732545:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787826627.732549:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787826627.732557:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 1791
00000100:00080000:2.0:1787826627.732560:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787826627.732563:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787826627.732567:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787826627.732579:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b0c0 x1874670272735616/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787826627.732595:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787826627.732604:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787826627.732607:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787826627.732614:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 1791
00000100:00080000:2.0:1787826627.732620:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787826627.732624:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787826627.732629:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787826627.732640:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728000 x1874670272735744/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787826637.971606:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787826637.971611:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787826637.971615:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787826637.971624:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 1801
00000100:00080000:2.0:1787826637.971634:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787826637.971641:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787826637.971674:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729e00 x1874670272736768/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787826637.972470:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787826637.972474:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787826637.972476:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787826637.972481:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 1801
00000100:00080000:2.0:1787826637.972486:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787826637.972490:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787826637.972499:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787826637.972513:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a940 x1874670272736896/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787826637.972949:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787826637.972953:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787826637.972955:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787826637.972959:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 1801
00000100:00080000:2.0:1787826637.972963:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787826637.972967:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787826637.972972:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787826637.972984:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b840 x1874670272737024/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787826637.972993:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787826637.972996:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787826637.972998:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787826637.973001:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 1801
00000100:00080000:2.0:1787826637.973004:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787826637.973007:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787826637.973010:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787826637.973018:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057283c0 x1874670272737152/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787826637.973026:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787826637.973028:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787826637.973030:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787826637.973034:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 1801
00000100:00080000:2.0:1787826637.973037:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787826637.973040:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787826637.973043:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787826637.973050:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057292c0 x1874670272737280/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787826637.973058:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787826637.973060:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787826637.973062:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787826637.973065:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 1801
00000100:00080000:2.0:1787826637.973067:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787826637.973070:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787826637.973074:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787826637.973081:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729680 x1874670272737408/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787826637.973088:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787826637.973091:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787826637.973093:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787826637.973096:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 1801
00000100:00080000:2.0:1787826637.973098:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787826637.973101:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787826637.973105:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787826637.973113:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728f00 x1874670272737536/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787826643.091670:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00100000:2.0:1787826644.115452:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00100000:2.0:1787826645.139449:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00100000:2.0:1787826646.163537:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00100000:2.0:1787826648.212928:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00100000:2.0:1787826649.235419:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00100000:2.0:1787826650.259427:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00100000:2.0:1787826651.283432:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00100000:2.0:1787826652.307445:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00100000:2.0:1787826653.331399:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00100000:2.0:1787826654.355538:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00100000:2.0:1787826655.379504:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00100000:2.0:1787826656.403684:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00100000:2.0:1787826657.427532:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:2.0:1787826658.451841:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787826658.451848:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787826658.451852:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787826658.451861:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 1822
00000100:00080000:2.0:1787826658.451872:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787826658.451880:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787826658.451914:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572bc00 x1874670272740352/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787826658.451941:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787826658.451945:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787826658.451947:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787826658.451951:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 1822
00000100:00080000:2.0:1787826658.451955:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787826658.451960:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787826658.451970:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787826658.451983:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728780 x1874670272740480/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787826658.451995:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787826658.452000:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787826658.452002:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787826658.452006:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 1822
00000100:00080000:2.0:1787826658.452012:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787826658.452018:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787826658.452022:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787826658.452035:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a1c0 x1874670272740608/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787826658.452045:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787826658.452048:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787826658.452050:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787826658.452053:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 1822
00000100:00080000:2.0:1787826658.452058:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787826658.452063:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787826658.452067:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787826658.452082:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728f00 x1874670272740736/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787826658.452097:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787826658.452101:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787826658.452103:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787826658.452107:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 1822
00000100:00080000:2.0:1787826658.452113:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787826658.452121:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787826658.452129:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787826658.452145:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729680 x1874670272740864/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787826658.452160:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787826658.452167:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787826658.452171:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787826658.452180:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 1822
00000100:00080000:2.0:1787826658.452185:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787826658.452188:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787826658.452193:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787826658.452204:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057292c0 x1874670272740992/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787826658.452215:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787826658.452222:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787826658.452223:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787826658.452228:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 1822
00000100:00080000:2.0:1787826658.452232:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787826658.452246:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787826658.452253:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787826658.452266:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057283c0 x1874670272741120/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787826719.892411:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787826719.892414:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787826719.892416:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787826719.892418:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 1883
00000100:00080000:0.0:1787826719.892422:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787826719.892425:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787826719.892430:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787826719.892442:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e92c0 x1874670272751360/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787826719.892450:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787826719.892453:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787826719.892455:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787826719.892459:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 1883
00000100:00080000:0.0:1787826719.892462:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787826719.892466:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787826719.892470:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787826719.892480:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9680 x1874670272751488/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787826719.892489:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787826719.892492:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787826719.892493:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787826719.892496:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 1883
00000100:00080000:0.0:1787826719.892498:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787826719.892501:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787826719.892507:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787826719.892521:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8b40 x1874670272751616/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787826719.892529:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787826719.892531:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787826719.892533:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787826719.892536:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 1883
00000100:00080000:0.0:1787826719.892538:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787826719.892540:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787826719.892544:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787826719.892557:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8000 x1874670272751744/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787826719.892579:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787826719.892584:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787826719.892593:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787826719.892598:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 1883
00000100:00080000:0.0:1787826719.892605:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787826719.892612:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787826719.892617:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787826719.892632:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8780 x1874670272751872/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00010000:00010000:0.0:1787826722.771612:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787826722.965771:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826719/real 1787826722]  req@ffff9ee0056e8780 x1874670272751872/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826744 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826722.965801:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8780 x1874670272751872/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826744 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826722.965813:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826722.965818:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826722.965822:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272751872:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787826722.965830:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826719/real 1787826722]  req@ffff9ee0056e8b40 x1874670272751616/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826744 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826722.965841:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8b40 x1874670272751616/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826744 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826722.965861:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826722.965865:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826722.965868:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272751616:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787826722.965874:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826719/real 1787826722]  req@ffff9ee0056e8000 x1874670272751744/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826744 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826722.965890:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8000 x1874670272751744/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826744 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826722.965897:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826722.965900:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826722.965903:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272751744:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787826722.965908:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826719/real 1787826722]  req@ffff9ee0056e83c0 x1874670272751232/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826744 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826722.965920:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e83c0 x1874670272751232/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826744 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826722.965927:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826722.965930:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826722.965933:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272751232:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787826722.965939:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826719/real 1787826722]  req@ffff9ee0056e92c0 x1874670272751360/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826744 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826722.965949:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e92c0 x1874670272751360/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826744 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826722.965958:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826722.965961:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826722.965964:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272751360:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787826722.965970:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826719/real 1787826722]  req@ffff9ee0056e9680 x1874670272751488/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826744 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826722.965983:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9680 x1874670272751488/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826744 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826722.965992:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826722.965996:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826722.966001:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272751488:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787826722.966011:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826719/real 1787826722]  req@ffff9ee0056eb840 x1874670272751104/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787826744 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826722.966020:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb840 x1874670272751104/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787826744 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826722.966026:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826722.966029:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826722.966035:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272751104:192.168.203.121@tcp:250:kworker.0
00000100:00080000:2.0:1787826725.011524:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787826725.011536:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787826725.011541:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787826725.011554:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 1888
00000100:00080000:2.0:1787826725.011565:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787826725.011574:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787826725.011607:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b840 x1874670272752000/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787826725.011639:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787826725.011646:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787826725.011648:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787826725.011653:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 1888
00000100:00080000:2.0:1787826725.011658:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787826725.011665:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787826725.011676:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787826725.011689:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a940 x1874670272752128/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787826725.011701:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787826725.011706:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787826725.011714:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1787826725.011716:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272752000:192.168.203.121@tcp:250:kworker.0
00000100:00080000:2.0:1787826725.011721:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 1888
00000100:00080000:2.0:1787826725.011729:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787826725.011734:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787826725.011752:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787826725.011770:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729e00 x1874670272752256/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787826725.011780:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787826725.011784:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787826725.011785:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787826725.011789:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 1888
00000100:00080000:2.0:1787826725.011795:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787826725.011799:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787826725.011806:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787826725.011817:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728000 x1874670272752384/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787826725.011826:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787826725.011829:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787826725.011831:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787826725.011835:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 1888
00000100:00080000:2.0:1787826725.011840:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000800:00000100:0.0:1787826725.011844:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:2.0:1787826725.011856:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787826725.011862:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787826725.011879:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b0c0 x1874670272752512/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787826725.011890:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787826725.011894:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787826725.011896:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787826725.011901:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 1888
00000100:00080000:2.0:1787826725.011907:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1787826725.011913:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826725/real 1787826725]  req@ffff9ee00572b840 x1874670272752000/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787826750 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826725.011917:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787826725.011931:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787826725.011951:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b840 x1874670272752000/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787826750 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826725.011952:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b480 x1874670272752640/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787826725.011999:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826725.012000:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787826725.012012:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787826725.012015:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:2.0:1787826725.012017:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1787826725.012026:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272752000:192.168.203.121@tcp:250:kworker.0
00000100:00080000:2.0:1787826725.012035:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 1888
00000100:00080000:2.0:1787826725.012041:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787826725.012046:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787826725.012051:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787826725.012063:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272752128:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787826725.012067:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572ad00 x1874670272752768/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1787826725.012103:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787826725.012138:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826725/real 1787826725]  req@ffff9ee00572a940 x1874670272752128/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826750 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826725.012150:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a940 x1874670272752128/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826750 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826725.012159:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826725.012163:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826725.012166:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272752128:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787826725.012173:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272752256:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787826725.012196:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787826725.012206:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826725/real 1787826725]  req@ffff9ee005729e00 x1874670272752256/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826750 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826725.012225:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729e00 x1874670272752256/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826750 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826725.012233:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826725.012236:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826725.012239:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272752256:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787826725.012245:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272752384:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787826725.012264:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787826725.012273:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826725/real 1787826725]  req@ffff9ee005728000 x1874670272752384/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826750 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826725.012289:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728000 x1874670272752384/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826750 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826725.012296:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826725.012299:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826725.012302:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272752384:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787826725.012308:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272752512:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787826725.012362:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787826725.012374:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826725/real 1787826725]  req@ffff9ee00572b0c0 x1874670272752512/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826750 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826725.012384:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b0c0 x1874670272752512/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826750 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826725.012396:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826725.012400:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826725.012403:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272752512:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787826725.012409:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272752640:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787826725.012428:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787826725.012439:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826725/real 1787826725]  req@ffff9ee00572b480 x1874670272752640/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826750 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826725.012449:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b480 x1874670272752640/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826750 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826725.012457:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826725.012460:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826725.012464:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272752640:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787826725.012491:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272752768:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787826725.012513:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787826725.012525:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826725/real 1787826725]  req@ffff9ee00572ad00 x1874670272752768/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826750 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826725.012536:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572ad00 x1874670272752768/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826750 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826725.012543:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826725.012546:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826725.012555:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272752768:192.168.203.121@tcp:8:kworker.0
00010000:00010000:0.0:1787826727.891526:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1787826730.131425:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787826730.131437:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787826730.131442:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787826730.131451:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 1893
00000100:00080000:2.0:1787826730.131461:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787826730.131468:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787826730.131502:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729a40 x1874670272752896/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787826730.131528:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787826730.131531:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787826730.131533:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787826730.131536:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 1893
00000100:00080000:2.0:1787826730.131539:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787826730.131547:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787826730.131556:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787826730.131566:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728b40 x1874670272753024/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787826730.131580:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272752896:192.168.203.121@tcp:250:kworker.0
00000100:00080000:2.0:1787826730.131583:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787826730.131588:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787826730.131590:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787826730.131593:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 1893
00000100:00080000:2.0:1787826730.131596:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787826730.131599:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787826730.131603:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787826730.131611:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a580 x1874670272753152/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787826730.131619:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787826730.131622:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787826730.131623:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787826730.131626:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 1893
00000100:00080000:2.0:1787826730.131629:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787826730.131632:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787826730.131635:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787826730.131645:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572ad00 x1874670272753280/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787826730.131655:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787826730.131657:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787826730.131658:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787826730.131662:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 1893
00000100:00080000:2.0:1787826730.131666:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787826730.131670:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787826730.131675:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787826730.131685:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b480 x1874670272753408/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787826730.131694:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787826730.131698:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787826730.131699:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787826730.131703:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 1893
00000100:00080000:2.0:1787826730.131706:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000800:00000100:0.0:1787826730.131712:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:2.0:1787826730.131713:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787826730.131720:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787826730.131732:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b0c0 x1874670272753536/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787826730.131740:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787826730.131744:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787826730.131745:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787826730.131749:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 1893
00000100:00080000:2.0:1787826730.131753:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1787826730.131754:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826730/real 1787826730]  req@ffff9ee005729a40 x1874670272752896/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787826755 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826730.131760:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787826730.131768:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787826730.131777:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729a40 x1874670272752896/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787826755 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826730.131781:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728000 x1874670272753664/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787826730.131799:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826730.131810:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826730.131816:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272752896:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787826730.131849:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272753024:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787826730.131872:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787826730.131882:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826730/real 1787826730]  req@ffff9ee005728b40 x1874670272753024/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826755 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826730.131890:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728b40 x1874670272753024/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826755 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826730.131897:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826730.131900:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826730.131904:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272753024:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787826730.131909:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272753152:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787826730.131931:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787826730.131941:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826730/real 1787826730]  req@ffff9ee00572a580 x1874670272753152/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826755 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826730.131951:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a580 x1874670272753152/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826755 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826730.131956:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826730.131958:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826730.131960:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272753152:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787826730.131963:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272753280:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787826730.131976:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787826730.131981:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826730/real 1787826730]  req@ffff9ee00572ad00 x1874670272753280/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826755 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826730.131987:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572ad00 x1874670272753280/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826755 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826730.131992:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826730.131993:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826730.131995:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272753280:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787826730.131998:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272753408:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787826730.132006:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787826730.132012:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826730/real 1787826730]  req@ffff9ee00572b480 x1874670272753408/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826755 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826730.132029:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b480 x1874670272753408/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826755 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826730.132036:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826730.132039:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826730.132042:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272753408:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787826730.132047:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272753536:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787826730.132063:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787826730.132084:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826730/real 1787826730]  req@ffff9ee00572b0c0 x1874670272753536/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826755 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826730.132096:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b0c0 x1874670272753536/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826755 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826730.132103:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826730.132106:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826730.132109:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272753536:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787826730.132115:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272753664:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787826730.132129:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787826730.132138:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826730/real 1787826730]  req@ffff9ee005728000 x1874670272753664/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826755 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826730.132148:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728000 x1874670272753664/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826755 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826730.132157:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826730.132159:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826730.132161:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272753664:192.168.203.121@tcp:8:kworker.0
00010000:00010000:0.0:1787826733.011552:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787826735.251721:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272753792:192.168.203.121@tcp:250:kworker.0
00000800:00000100:0.0:1787826735.251796:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787826735.251855:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826735/real 1787826735]  req@ffff9ee005705e00 x1874670272753792/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787826760 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826735.251881:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705e00 x1874670272753792/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787826760 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826735.251913:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826735.251921:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826735.251931:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272753792:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787826735.251960:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272753920:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787826735.251987:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787826735.252000:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826735/real 1787826735]  req@ffff9ee005707840 x1874670272753920/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826760 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826735.252012:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707840 x1874670272753920/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826760 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826735.252019:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826735.252023:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826735.252026:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272753920:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787826735.252032:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272754048:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787826735.252065:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787826735.252076:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826735/real 1787826735]  req@ffff9ee005704780 x1874670272754048/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826760 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826735.252097:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704780 x1874670272754048/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826760 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826735.252107:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826735.252110:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826735.252124:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272754048:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787826735.252130:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272754176:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787826735.252147:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787826735.252158:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826735/real 1787826735]  req@ffff9ee005705a40 x1874670272754176/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826760 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826735.252168:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705a40 x1874670272754176/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826760 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826735.252175:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826735.252178:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826735.252181:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272754176:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787826735.252186:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272754304:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787826735.252201:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787826735.252216:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826735/real 1787826735]  req@ffff9ee0057061c0 x1874670272754304/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826760 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826735.252226:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057061c0 x1874670272754304/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826760 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826735.252233:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826735.252235:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826735.252238:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272754304:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787826735.252244:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272754432:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787826735.252275:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787826735.252286:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826735/real 1787826735]  req@ffff9ee005707480 x1874670272754432/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826760 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826735.252297:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707480 x1874670272754432/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826760 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826735.252304:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826735.252307:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826735.252309:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272754432:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787826735.252368:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272754560:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787826735.252385:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787826735.252394:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826735/real 1787826735]  req@ffff9ee005704b40 x1874670272754560/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826760 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826735.252404:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704b40 x1874670272754560/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826760 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826735.252411:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826735.252414:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826735.252416:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272754560:192.168.203.121@tcp:8:kworker.0
00010000:00010000:0.0:1787826738.131708:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787826740.371654:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272754688:192.168.203.121@tcp:250:kworker.0
00000800:00000100:0.0:1787826740.371746:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787826740.371807:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826740/real 1787826740]  req@ffff9ee005704000 x1874670272754688/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787826765 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826740.371842:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704000 x1874670272754688/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787826765 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826740.371855:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826740.371865:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826740.371873:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272754688:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787826740.371881:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272754816:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787826740.371911:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787826740.371935:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826740/real 1787826740]  req@ffff9ee005706580 x1874670272754816/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826765 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826740.371955:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706580 x1874670272754816/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826765 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826740.371973:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826740.371977:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826740.371982:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272754816:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787826740.372028:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272754944:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787826740.372047:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787826740.372055:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826740/real 1787826740]  req@ffff9ee005705680 x1874670272754944/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826765 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826740.372063:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705680 x1874670272754944/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826765 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826740.372068:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826740.372070:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826740.372073:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272754944:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787826740.372077:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272755072:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787826740.372086:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787826740.372092:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826740/real 1787826740]  req@ffff9ee005706940 x1874670272755072/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826765 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826740.372098:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706940 x1874670272755072/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826765 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826740.372103:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826740.372104:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826740.372106:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272755072:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787826740.372109:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272755200:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787826740.372118:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787826740.372124:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826740/real 1787826740]  req@ffff9ee005707c00 x1874670272755200/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826765 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826740.372130:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707c00 x1874670272755200/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826765 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826740.372134:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826740.372136:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826740.372138:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272755200:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787826740.372141:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272755328:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787826740.372150:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787826740.372157:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826740/real 1787826740]  req@ffff9ee0057052c0 x1874670272755328/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826765 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826740.372167:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057052c0 x1874670272755328/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826765 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826740.372174:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826740.372183:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826740.372186:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272755328:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787826740.372193:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272755456:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787826740.372212:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787826740.372223:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826740/real 1787826740]  req@ffff9ee0057043c0 x1874670272755456/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826765 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826740.372234:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057043c0 x1874670272755456/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826765 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826740.372241:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826740.372245:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826740.372248:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272755456:192.168.203.121@tcp:8:kworker.0
00010000:00010000:0.0:1787826743.251726:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787826745.491615:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272755584:192.168.203.121@tcp:250:kworker.0
00000800:00000100:0.0:1787826745.491688:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787826745.491738:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826745/real 1787826745]  req@ffff9ee0057070c0 x1874670272755584/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787826770 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826745.491764:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057070c0 x1874670272755584/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787826770 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826745.491785:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826745.491792:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826745.491798:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272755584:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787826745.491806:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272755712:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787826745.491830:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787826745.491844:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826745/real 1787826745]  req@ffff9ee005706d00 x1874670272755712/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826770 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826745.491857:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706d00 x1874670272755712/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826770 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826745.491866:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826745.491869:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826745.491873:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272755712:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787826745.491897:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272755840:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787826745.491920:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787826745.491931:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826745/real 1787826745]  req@ffff9ee0057043c0 x1874670272755840/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826770 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826745.491944:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057043c0 x1874670272755840/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826770 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826745.491951:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826745.491954:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826745.491957:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272755840:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787826745.491978:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272755968:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787826745.492000:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787826745.492012:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826745/real 1787826745]  req@ffff9ee0057052c0 x1874670272755968/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826770 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826745.492023:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057052c0 x1874670272755968/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826770 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826745.492030:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826745.492034:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826745.492037:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272755968:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787826745.492045:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272756096:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787826745.492066:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787826745.492078:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826745/real 1787826745]  req@ffff9ee005707c00 x1874670272756096/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826770 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826745.492090:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707c00 x1874670272756096/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826770 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826745.492097:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826745.492100:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826745.492103:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272756096:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787826745.492109:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272756224:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787826745.492128:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787826745.492141:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826745/real 1787826745]  req@ffff9ee005706940 x1874670272756224/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826770 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826745.492154:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706940 x1874670272756224/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826770 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826745.492163:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826745.492166:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826745.492170:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272756224:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787826745.492177:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272756352:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787826745.492197:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787826745.492209:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826745/real 1787826745]  req@ffff9ee005705680 x1874670272756352/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826770 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826745.492222:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705680 x1874670272756352/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826770 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826745.492230:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826745.492233:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826745.492237:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272756352:192.168.203.121@tcp:8:kworker.0
00010000:00010000:0.0:1787826748.371993:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1787826750.611484:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787826750.611490:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1787826750.611495:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787826750.611505:0:8:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 1914
00000100:00080000:0.0:1787826750.611515:0:8:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787826750.611521:0:8:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787826750.611557:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8f00 x1874670272756480/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787826750.611585:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787826750.611588:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787826750.611590:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787826750.611593:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 1914
00000100:00080000:0.0:1787826750.611597:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787826750.611601:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787826750.611610:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787826750.611623:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ebc00 x1874670272756608/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787826750.611630:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272756480:192.168.203.121@tcp:250:kworker.0
00000100:00080000:0.0:1787826750.611640:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787826750.611645:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787826750.611647:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787826750.611651:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 1914
00000100:00080000:0.0:1787826750.611655:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787826750.611659:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787826750.611664:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787826750.611678:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb840 x1874670272756736/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787826750.611688:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787826750.611691:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787826750.611693:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:2.0:1787826750.611695:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:0.0:1787826750.611700:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 1914
00000100:00080000:0.0:1787826750.611705:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787826750.611709:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787826750.611714:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787826750.611726:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9680 x1874670272756864/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787826750.611735:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1787826750.611740:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826750/real 1787826750]  req@ffff9ee0056e8f00 x1874670272756480/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787826775 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826750.611741:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787826750.611744:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787826750.611753:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 1914
00000100:00080000:0.0:1787826750.611758:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787826750.611762:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787826750.611766:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8f00 x1874670272756480/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787826775 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:0.0:1787826750.611769:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00080000:2.0:1787826750.611783:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:0.0:1787826750.611787:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e92c0 x1874670272756992/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787826750.611791:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826750.611798:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272756480:192.168.203.121@tcp:250:kworker.0
00000100:00080000:0.0:1787826750.611804:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787826750.611808:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787826750.611810:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787826750.611814:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 1914
00000100:00080000:0.0:1787826750.611818:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1787826750.611823:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272756608:192.168.203.121@tcp:38:kworker.0
00000100:00080000:0.0:1787826750.611824:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787826750.611833:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787826750.611847:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e83c0 x1874670272757120/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1787826750.611855:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:0.0:1787826750.611862:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787826750.611866:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787826750.611868:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1787826750.611873:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826750/real 1787826750]  req@ffff9ee0056ebc00 x1874670272756608/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826775 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826750.611875:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 1914
00000100:00080000:0.0:1787826750.611881:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787826750.611888:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787826750.611893:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ebc00 x1874670272756608/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826775 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:0.0:1787826750.611894:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:2.0:1787826750.611907:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:0.0:1787826750.611911:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8000 x1874670272757248/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787826750.611914:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826750.611922:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272756608:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787826750.611947:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272756736:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787826750.611966:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826750.611978:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826750/real 1787826750]  req@ffff9ee0056eb840 x1874670272756736/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826775 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826750.611989:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb840 x1874670272756736/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826775 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826750.611996:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826750.612000:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826750.612002:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272756736:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787826750.612008:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272756864:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787826750.612023:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826750.612032:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826750/real 1787826750]  req@ffff9ee0056e9680 x1874670272756864/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826775 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826750.612042:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9680 x1874670272756864/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826775 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826750.612048:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826750.612051:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826750.612054:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272756864:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787826750.612058:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272756992:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787826750.612074:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826750.612082:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826750/real 1787826750]  req@ffff9ee0056e92c0 x1874670272756992/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826775 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826750.612104:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e92c0 x1874670272756992/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826775 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826750.612111:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826750.612114:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826750.612117:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272756992:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787826750.612131:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272757120:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787826750.612148:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826750.612174:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826750/real 1787826750]  req@ffff9ee0056e83c0 x1874670272757120/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826775 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826750.612185:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e83c0 x1874670272757120/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826775 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826750.612191:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826750.612194:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826750.612197:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272757120:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787826750.612202:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272757248:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787826750.612220:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826750.612230:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826750/real 1787826750]  req@ffff9ee0056e8000 x1874670272757248/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826775 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826750.612240:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8000 x1874670272757248/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826775 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826750.612246:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826750.612249:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826750.612252:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272757248:192.168.203.121@tcp:8:kworker.0
00010000:00010000:0.0:1787826753.491522:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1787826755.731786:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787826755.731795:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787826755.731799:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787826755.731810:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 1919
00000100:00080000:2.0:1787826755.731819:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787826755.731826:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787826755.731860:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729e00 x1874670272757376/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787826755.731884:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787826755.731886:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787826755.731887:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787826755.731899:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 1919
00000100:00080000:2.0:1787826755.731903:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787826755.731908:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787826755.731917:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787826755.731930:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a940 x1874670272757504/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787826755.731938:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272757376:192.168.203.121@tcp:250:kworker.0
00000100:00080000:2.0:1787826755.731944:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787826755.731948:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787826755.731950:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787826755.731954:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 1919
00000100:00080000:2.0:1787826755.731958:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787826755.731963:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787826755.731976:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787826755.731986:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b840 x1874670272757632/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787826755.731993:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787826755.731995:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787826755.731998:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:0.0:1787826755.731999:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:2.0:1787826755.732003:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 1919
00000100:00080000:2.0:1787826755.732007:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787826755.732010:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787826755.732014:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787826755.732024:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057283c0 x1874670272757760/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787826755.732033:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787826755.732036:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787826755.732038:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1787826755.732043:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826755/real 1787826755]  req@ffff9ee005729e00 x1874670272757376/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787826780 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826755.732046:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 1919
00000100:00080000:2.0:1787826755.732052:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787826755.732060:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787826755.732066:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787826755.732067:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729e00 x1874670272757376/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787826780 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826755.732080:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:2.0:1787826755.732080:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057292c0 x1874670272757888/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787826755.732090:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:2.0:1787826755.732092:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1787826755.732097:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272757376:192.168.203.121@tcp:250:kworker.0
00000100:00080000:2.0:1787826755.732097:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787826755.732101:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787826755.732109:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 1919
00000100:00080000:2.0:1787826755.732113:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787826755.732118:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787826755.732123:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787826755.732127:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272757504:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787826755.732135:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729680 x1874670272758016/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787826755.732147:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:0.0:1787826755.732153:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:2.0:1787826755.732161:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787826755.732164:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1787826755.732166:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826755/real 1787826755]  req@ffff9ee00572a940 x1874670272757504/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826780 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826755.732172:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 1919
00000100:00080000:2.0:1787826755.732180:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1787826755.732187:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a940 x1874670272757504/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826780 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826755.732188:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787826755.732197:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:0.0:1787826755.732200:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826755.732206:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826755.732209:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272757504:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787826755.732218:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272757632:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787826755.732224:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728f00 x1874670272758144/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1787826755.732237:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787826755.732248:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826755/real 1787826755]  req@ffff9ee00572b840 x1874670272757632/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826780 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826755.732264:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b840 x1874670272757632/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826780 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826755.732271:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826755.732273:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826755.732276:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272757632:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787826755.732280:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272757760:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787826755.732293:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787826755.732301:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826755/real 1787826755]  req@ffff9ee0057283c0 x1874670272757760/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826780 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826755.732310:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057283c0 x1874670272757760/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826780 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826755.732336:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826755.732339:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826755.732342:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272757760:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787826755.732348:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057292c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272757888:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787826755.732363:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787826755.732372:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826755/real 1787826755]  req@ffff9ee0057292c0 x1874670272757888/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826780 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826755.732381:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057292c0 x1874670272757888/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826780 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826755.732392:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826755.732395:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826755.732406:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057292c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272757888:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787826755.732422:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272758016:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787826755.732437:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787826755.732445:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826755/real 1787826755]  req@ffff9ee005729680 x1874670272758016/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826780 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826755.732456:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729680 x1874670272758016/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826780 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826755.732463:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826755.732466:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826755.732468:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272758016:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787826755.732473:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272758144:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787826755.732486:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787826755.732494:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826755/real 1787826755]  req@ffff9ee005728f00 x1874670272758144/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826780 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826755.732503:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728f00 x1874670272758144/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826780 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826755.732509:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826755.732512:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826755.732515:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272758144:192.168.203.121@tcp:8:kworker.0
00010000:00010000:0.0:1787826758.611519:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1787826760.851418:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787826760.851428:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1787826760.851433:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787826760.851444:0:8:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 1924
00000100:00080000:0.0:1787826760.851456:0:8:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787826760.851464:0:8:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787826760.851499:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8b40 x1874670272758272/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787826760.851535:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787826760.851539:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787826760.851541:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787826760.851544:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 1924
00000100:00080000:0.0:1787826760.851547:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787826760.851551:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787826760.851559:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787826760.851571:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8780 x1874670272758400/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787826760.851572:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272758272:192.168.203.121@tcp:250:kworker.0
00000100:00080000:0.0:1787826760.851596:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787826760.851599:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787826760.851601:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787826760.851605:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 1924
00000100:00080000:0.0:1787826760.851609:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787826760.851614:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787826760.851619:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787826760.851631:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb480 x1874670272758528/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1787826760.851636:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:0.0:1787826760.851642:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787826760.851645:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787826760.851646:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787826760.851649:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 1924
00000100:00080000:0.0:1787826760.851651:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787826760.851654:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787826760.851657:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787826760.851664:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9e00 x1874670272758656/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787826760.851669:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787826760.851672:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787826760.851673:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1787826760.851676:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826760/real 1787826760]  req@ffff9ee0056e8b40 x1874670272758272/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787826785 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826760.851679:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 1924
00000100:00080000:0.0:1787826760.851683:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787826760.851688:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787826760.851694:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787826760.851702:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8b40 x1874670272758272/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787826785 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826760.851703:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ea940 x1874670272758784/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787826760.851732:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787826760.851741:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787826760.851744:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787826760.851746:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826760.851748:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 1924
00000100:00080000:0.0:1787826760.851754:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787826760.851755:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:0.0:1787826760.851762:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787826760.851764:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272758272:192.168.203.121@tcp:250:kworker.0
00000008:00100000:0.0:1787826760.851774:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787826760.851787:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272758400:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787826760.851798:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb0c0 x1874670272758912/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787826760.851810:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787826760.851815:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787826760.851817:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787826760.851821:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 1924
00000800:00000100:2.0:1787826760.851822:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:0.0:1787826760.851826:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787826760.851832:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787826760.851837:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787826760.851841:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826760/real 1787826760]  req@ffff9ee0056e8780 x1874670272758400/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826785 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826760.851851:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ea580 x1874670272759040/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787826760.851870:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8780 x1874670272758400/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826785 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826760.851883:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826760.851887:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826760.851891:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272758400:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787826760.851899:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272758528:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787826760.851920:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826760.851932:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826760/real 1787826760]  req@ffff9ee0056eb480 x1874670272758528/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826785 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826760.851943:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb480 x1874670272758528/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826785 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826760.851950:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826760.851954:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826760.851957:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272758528:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787826760.851963:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272758656:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787826760.851980:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826760.851991:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826760/real 1787826760]  req@ffff9ee0056e9e00 x1874670272758656/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826785 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826760.852002:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9e00 x1874670272758656/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826785 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826760.852010:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826760.852013:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826760.852016:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272758656:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787826760.852021:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272758784:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787826760.852036:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826760.852045:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826760/real 1787826760]  req@ffff9ee0056ea940 x1874670272758784/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826785 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826760.852055:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ea940 x1874670272758784/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826785 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826760.852062:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826760.852065:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826760.852068:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272758784:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787826760.852084:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272758912:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787826760.852100:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826760.852110:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826760/real 1787826760]  req@ffff9ee0056eb0c0 x1874670272758912/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826785 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826760.852120:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb0c0 x1874670272758912/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826785 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826760.852127:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826760.852130:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826760.852132:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272758912:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787826760.852137:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272759040:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787826760.852163:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826760.852173:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826760/real 1787826760]  req@ffff9ee0056ea580 x1874670272759040/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826785 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826760.852183:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ea580 x1874670272759040/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826785 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826760.852190:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826760.852194:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826760.852197:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272759040:192.168.203.121@tcp:8:kworker.0
00010000:00010000:0.0:1787826763.731446:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1787826765.971472:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787826765.971484:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1787826765.971490:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787826765.971507:0:8:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 1929
00000100:00080000:0.0:1787826765.971531:0:8:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787826765.971541:0:8:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787826765.971607:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ead00 x1874670272759168/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787826765.971645:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787826765.971649:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787826765.971651:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787826765.971655:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 1929
00000100:00080000:0.0:1787826765.971659:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787826765.971663:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787826765.971676:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787826765.971690:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9a40 x1874670272759296/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787826765.971703:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1787826765.971706:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272759168:192.168.203.121@tcp:250:kworker.0
00000100:00080000:0.0:1787826765.971708:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787826765.971715:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787826765.971722:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 1929
00000100:00080000:0.0:1787826765.971727:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787826765.971731:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787826765.971737:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787826765.971755:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ea580 x1874670272759424/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787826765.971765:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787826765.971769:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787826765.971771:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787826765.971776:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 1929
00000100:00080000:0.0:1787826765.971781:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787826765.971785:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000800:00000100:2.0:1787826765.971793:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000008:00100000:0.0:1787826765.971797:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787826765.971814:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb0c0 x1874670272759552/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787826765.971836:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787826765.971840:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787826765.971842:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787826765.971848:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 1929
00000100:00100000:2.0:1787826765.971855:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826765/real 1787826765]  req@ffff9ee0056ead00 x1874670272759168/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787826790 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826765.971859:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787826765.971871:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787826765.971880:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787826765.971886:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ead00 x1874670272759168/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787826790 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826765.971898:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ea940 x1874670272759680/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787826765.971953:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787826765.971953:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826765.971965:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826765.971969:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272759168:192.168.203.121@tcp:250:kworker.0
00000100:00100000:2.0:1787826765.971992:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272759296:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787826765.972015:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826765.972027:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826765/real 1787826765]  req@ffff9ee0056e9a40 x1874670272759296/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826790 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826765.972040:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9a40 x1874670272759296/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826790 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826765.972048:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826765.972052:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826765.972055:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272759296:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787826765.972061:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272759424:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787826765.972079:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826765.972091:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826765/real 1787826765]  req@ffff9ee0056ea580 x1874670272759424/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826790 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826765.972102:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ea580 x1874670272759424/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826790 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826765.972110:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826765.972114:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826765.972117:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272759424:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787826765.972124:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272759552:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787826765.972142:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826765.972151:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826765/real 1787826765]  req@ffff9ee0056eb0c0 x1874670272759552/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826790 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826765.972162:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb0c0 x1874670272759552/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826790 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826765.972169:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826765.972173:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826765.972176:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272759552:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787826765.972181:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272759680:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787826765.972198:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826765.972208:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826765/real 1787826765]  req@ffff9ee0056ea940 x1874670272759680/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826790 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826765.972219:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ea940 x1874670272759680/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826790 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826765.972226:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826765.972229:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826765.972232:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272759680:192.168.203.121@tcp:38:kworker.0
00000100:00080000:0.0:1787826765.972419:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787826765.972422:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787826765.972429:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 1929
00000100:00080000:0.0:1787826765.972434:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787826765.972439:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787826765.972446:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787826765.972462:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9e00 x1874670272759808/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787826765.972488:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787826765.972492:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787826765.972494:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787826765.972497:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 1929
00000100:00080000:0.0:1787826765.972501:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787826765.972506:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787826765.972513:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787826765.972529:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb480 x1874670272759936/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787826765.972536:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272759808:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787826765.972577:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826765.972593:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826765/real 1787826765]  req@ffff9ee0056e9e00 x1874670272759808/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826790 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826765.972608:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9e00 x1874670272759808/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826790 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826765.972617:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826765.972619:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826765.972621:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272759808:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787826765.972632:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272759936:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787826765.972649:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826765.972660:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826765/real 1787826765]  req@ffff9ee0056eb480 x1874670272759936/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826790 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826765.972671:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb480 x1874670272759936/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826790 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826765.972678:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826765.972682:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826765.972685:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272759936:192.168.203.121@tcp:8:kworker.0
00010000:00010000:0.0:1787826768.851494:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1787826771.091443:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787826771.091450:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1787826771.091454:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787826771.091463:0:8:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 1934
00000100:00080000:0.0:1787826771.091481:0:8:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787826771.091489:0:8:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787826771.091531:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8780 x1874670272760064/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787826771.091554:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787826771.091556:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787826771.091558:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787826771.091560:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 1934
00000100:00080000:0.0:1787826771.091563:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787826771.091566:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787826771.091573:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787826771.091584:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8b40 x1874670272760192/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787826771.091595:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272760064:192.168.203.121@tcp:250:kworker.0
00000100:00080000:0.0:1787826771.091596:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787826771.091605:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787826771.091614:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787826771.091618:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 1934
00000100:00080000:0.0:1787826771.091622:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787826771.091626:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787826771.091630:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787826771.091639:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8000 x1874670272760320/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787826771.091645:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787826771.091647:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787826771.091648:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787826771.091650:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 1934
00000100:00080000:0.0:1787826771.091653:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787826771.091657:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000800:00000100:2.0:1787826771.091659:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000008:00100000:0.0:1787826771.091661:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787826771.091668:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e83c0 x1874670272760448/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787826771.091674:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787826771.091677:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787826771.091678:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787826771.091681:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 1934
00000100:00080000:0.0:1787826771.091683:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787826771.091685:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787826771.091687:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787826771.091694:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e92c0 x1874670272760576/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787826771.091700:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826771/real 1787826771]  req@ffff9ee0056e8780 x1874670272760064/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787826796 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826771.091701:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787826771.091706:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787826771.091708:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787826771.091715:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 1934
00000100:00080000:0.0:1787826771.091718:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787826771.091720:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787826771.091723:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787826771.091727:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8780 x1874670272760064/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787826796 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826771.091731:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9680 x1874670272760704/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787826771.091751:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787826771.091757:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787826771.091759:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787826771.091760:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826771.091763:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 1934
00000100:00080000:0.0:1787826771.091766:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787826771.091767:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:0.0:1787826771.091770:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787826771.091774:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272760064:192.168.203.121@tcp:250:kworker.0
00000008:00100000:0.0:1787826771.091775:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787826771.091797:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb840 x1874670272760832/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787826771.091807:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272760192:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787826771.091827:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826771.091836:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826771/real 1787826771]  req@ffff9ee0056e8b40 x1874670272760192/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826796 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826771.091844:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8b40 x1874670272760192/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826796 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826771.091849:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826771.091852:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826771.091853:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272760192:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787826771.091858:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272760320:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787826771.091875:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826771.091885:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826771/real 1787826771]  req@ffff9ee0056e8000 x1874670272760320/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826796 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826771.091896:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8000 x1874670272760320/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826796 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826771.091904:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826771.091907:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826771.091909:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272760320:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787826771.091914:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272760448:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787826771.091927:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826771.091934:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826771/real 1787826771]  req@ffff9ee0056e83c0 x1874670272760448/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826796 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826771.091941:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e83c0 x1874670272760448/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826796 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826771.091945:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826771.091947:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826771.091949:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272760448:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787826771.091952:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272760576:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787826771.091960:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826771.091965:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826771/real 1787826771]  req@ffff9ee0056e92c0 x1874670272760576/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826796 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826771.091971:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e92c0 x1874670272760576/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826796 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826771.091976:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826771.091977:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826771.091979:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272760576:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787826771.091982:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272760704:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787826771.091990:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826771.091997:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826771/real 1787826771]  req@ffff9ee0056e9680 x1874670272760704/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826796 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826771.092008:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9680 x1874670272760704/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826796 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826771.092016:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826771.092018:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826771.092021:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272760704:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787826771.092037:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272760832:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787826771.092055:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826771.092066:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826771/real 1787826771]  req@ffff9ee0056eb840 x1874670272760832/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826796 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826771.092078:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb840 x1874670272760832/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826796 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826771.092084:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826771.092086:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826771.092088:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272760832:192.168.203.121@tcp:8:kworker.0
00010000:00010000:0.0:1787826773.971517:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787826776.211937:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272760960:192.168.203.121@tcp:250:kworker.0
00000800:00000100:2.0:1787826776.211995:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826776.212048:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826776/real 1787826776]  req@ffff9ee005706580 x1874670272760960/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787826801 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826776.212063:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706580 x1874670272760960/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787826801 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826776.212077:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826776.212082:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826776.212085:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272760960:192.168.203.121@tcp:250:kworker.0
00000100:00100000:2.0:1787826776.212092:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272761088:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787826776.212113:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826776.212125:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826776/real 1787826776]  req@ffff9ee005704000 x1874670272761088/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826801 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826776.212136:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704000 x1874670272761088/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826801 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826776.212143:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826776.212146:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826776.212149:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272761088:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787826776.212167:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272761216:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787826776.212188:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826776.212205:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826776/real 1787826776]  req@ffff9ee005704b40 x1874670272761216/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826801 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826776.212216:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704b40 x1874670272761216/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826801 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826776.212223:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826776.212226:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826776.212229:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272761216:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787826776.212235:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272761344:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787826776.212253:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826776.212263:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826776/real 1787826776]  req@ffff9ee005707480 x1874670272761344/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826801 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826776.212272:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707480 x1874670272761344/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826801 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826776.212279:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826776.212282:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826776.212285:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272761344:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787826776.212290:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272761472:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787826776.212307:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826776.212353:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826776/real 1787826776]  req@ffff9ee0057061c0 x1874670272761472/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826801 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826776.212365:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057061c0 x1874670272761472/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826801 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826776.212372:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826776.212375:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826776.212378:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272761472:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787826776.212383:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272761600:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787826776.212403:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826776.212413:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826776/real 1787826776]  req@ffff9ee005705a40 x1874670272761600/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826801 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826776.212424:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705a40 x1874670272761600/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826801 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826776.212431:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826776.212434:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826776.212437:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272761600:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787826776.212441:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272761728:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787826776.212458:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826776.212467:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826776/real 1787826776]  req@ffff9ee005704780 x1874670272761728/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826801 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826776.212476:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704780 x1874670272761728/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826801 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826776.212483:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826776.212486:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826776.212489:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272761728:192.168.203.121@tcp:8:kworker.0
00010000:00010000:0.0:1787826779.091537:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787826781.332173:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272761856:192.168.203.121@tcp:250:kworker.0
00000800:00000100:0.0:1787826781.332231:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787826781.332264:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826781/real 1787826781]  req@ffff9ee005707840 x1874670272761856/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787826806 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826781.332278:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707840 x1874670272761856/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787826806 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826781.332286:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826781.332290:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826781.332294:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272761856:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787826781.332300:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272761984:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787826781.332351:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787826781.332367:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826781/real 1787826781]  req@ffff9ee005705e00 x1874670272761984/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826806 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826781.332378:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705e00 x1874670272761984/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826806 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826781.332385:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826781.332389:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826781.332392:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272761984:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787826781.332397:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272762112:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787826781.332416:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787826781.332425:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826781/real 1787826781]  req@ffff9ee005704780 x1874670272762112/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826806 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826781.332435:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704780 x1874670272762112/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826806 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826781.332441:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826781.332444:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826781.332447:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272762112:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787826781.332452:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272762240:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787826781.332466:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787826781.332474:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826781/real 1787826781]  req@ffff9ee005705a40 x1874670272762240/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826806 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826781.332482:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705a40 x1874670272762240/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826806 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826781.332488:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826781.332491:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826781.332494:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272762240:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787826781.332499:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272762368:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787826781.332512:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787826781.332519:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826781/real 1787826781]  req@ffff9ee0057061c0 x1874670272762368/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826806 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826781.332528:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057061c0 x1874670272762368/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826806 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826781.332534:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826781.332537:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826781.332539:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272762368:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787826781.332543:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272762496:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787826781.332556:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787826781.332563:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826781/real 1787826781]  req@ffff9ee005707480 x1874670272762496/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826806 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826781.332572:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707480 x1874670272762496/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826806 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826781.332578:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826781.332581:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826781.332583:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272762496:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787826781.332588:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272762624:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787826781.332601:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787826781.332609:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826781/real 1787826781]  req@ffff9ee005704b40 x1874670272762624/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826806 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826781.332619:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704b40 x1874670272762624/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826806 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826781.332626:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826781.332629:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826781.332631:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272762624:192.168.203.121@tcp:8:kworker.0
00010000:00010000:0.0:1787826784.211507:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787826786.451939:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272762752:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787826786.452021:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272762880:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787826786.452044:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272763008:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787826786.452063:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272763136:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787826786.452083:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272763264:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787826786.452100:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272763392:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787826786.452119:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272763520:192.168.203.121@tcp:8:kworker.0
00010000:00010000:0.0:1787826789.331523:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787826789.523728:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826786/real 1787826789]  req@ffff9ee005704000 x1874670272762752/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787826811 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826789.523757:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704000 x1874670272762752/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787826811 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826789.523769:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826789.523774:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826789.523778:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272762752:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787826789.523785:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826786/real 1787826789]  req@ffff9ee005706580 x1874670272762880/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826811 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826789.523797:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706580 x1874670272762880/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826811 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826789.523805:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826789.523808:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826789.523812:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272762880:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787826789.523818:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826786/real 1787826789]  req@ffff9ee005705680 x1874670272763008/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826811 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826789.523829:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705680 x1874670272763008/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826811 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826789.523835:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826789.523838:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826789.523841:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272763008:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787826789.523847:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826786/real 1787826789]  req@ffff9ee005706940 x1874670272763136/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826811 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826789.523857:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706940 x1874670272763136/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826811 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826789.523863:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826789.523866:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826789.523869:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272763136:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787826789.523874:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826786/real 1787826789]  req@ffff9ee005707c00 x1874670272763264/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826811 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826789.523885:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707c00 x1874670272763264/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826811 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826789.523892:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826789.523895:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826789.523898:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272763264:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787826789.523904:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826786/real 1787826789]  req@ffff9ee0057052c0 x1874670272763392/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826811 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826789.523914:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057052c0 x1874670272763392/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826811 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826789.523922:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826789.523925:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826789.523928:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272763392:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787826789.523932:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826786/real 1787826789]  req@ffff9ee0057043c0 x1874670272763520/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826811 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826789.523939:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057043c0 x1874670272763520/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826811 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826789.523944:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826789.523946:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826789.523947:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272763520:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787826791.571584:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272763648:192.168.203.121@tcp:250:kworker.0
00000800:00000100:0.0:1787826791.571639:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787826791.571776:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826791/real 1787826791]  req@ffff9ee0056a0780 x1874670272763648/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787826816 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826791.571791:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0780 x1874670272763648/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787826816 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826791.571800:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826791.571804:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826791.571808:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272763648:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787826791.571832:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272763776:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787826791.571856:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787826791.571869:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826791/real 1787826791]  req@ffff9ee0056a0000 x1874670272763776/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826816 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826791.571880:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0000 x1874670272763776/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826816 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826791.571888:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826791.571891:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826791.571894:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272763776:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787826791.572172:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272763904:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787826791.572197:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787826791.572209:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826791/real 1787826791]  req@ffff9ee0056a1e00 x1874670272763904/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826816 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826791.572221:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1e00 x1874670272763904/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826816 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826791.572229:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826791.572232:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826791.572235:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272763904:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787826791.572241:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272764032:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787826791.572259:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787826791.572276:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826791/real 1787826791]  req@ffff9ee0056a03c0 x1874670272764032/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826816 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826791.572286:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a03c0 x1874670272764032/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826816 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826791.572294:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826791.572297:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826791.572300:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272764032:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787826791.572306:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272764160:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787826791.572362:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787826791.572374:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826791/real 1787826791]  req@ffff9ee0056a2580 x1874670272764160/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826816 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826791.572386:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a2580 x1874670272764160/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826816 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826791.572398:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826791.572401:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826791.572404:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272764160:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787826791.572409:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272764288:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787826791.572426:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787826791.572435:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826791/real 1787826791]  req@ffff9ee0056a3480 x1874670272764288/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826816 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826791.572446:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a3480 x1874670272764288/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826816 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826791.572453:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826791.572456:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826791.572459:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272764288:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787826791.572464:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272764416:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787826791.572480:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787826791.572489:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826791/real 1787826791]  req@ffff9ee0056a0b40 x1874670272764416/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826816 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826791.572500:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0b40 x1874670272764416/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826816 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826791.572507:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826791.572510:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826791.572513:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272764416:192.168.203.121@tcp:8:kworker.0
00010000:00010000:0.0:1787826794.451830:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1787826796.691445:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787826796.691452:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1787826796.691455:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787826796.691468:0:8:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 1960
00000100:00080000:0.0:1787826796.691478:0:8:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787826796.691486:0:8:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787826796.691520:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ebc00 x1874670272764544/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787826796.691551:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787826796.691555:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787826796.691557:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787826796.691560:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 1960
00000100:00080000:0.0:1787826796.691564:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787826796.691568:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787826796.691577:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787826796.691601:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272764544:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787826796.691602:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8f00 x1874670272764672/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787826796.691630:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787826796.691633:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787826796.691635:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787826796.691639:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 1960
00000100:00080000:0.0:1787826796.691643:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787826796.691647:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787826796.691652:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787826796.691664:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb840 x1874670272764800/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787826796.691674:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787826796.691677:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787826796.691679:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:2.0:1787826796.691684:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:0.0:1787826796.691685:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 1960
00000100:00080000:0.0:1787826796.691692:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787826796.691696:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787826796.691701:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787826796.691712:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9680 x1874670272764928/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787826796.691719:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787826796.691721:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787826796.691723:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787826796.691728:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 1960
00000100:00100000:2.0:1787826796.691728:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826796/real 1787826796]  req@ffff9ee0056ebc00 x1874670272764544/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787826821 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826796.691733:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787826796.691738:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787826796.691744:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787826796.691753:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e92c0 x1874670272765056/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787826796.691759:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ebc00 x1874670272764544/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787826821 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826796.691760:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787826796.691769:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787826796.691772:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787826796.691778:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 1960
00000100:00080000:2.0:1787826796.691785:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826796.691790:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:0.0:1787826796.691791:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1787826796.691795:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272764544:192.168.203.121@tcp:250:kworker.0
00000100:00080000:0.0:1787826796.691799:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787826796.691805:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787826796.691816:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e83c0 x1874670272765184/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787826796.691821:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272764672:192.168.203.121@tcp:38:kworker.0
00000100:00080000:0.0:1787826796.691832:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787826796.691835:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787826796.691837:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787826796.691842:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 1960
00000100:00080000:0.0:1787826796.691847:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000800:00000100:2.0:1787826796.691852:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:0.0:1787826796.691853:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787826796.691861:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787826796.691870:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826796/real 1787826796]  req@ffff9ee0056e8f00 x1874670272764672/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826821 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826796.691876:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8000 x1874670272765312/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787826796.691884:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8f00 x1874670272764672/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826821 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826796.691897:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826796.691901:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826796.691904:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272764672:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787826796.691912:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272764800:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787826796.691953:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826796.691965:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826796/real 1787826796]  req@ffff9ee0056eb840 x1874670272764800/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826821 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826796.691977:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb840 x1874670272764800/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826821 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826796.691985:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826796.691988:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826796.691990:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272764800:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787826796.691994:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272764928:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787826796.692024:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826796.692034:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826796/real 1787826796]  req@ffff9ee0056e9680 x1874670272764928/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826821 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826796.692046:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9680 x1874670272764928/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826821 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826796.692060:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826796.692063:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826796.692066:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272764928:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787826796.692071:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272765056:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787826796.692089:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826796.692099:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826796/real 1787826796]  req@ffff9ee0056e92c0 x1874670272765056/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826821 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826796.692110:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e92c0 x1874670272765056/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826821 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826796.692117:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826796.692120:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826796.692123:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272765056:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787826796.692138:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272765184:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787826796.692156:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826796.692166:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826796/real 1787826796]  req@ffff9ee0056e83c0 x1874670272765184/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826821 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826796.692178:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e83c0 x1874670272765184/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826821 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826796.692185:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826796.692187:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826796.692190:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272765184:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787826796.692195:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272765312:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787826796.692222:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826796.692233:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826796/real 1787826796]  req@ffff9ee0056e8000 x1874670272765312/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826821 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826796.692244:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8000 x1874670272765312/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826821 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826796.692252:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826796.692261:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826796.692264:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272765312:192.168.203.121@tcp:8:kworker.0
00010000:00010000:0.0:1787826799.571615:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1787826801.619543:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1787826801.811431:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787826801.811440:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1787826801.811444:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787826801.811453:0:8:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 1965
00000100:00080000:0.0:1787826801.811462:0:8:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787826801.811467:0:8:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787826801.811507:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8b40 x1874670272765440/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787826801.811537:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787826801.811542:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787826801.811543:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787826801.811547:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 1965
00000100:00080000:0.0:1787826801.811550:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787826801.811554:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787826801.811563:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787826801.811589:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8780 x1874670272765568/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787826801.811600:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1787826801.811602:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272765440:192.168.203.121@tcp:250:kworker.0
00000100:00080000:0.0:1787826801.811605:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787826801.811609:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787826801.811613:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 1965
00000100:00080000:0.0:1787826801.811616:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787826801.811620:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787826801.811624:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787826801.811627:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00100000:0.0:1787826801.811635:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb480 x1874670272765696/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787826801.811643:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787826801.811646:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787826801.811647:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787826801.811650:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 1965
00000100:00080000:0.0:1787826801.811655:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787826801.811659:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787826801.811663:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787826801.811672:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9e00 x1874670272765824/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1787826801.811679:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:0.0:1787826801.811684:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787826801.811687:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787826801.811689:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787826801.811693:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 1965
00000100:00080000:0.0:1787826801.811701:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787826801.811704:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787826801.811708:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787826801.811717:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ea940 x1874670272765952/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787826801.811724:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1787826801.811724:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826801/real 1787826801]  req@ffff9ee0056e8b40 x1874670272765440/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787826826 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826801.811729:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787826801.811731:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787826801.811736:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 1965
00000100:00080000:0.0:1787826801.811741:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787826801.811744:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787826801.811747:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787826801.811759:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb0c0 x1874670272766080/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787826801.811759:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8b40 x1874670272765440/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787826826 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826801.811778:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787826801.811782:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787826801.811785:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787826801.811790:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 1965
00000100:00080000:0.0:1787826801.811794:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787826801.811799:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787826801.811802:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:2.0:1787826801.811802:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826801.811811:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826801.811812:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ea580 x1874670272766208/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787826801.811820:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272765440:192.168.203.121@tcp:250:kworker.0
00000100:00100000:2.0:1787826801.811845:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272765568:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787826801.811868:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826801.811880:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826801/real 1787826801]  req@ffff9ee0056e8780 x1874670272765568/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826826 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826801.811891:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8780 x1874670272765568/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826826 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826801.811899:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826801.811902:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826801.811906:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272765568:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787826801.811911:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272765696:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787826801.811929:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826801.811937:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826801/real 1787826801]  req@ffff9ee0056eb480 x1874670272765696/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826826 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826801.811944:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb480 x1874670272765696/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826826 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826801.811949:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826801.811951:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826801.811953:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272765696:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787826801.811957:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272765824:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787826801.811967:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826801.811975:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826801/real 1787826801]  req@ffff9ee0056e9e00 x1874670272765824/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826826 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826801.811985:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9e00 x1874670272765824/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826826 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826801.811991:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826801.811994:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826801.811997:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272765824:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787826801.812003:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272765952:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787826801.812021:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826801.812032:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826801/real 1787826801]  req@ffff9ee0056ea940 x1874670272765952/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826826 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826801.812042:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ea940 x1874670272765952/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826826 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826801.812049:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826801.812052:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826801.812055:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272765952:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787826801.812061:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272766080:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787826801.812081:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826801.812091:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826801/real 1787826801]  req@ffff9ee0056eb0c0 x1874670272766080/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826826 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826801.812098:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb0c0 x1874670272766080/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826826 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826801.812103:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826801.812105:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826801.812107:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272766080:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787826801.812118:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272766208:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787826801.812136:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826801.812146:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826801/real 1787826801]  req@ffff9ee0056ea580 x1874670272766208/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826826 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826801.812157:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ea580 x1874670272766208/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826826 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826801.812163:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826801.812166:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826801.812169:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272766208:192.168.203.121@tcp:8:kworker.0
00010000:00010000:3.0:1787826802.643499:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787826802.835457:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787826803.667579:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787826803.859444:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787826804.691527:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787826804.883427:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787826805.715594:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787826805.907457:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787826806.739424:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1787826806.931467:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1787826806.931472:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:0.0:1787826806.931479:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1787826806.931488:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787826806.931499:0:8:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 1970
00000100:00080000:0.0:1787826806.931511:0:8:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787826806.931519:0:8:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787826806.931567:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9a40 x1874670272766336/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787826806.931597:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787826806.931601:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787826806.931603:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787826806.931607:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 1970
00000100:00080000:0.0:1787826806.931611:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787826806.931616:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787826806.931625:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787826806.931637:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ead00 x1874670272766464/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787826806.931648:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787826806.931652:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787826806.931655:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1787826806.931656:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272766336:192.168.203.121@tcp:250:kworker.0
00000100:00080000:0.0:1787826806.931662:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 1970
00000100:00080000:0.0:1787826806.931667:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787826806.931672:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787826806.931676:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787826806.931689:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ea580 x1874670272766592/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787826806.931697:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787826806.931700:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787826806.931702:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787826806.931722:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 1970
00000100:00080000:0.0:1787826806.931726:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787826806.931733:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000800:00000100:2.0:1787826806.931735:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000008:00100000:0.0:1787826806.931739:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787826806.931751:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb0c0 x1874670272766720/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787826806.931766:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787826806.931769:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787826806.931771:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787826806.931775:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 1970
00000100:00080000:0.0:1787826806.931779:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787826806.931783:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787826806.931788:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787826806.931791:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826806/real 1787826806]  req@ffff9ee0056e9a40 x1874670272766336/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787826831 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826806.931801:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ea940 x1874670272766848/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787826806.931811:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1787826806.931813:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9a40 x1874670272766336/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787826831 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826806.931814:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787826806.931817:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787826806.931824:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 1970
00000100:00080000:2.0:1787826806.931837:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826806.931840:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787826806.931845:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:0.0:1787826806.931848:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787826806.931853:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272766336:192.168.203.121@tcp:250:kworker.0
00000008:00100000:0.0:1787826806.931856:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787826806.931870:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9e00 x1874670272766976/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787826806.931880:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1787826806.931881:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272766464:192.168.203.121@tcp:38:kworker.0
00000100:00080000:0.0:1787826806.931886:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787826806.931889:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787826806.931894:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 1970
00000100:00080000:0.0:1787826806.931898:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787826806.931902:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787826806.931907:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:2.0:1787826806.931912:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787826806.931921:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb480 x1874670272767104/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787826806.931928:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826806/real 1787826806]  req@ffff9ee0056ead00 x1874670272766464/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826831 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826806.931954:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ead00 x1874670272766464/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826831 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826806.931963:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826806.931967:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826806.931971:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272766464:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787826806.931982:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272766592:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787826806.932005:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826806.932017:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826806/real 1787826806]  req@ffff9ee0056ea580 x1874670272766592/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826831 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826806.932029:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ea580 x1874670272766592/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826831 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826806.932046:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826806.932050:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826806.932053:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272766592:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787826806.932059:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272766720:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787826806.932077:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826806.932084:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826806/real 1787826806]  req@ffff9ee0056eb0c0 x1874670272766720/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826831 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826806.932094:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb0c0 x1874670272766720/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826831 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826806.932102:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826806.932104:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826806.932107:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272766720:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787826806.932113:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272766848:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787826806.932131:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826806.932150:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826806/real 1787826806]  req@ffff9ee0056ea940 x1874670272766848/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826831 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826806.932160:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ea940 x1874670272766848/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826831 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826806.932164:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826806.932166:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826806.932168:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272766848:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787826806.932180:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272766976:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787826806.932193:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826806.932200:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826806/real 1787826806]  req@ffff9ee0056e9e00 x1874670272766976/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826831 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826806.932206:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9e00 x1874670272766976/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826831 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826806.932211:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826806.932213:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826806.932214:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272766976:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787826806.932224:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272767104:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787826806.932233:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826806.932239:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826806/real 1787826806]  req@ffff9ee0056eb480 x1874670272767104/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826831 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826806.932245:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb480 x1874670272767104/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826831 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826806.932249:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826806.932251:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826806.932253:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272767104:192.168.203.121@tcp:8:kworker.0
00010000:00010000:3.0:1787826807.763562:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787826807.955476:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787826808.787591:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787826808.980572:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787826809.811591:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1787826810.835563:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1787826811.859481:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1787826812.051475:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787826812.051482:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787826812.051486:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787826812.051496:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 1975
00000100:00080000:3.0:1787826812.051516:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787826812.051524:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787826812.051561:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706d00 x1874670272767232/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787826812.051583:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787826812.051587:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787826812.051589:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787826812.051593:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 1975
00000100:00080000:3.0:1787826812.051596:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787826812.051601:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787826812.051610:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787826812.051622:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057070c0 x1874670272767360/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787826812.051630:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272767232:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787826812.051632:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787826812.051636:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787826812.051638:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787826812.051641:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 1975
00000100:00080000:3.0:1787826812.051644:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787826812.051647:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787826812.051650:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787826812.051660:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057043c0 x1874670272767488/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787826812.051666:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787826812.051668:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787826812.051669:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787826812.051671:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 1975
00000100:00080000:3.0:1787826812.051692:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787826812.051695:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787826812.051698:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787826812.051704:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057052c0 x1874670272767616/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1787826812.051709:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787826812.051715:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787826812.051718:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787826812.051719:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787826812.051723:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 1975
00000100:00080000:3.0:1787826812.051726:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787826812.051729:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787826812.051732:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787826812.051739:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707c00 x1874670272767744/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787826812.051744:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787826812.051748:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787826812.051749:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787826812.051753:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 1975
00000100:00080000:3.0:1787826812.051756:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787826812.051761:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787826812.051765:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826812/real 1787826812]  req@ffff9ee005706d00 x1874670272767232/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787826837 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:3.0:1787826812.051768:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787826812.051785:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706940 x1874670272767872/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787826812.051790:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706d00 x1874670272767232/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787826837 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787826812.051803:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787826812.051812:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787826812.051815:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787826812.051822:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 1975
00000100:00080000:3.0:1787826812.051825:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787826812.051828:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00080000:2.0:1787826812.051831:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000008:00100000:3.0:1787826812.051834:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:2.0:1787826812.051841:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787826812.051847:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705680 x1874670272768000/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787826812.051849:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272767232:192.168.203.121@tcp:250:kworker.0
00000100:00100000:2.0:1787826812.051872:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272767360:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787826812.051897:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826812.051910:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826812/real 1787826812]  req@ffff9ee0057070c0 x1874670272767360/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826837 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826812.051920:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057070c0 x1874670272767360/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826837 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826812.051928:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826812.051931:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826812.051934:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272767360:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787826812.051940:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272767488:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787826812.051959:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826812.051970:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826812/real 1787826812]  req@ffff9ee0057043c0 x1874670272767488/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826837 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826812.051980:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057043c0 x1874670272767488/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826837 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826812.051987:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826812.051990:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826812.051993:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272767488:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787826812.051999:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272767616:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787826812.052021:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826812.052030:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826812/real 1787826812]  req@ffff9ee0057052c0 x1874670272767616/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826837 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826812.052041:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057052c0 x1874670272767616/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826837 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826812.052048:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826812.052051:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826812.052054:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272767616:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787826812.052059:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272767744:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787826812.052074:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826812.052082:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826812/real 1787826812]  req@ffff9ee005707c00 x1874670272767744/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826837 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826812.052092:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707c00 x1874670272767744/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826837 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826812.052099:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826812.052101:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826812.052104:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272767744:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787826812.052109:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272767872:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787826812.052124:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826812.052134:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826812/real 1787826812]  req@ffff9ee005706940 x1874670272767872/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826837 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826812.052146:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706940 x1874670272767872/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826837 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826812.052153:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826812.052155:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826812.052158:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272767872:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787826812.052174:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272768000:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787826812.052192:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826812.052201:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826812/real 1787826812]  req@ffff9ee005705680 x1874670272768000/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826837 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826812.052211:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705680 x1874670272768000/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826837 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826812.052218:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826812.052221:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826812.052224:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272768000:192.168.203.121@tcp:8:kworker.0
00010000:00010000:3.0:1787826812.883514:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787826813.076813:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787826813.907518:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787826814.099403:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787826814.931508:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787826815.123466:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787826815.955526:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787826816.147433:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787826816.979517:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787826817.171695:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00100000:2.0:1787826817.171738:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272768128:192.168.203.121@tcp:250:kworker.0
00000800:00000100:2.0:1787826817.171799:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826817.171840:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826817/real 1787826817]  req@ffff9ee0056a30c0 x1874670272768128/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787826842 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826817.171861:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a30c0 x1874670272768128/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787826842 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826817.171890:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826817.171899:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826817.171909:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272768128:192.168.203.121@tcp:250:kworker.0
00000100:00100000:2.0:1787826817.171937:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272768256:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787826817.171968:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826817.171994:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826817/real 1787826817]  req@ffff9ee0056a0b40 x1874670272768256/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826842 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826817.172030:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0b40 x1874670272768256/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826842 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826817.172037:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826817.172039:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826817.172042:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272768256:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787826817.172046:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272768384:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787826817.172064:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826817.172072:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826817/real 1787826817]  req@ffff9ee0056a3480 x1874670272768384/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826842 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826817.172079:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a3480 x1874670272768384/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826842 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826817.172084:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826817.172087:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826817.172089:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272768384:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787826817.172095:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272768512:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787826817.172118:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826817.172133:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826817/real 1787826817]  req@ffff9ee0056a2580 x1874670272768512/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826842 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826817.172147:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a2580 x1874670272768512/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826842 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826817.172155:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826817.172159:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826817.172163:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272768512:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787826817.172170:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272768640:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787826817.172192:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826817.172207:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826817/real 1787826817]  req@ffff9ee0056a03c0 x1874670272768640/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826842 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826817.172219:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a03c0 x1874670272768640/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826842 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826817.172227:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826817.172229:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826817.172232:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272768640:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787826817.172250:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272768768:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787826817.172269:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826817.172279:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826817/real 1787826817]  req@ffff9ee0056a1e00 x1874670272768768/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826842 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826817.172291:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1e00 x1874670272768768/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826842 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826817.172299:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826817.172301:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826817.172304:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272768768:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787826817.172309:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272768896:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787826817.172347:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826817.172356:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826817/real 1787826817]  req@ffff9ee0056a0000 x1874670272768896/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826842 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826817.172363:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0000 x1874670272768896/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826842 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826817.172369:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826817.172371:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826817.172373:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272768896:192.168.203.121@tcp:8:kworker.0
00010000:00010000:3.0:1787826818.003647:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787826818.195453:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787826819.027608:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787826819.219469:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787826820.051440:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787826820.243472:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787826821.075515:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787826821.267533:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787826822.099504:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1787826822.291639:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787826822.291649:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787826822.291653:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787826822.291663:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 1986
00000100:00080000:3.0:1787826822.291675:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787826822.291683:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787826822.291719:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706580 x1874670272769024/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787826822.291746:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787826822.291750:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787826822.291752:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787826822.291756:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 1986
00000100:00080000:3.0:1787826822.291760:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787826822.291764:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787826822.291773:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787826822.291787:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704000 x1874670272769152/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787826822.291797:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272769024:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787826822.291799:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787826822.291807:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787826822.291809:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787826822.291812:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 1986
00000100:00080000:3.0:1787826822.291816:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000800:00000100:2.0:1787826822.291860:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787826822.291875:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787826822.291882:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787826822.291897:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704b40 x1874670272769280/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787826822.291903:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826822/real 1787826822]  req@ffff9ee005706580 x1874670272769024/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787826847 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787826822.291911:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787826822.291919:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787826822.291922:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787826822.291927:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 1986
00000100:00080000:3.0:1787826822.291931:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1787826822.291934:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706580 x1874670272769024/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787826847 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787826822.291938:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787826822.291946:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787826822.291958:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707480 x1874670272769408/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787826822.291960:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826822.291969:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:3.0:1787826822.291974:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1787826822.291976:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272769024:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787826822.291980:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787826822.291984:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787826822.291988:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 1986
00000100:00080000:3.0:1787826822.291992:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787826822.291996:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787826822.292001:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787826822.292004:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272769152:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787826822.292014:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057061c0 x1874670272769536/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787826822.292024:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787826822.292027:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000800:00000100:2.0:1787826822.292031:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787826822.292032:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1787826822.292043:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826822/real 1787826822]  req@ffff9ee005704000 x1874670272769152/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826847 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787826822.292048:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 1986
00000100:00080000:3.0:1787826822.292054:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1787826822.292060:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704000 x1874670272769152/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826847 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787826822.292062:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787826822.292070:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:2.0:1787826822.292071:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826822.292078:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826822.292085:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272769152:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787826822.292085:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705a40 x1874670272769664/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787826822.292094:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272769280:192.168.203.121@tcp:8:kworker.0
00000100:00080000:3.0:1787826822.292102:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787826822.292106:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787826822.292108:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787826822.292113:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 1986
00000100:00080000:3.0:1787826822.292118:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000800:00000100:2.0:1787826822.292124:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787826822.292124:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787826822.292133:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787826822.292143:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826822/real 1787826822]  req@ffff9ee005704b40 x1874670272769280/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826847 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787826822.292146:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704780 x1874670272769792/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787826822.292173:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704b40 x1874670272769280/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826847 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826822.292182:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826822.292186:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826822.292189:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272769280:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787826822.292196:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272769408:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787826822.292215:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826822.292225:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826822/real 1787826822]  req@ffff9ee005707480 x1874670272769408/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826847 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826822.292237:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707480 x1874670272769408/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826847 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826822.292244:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826822.292247:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826822.292250:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272769408:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787826822.292262:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272769536:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787826822.292275:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826822.292285:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826822/real 1787826822]  req@ffff9ee0057061c0 x1874670272769536/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826847 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826822.292295:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057061c0 x1874670272769536/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826847 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826822.292302:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826822.292305:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826822.292308:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272769536:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787826822.292351:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272769664:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787826822.292369:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826822.292379:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826822/real 1787826822]  req@ffff9ee005705a40 x1874670272769664/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826847 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826822.292388:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705a40 x1874670272769664/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826847 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826822.292393:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:2.0:1787826822.292394:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826822.292399:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826822.292403:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272769664:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787826822.292408:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272769792:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787826822.292418:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826822.292425:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826822/real 1787826822]  req@ffff9ee005704780 x1874670272769792/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826847 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826822.292446:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704780 x1874670272769792/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826847 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826822.292451:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826822.292453:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826822.292455:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272769792:192.168.203.121@tcp:8:kworker.0
00010000:00010000:3.0:1787826823.123552:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787826823.317176:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787826824.147535:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787826824.339475:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787826825.171553:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787826825.364110:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787826826.195449:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787826826.388578:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787826827.219514:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787826827.411451:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:0.0:1787826827.411457:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787826827.411464:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1787826827.411469:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787826827.411479:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 1991
00000100:00080000:0.0:1787826827.411490:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787826827.411496:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787826827.411528:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8780 x1874670272769920/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787826827.411552:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787826827.411555:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787826827.411557:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787826827.411561:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 1991
00000100:00080000:0.0:1787826827.411565:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787826827.411568:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787826827.411577:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787826827.411589:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8b40 x1874670272770048/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787826827.411598:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272769920:192.168.203.121@tcp:250:kworker.0
00000100:00080000:0.0:1787826827.411604:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787826827.411608:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787826827.411610:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787826827.411614:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 1991
00000100:00080000:0.0:1787826827.411618:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787826827.411622:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787826827.411627:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787826827.411639:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8000 x1874670272770176/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787826827.411648:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787826827.411651:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787826827.411655:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:2.0:1787826827.411655:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:0.0:1787826827.411662:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 1991
00000100:00080000:0.0:1787826827.411666:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787826827.411671:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787826827.411676:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787826827.411688:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826827/real 1787826827]  req@ffff9ee0056e8780 x1874670272769920/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787826852 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826827.411691:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e83c0 x1874670272770304/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787826827.411708:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1787826827.411710:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8780 x1874670272769920/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787826852 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826827.411712:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787826827.411717:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787826827.411726:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 1991
00000100:00080000:2.0:1787826827.411730:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826827.411731:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787826827.411736:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:0.0:1787826827.411740:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787826827.411741:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272769920:192.168.203.121@tcp:250:kworker.0
00000008:00100000:0.0:1787826827.411747:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787826827.411758:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e92c0 x1874670272770432/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787826827.411761:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272770048:192.168.203.121@tcp:38:kworker.0
00000100:00080000:0.0:1787826827.411773:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787826827.411776:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787826827.411778:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:2.0:1787826827.411784:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:0.0:1787826827.411790:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 1991
00000100:00100000:2.0:1787826827.411795:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826827/real 1787826827]  req@ffff9ee0056e8b40 x1874670272770048/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826852 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826827.411797:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787826827.411805:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787826827.411812:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787826827.411818:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8b40 x1874670272770048/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826852 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826827.411827:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9680 x1874670272770560/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787826827.411830:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826827.411838:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826827.411843:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272770048:192.168.203.121@tcp:38:kworker.0
00000100:00080000:0.0:1787826827.411848:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1787826827.411849:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272770176:192.168.203.121@tcp:8:kworker.0
00000100:00080000:0.0:1787826827.411855:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787826827.411857:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787826827.411862:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 1991
00000100:00080000:0.0:1787826827.411866:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000800:00000100:2.0:1787826827.411871:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:0.0:1787826827.411872:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787826827.411880:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787826827.411883:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826827/real 1787826827]  req@ffff9ee0056e8000 x1874670272770176/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826852 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826827.411898:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb840 x1874670272770688/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787826827.411898:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8000 x1874670272770176/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826852 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826827.411919:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826827.411921:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826827.411922:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272770176:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787826827.411933:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272770304:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787826827.411944:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826827.411952:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826827/real 1787826827]  req@ffff9ee0056e83c0 x1874670272770304/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826852 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826827.411958:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e83c0 x1874670272770304/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826852 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826827.411963:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826827.411964:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826827.411966:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272770304:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787826827.411974:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272770432:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787826827.411983:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826827.411989:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826827/real 1787826827]  req@ffff9ee0056e92c0 x1874670272770432/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826852 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826827.411995:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e92c0 x1874670272770432/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826852 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826827.411999:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826827.412001:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826827.412004:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272770432:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787826827.412009:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272770560:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787826827.412025:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826827.412035:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826827/real 1787826827]  req@ffff9ee0056e9680 x1874670272770560/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826852 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826827.412047:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9680 x1874670272770560/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826852 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826827.412054:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826827.412055:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826827.412057:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272770560:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787826827.412061:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272770688:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787826827.412081:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826827.412088:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826827/real 1787826827]  req@ffff9ee0056eb840 x1874670272770688/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826852 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826827.412095:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb840 x1874670272770688/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826852 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826827.412099:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826827.412101:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826827.412103:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272770688:192.168.203.121@tcp:8:kworker.0
00010000:00010000:3.0:1787826828.243492:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787826828.435444:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787826829.267510:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787826829.459454:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787826830.291662:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787826830.483433:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787826831.315515:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787826831.507522:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787826832.339545:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787826832.531473:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00100000:2.0:1787826832.531834:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272770816:192.168.203.121@tcp:250:kworker.0
00000800:00000100:2.0:1787826832.531889:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826832.531924:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826832/real 1787826832]  req@ffff9ee0056a0780 x1874670272770816/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787826857 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826832.531935:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0780 x1874670272770816/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787826857 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826832.531946:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826832.531949:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826832.531953:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272770816:192.168.203.121@tcp:250:kworker.0
00000100:00100000:2.0:1787826832.531958:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272770944:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787826832.531971:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826832.531978:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826832/real 1787826832]  req@ffff9ee0056a12c0 x1874670272770944/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826857 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826832.531984:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a12c0 x1874670272770944/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826857 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826832.531989:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826832.531990:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826832.531992:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272770944:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787826832.531995:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272771072:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787826832.532005:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826832.532010:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826832/real 1787826832]  req@ffff9ee0056a1a40 x1874670272771072/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826857 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826832.532020:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1a40 x1874670272771072/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826857 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826832.532026:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826832.532029:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826832.532032:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272771072:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787826832.532037:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272771200:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787826832.532055:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826832.532066:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826832/real 1787826832]  req@ffff9ee0056a3c00 x1874670272771200/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826857 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826832.532076:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a3c00 x1874670272771200/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826857 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826832.532081:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826832.532083:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826832.532085:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272771200:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787826832.532088:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272771328:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787826832.532112:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826832.532121:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826832/real 1787826832]  req@ffff9ee0056a2940 x1874670272771328/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826857 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826832.532132:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a2940 x1874670272771328/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826857 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826832.532139:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826832.532150:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826832.532153:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272771328:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787826832.532157:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272771456:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787826832.532170:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826832.532177:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826832/real 1787826832]  req@ffff9ee0056a1680 x1874670272771456/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826857 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826832.532187:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1680 x1874670272771456/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826857 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826832.532194:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826832.532197:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826832.532199:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272771456:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787826832.532204:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272771584:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787826832.532221:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826832.532231:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826832/real 1787826832]  req@ffff9ee0056a0f00 x1874670272771584/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826857 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826832.532242:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0f00 x1874670272771584/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826857 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826832.532249:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826832.532252:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826832.532255:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272771584:192.168.203.121@tcp:8:kworker.0
00010000:00010000:3.0:1787826833.363996:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787826833.555497:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787826834.387498:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787826834.579420:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787826835.411525:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787826835.603470:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787826836.435511:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787826836.627432:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787826837.459505:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787826837.651440:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00100000:2.0:1787826837.651568:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272771712:192.168.203.121@tcp:250:kworker.0
00000800:00000100:2.0:1787826837.651636:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826837.651677:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826837/real 1787826837]  req@ffff9ee0056a21c0 x1874670272771712/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787826862 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826837.651702:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a21c0 x1874670272771712/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787826862 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826837.651742:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826837.651750:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826837.651758:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272771712:192.168.203.121@tcp:250:kworker.0
00000100:00100000:2.0:1787826837.651787:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272771840:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787826837.651826:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826837.651840:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826837/real 1787826837]  req@ffff9ee0056a0f00 x1874670272771840/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826862 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826837.651851:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0f00 x1874670272771840/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826862 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826837.651859:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826837.651862:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826837.651864:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272771840:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787826837.651870:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272771968:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787826837.651887:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826837.651896:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826837/real 1787826837]  req@ffff9ee0056a1680 x1874670272771968/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826862 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826837.651906:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1680 x1874670272771968/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826862 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826837.651913:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826837.651915:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826837.651918:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272771968:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787826837.651924:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272772096:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787826837.651939:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826837.651948:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826837/real 1787826837]  req@ffff9ee0056a2940 x1874670272772096/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826862 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826837.651958:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a2940 x1874670272772096/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826862 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826837.651965:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826837.651968:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826837.651971:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272772096:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787826837.651976:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272772224:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787826837.651992:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826837.652001:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826837/real 1787826837]  req@ffff9ee0056a3c00 x1874670272772224/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826862 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826837.652011:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a3c00 x1874670272772224/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826862 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826837.652018:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826837.652021:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826837.652024:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272772224:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787826837.652030:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272772352:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787826837.652046:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826837.652055:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826837/real 1787826837]  req@ffff9ee0056a1a40 x1874670272772352/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826862 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826837.652065:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1a40 x1874670272772352/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826862 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826837.652071:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826837.652073:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826837.652076:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272772352:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787826837.652092:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272772480:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787826837.652109:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826837.652119:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826837/real 1787826837]  req@ffff9ee0056a12c0 x1874670272772480/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826862 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826837.652128:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a12c0 x1874670272772480/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826862 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826837.652134:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826837.652137:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826837.652139:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272772480:192.168.203.121@tcp:8:kworker.0
00010000:00010000:3.0:1787826838.483505:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787826838.675463:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787826839.507494:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787826839.699451:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787826840.531514:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787826840.723442:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787826841.555544:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787826841.747460:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787826842.579573:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1787826842.772404:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787826842.772417:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787826842.772422:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787826842.772434:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2006
00000100:00080000:3.0:1787826842.772448:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787826842.772456:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787826842.772504:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705e00 x1874670272772608/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787826842.772534:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787826842.772538:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787826842.772540:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787826842.772544:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2006
00000100:00080000:3.0:1787826842.772548:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787826842.772553:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787826842.772564:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787826842.772578:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707840 x1874670272772736/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787826842.772585:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787826842.772588:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787826842.772589:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787826842.772592:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2006
00000100:00080000:3.0:1787826842.772595:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787826842.772598:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787826842.772601:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787826842.772612:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704780 x1874670272772864/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787826842.772614:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272772608:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787826842.772642:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787826842.772645:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787826842.772646:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787826842.772649:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2006
00000100:00080000:3.0:1787826842.772651:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787826842.772653:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787826842.772655:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787826842.772663:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705a40 x1874670272772992/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787826842.772670:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787826842.772673:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787826842.772674:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787826842.772676:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2006
00000100:00080000:3.0:1787826842.772679:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787826842.772682:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787826842.772687:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787826842.772693:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057061c0 x1874670272773120/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787826842.772699:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787826842.772702:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787826842.772704:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787826842.772706:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2006
00000100:00080000:3.0:1787826842.772709:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787826842.772711:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787826842.772714:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787826842.772720:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707480 x1874670272773248/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787826842.772724:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787826842.772726:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787826842.772728:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787826842.772730:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2006
00000100:00080000:3.0:1787826842.772732:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787826842.772734:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787826842.772736:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:2.0:1787826842.772739:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787826842.772746:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704b40 x1874670272773376/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787826842.772802:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826842/real 1787826842]  req@ffff9ee005705e00 x1874670272772608/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787826867 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826842.772822:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705e00 x1874670272772608/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787826867 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826842.772840:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826842.772849:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826842.772853:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272772608:192.168.203.121@tcp:250:kworker.0
00000100:00100000:2.0:1787826842.772861:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272772736:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787826842.772888:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826842.772901:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826842/real 1787826842]  req@ffff9ee005707840 x1874670272772736/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826867 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826842.772913:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707840 x1874670272772736/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826867 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826842.772921:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826842.772925:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826842.772928:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272772736:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787826842.772949:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272772864:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787826842.772965:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826842.772972:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826842/real 1787826842]  req@ffff9ee005704780 x1874670272772864/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826867 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826842.772979:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704780 x1874670272772864/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826867 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826842.772987:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826842.772990:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826842.772993:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272772864:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787826842.772999:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272772992:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787826842.773017:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826842.773041:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826842/real 1787826842]  req@ffff9ee005705a40 x1874670272772992/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826867 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826842.773049:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705a40 x1874670272772992/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826867 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826842.773054:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826842.773056:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826842.773059:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272772992:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787826842.773063:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272773120:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787826842.773077:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826842.773085:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826842/real 1787826842]  req@ffff9ee0057061c0 x1874670272773120/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826867 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826842.773096:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057061c0 x1874670272773120/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826867 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826842.773104:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826842.773107:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826842.773110:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272773120:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787826842.773117:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272773248:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787826842.773136:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826842.773146:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826842/real 1787826842]  req@ffff9ee005707480 x1874670272773248/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826867 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826842.773157:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707480 x1874670272773248/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826867 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826842.773164:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826842.773167:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826842.773170:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272773248:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787826842.773175:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272773376:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787826842.773193:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826842.773203:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826842/real 1787826842]  req@ffff9ee005704b40 x1874670272773376/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826867 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826842.773214:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704b40 x1874670272773376/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826867 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826842.773221:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826842.773224:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826842.773227:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272773376:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787826842.773356:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787826843.603529:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787826843.795455:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787826844.627560:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787826844.819441:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787826845.651488:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787826845.843434:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787826846.675912:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787826846.867530:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787826847.699563:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787826847.891495:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00100000:2.0:1787826847.892415:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272773504:192.168.203.121@tcp:250:kworker.0
00000800:00000100:2.0:1787826847.892485:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826847.892530:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826847/real 1787826847]  req@ffff9ee0056a0780 x1874670272773504/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787826872 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826847.892554:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0780 x1874670272773504/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787826872 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826847.892569:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826847.892574:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826847.892577:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272773504:192.168.203.121@tcp:250:kworker.0
00000100:00100000:2.0:1787826847.892585:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272773632:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787826847.892607:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826847.892618:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826847/real 1787826847]  req@ffff9ee0056a0000 x1874670272773632/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826872 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826847.892629:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0000 x1874670272773632/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826872 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826847.892637:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826847.892640:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826847.892643:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272773632:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787826847.892648:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272773760:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787826847.892664:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826847.892673:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826847/real 1787826847]  req@ffff9ee0056a1e00 x1874670272773760/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826872 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826847.892683:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1e00 x1874670272773760/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826872 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826847.892690:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826847.892694:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826847.892696:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272773760:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787826847.892702:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272773888:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787826847.892717:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826847.892726:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826847/real 1787826847]  req@ffff9ee0056a03c0 x1874670272773888/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826872 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826847.892736:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a03c0 x1874670272773888/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826872 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826847.892743:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826847.892746:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826847.892748:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272773888:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787826847.892754:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272774016:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787826847.892769:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826847.892779:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826847/real 1787826847]  req@ffff9ee0056a2580 x1874670272774016/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826872 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826847.892788:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a2580 x1874670272774016/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826872 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826847.892795:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826847.892798:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826847.892801:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272774016:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787826847.892807:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272774144:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787826847.892823:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826847.892830:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826847/real 1787826847]  req@ffff9ee0056a3480 x1874670272774144/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826872 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826847.892840:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a3480 x1874670272774144/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826872 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826847.892847:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826847.892850:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826847.892853:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272774144:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787826847.892859:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272774272:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787826847.892884:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826847.892894:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826847/real 1787826847]  req@ffff9ee0056a0b40 x1874670272774272/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826872 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826847.892903:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0b40 x1874670272774272/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826872 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826847.892910:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826847.892912:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826847.892915:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272774272:192.168.203.121@tcp:8:kworker.0
00010000:00010000:3.0:1787826848.723500:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787826848.915456:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787826849.747521:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787826849.939469:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787826850.771514:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1787826851.795538:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1787826852.819506:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1787826853.011651:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787826853.011659:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787826853.011663:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787826853.011674:0:8:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2016
00000100:00080000:2.0:1787826853.011687:0:8:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787826853.011696:0:8:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787826853.011751:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a1c0 x1874670272774400/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787826853.011786:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787826853.011791:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787826853.011793:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787826853.011797:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2016
00000100:00080000:2.0:1787826853.011800:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787826853.011805:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787826853.011819:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787826853.011834:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272774400:192.168.203.121@tcp:250:kworker.0
00000100:00100000:2.0:1787826853.011849:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728780 x1874670272774528/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787826853.011865:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787826853.011869:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787826853.011871:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787826853.011877:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2016
00000100:00080000:2.0:1787826853.011884:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787826853.011890:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787826853.011896:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787826853.011911:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572bc00 x1874670272774656/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787826853.011921:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787826853.011925:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787826853.011927:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787826853.011931:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2016
00000100:00080000:2.0:1787826853.011936:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787826853.011940:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787826853.011944:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787826853.011960:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728f00 x1874670272774784/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787826853.011970:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787826853.011974:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787826853.011976:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787826853.011980:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2016
00000100:00080000:2.0:1787826853.011985:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787826853.011990:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787826853.011995:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787826853.012005:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272774528:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787826853.012010:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729680 x1874670272774912/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787826853.012026:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787826853.012030:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787826853.012032:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787826853.012037:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2016
00000100:00080000:2.0:1787826853.012042:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787826853.012048:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787826853.012052:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272774656:192.168.203.121@tcp:8:kworker.0
00000008:00100000:2.0:1787826853.012056:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787826853.012076:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057292c0 x1874670272775040/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787826853.012092:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272774784:192.168.203.121@tcp:8:kworker.0
00000100:00080000:2.0:1787826853.012095:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787826853.012101:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787826853.012104:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787826853.012110:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2016
00000100:00080000:2.0:1787826853.012115:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787826853.012120:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787826853.012126:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787826853.012134:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272774912:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787826853.012139:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057283c0 x1874670272775168/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787826853.012181:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057292c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272775040:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787826853.012213:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272775168:192.168.203.121@tcp:8:kworker.0
00010000:00010000:3.0:1787826853.843922:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787826854.035584:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787826854.867467:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787826855.059425:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787826855.892095:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787826856.083413:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00100000:0.0:1787826856.083745:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826853/real 1787826856]  req@ffff9ee005729680 x1874670272774912/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826878 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826856.083768:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729680 x1874670272774912/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826878 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826856.083778:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826856.083783:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826856.083787:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272774912:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787826856.083793:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826853/real 1787826856]  req@ffff9ee0057292c0 x1874670272775040/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826878 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826856.083802:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057292c0 x1874670272775040/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826878 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826856.083809:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826856.083812:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826856.083815:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057292c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272775040:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787826856.083823:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826853/real 1787826856]  req@ffff9ee005728780 x1874670272774528/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826878 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826856.083834:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728780 x1874670272774528/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826878 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826856.083841:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826856.083844:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826856.083847:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272774528:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787826856.083852:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826853/real 1787826856]  req@ffff9ee00572bc00 x1874670272774656/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826878 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826856.083862:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572bc00 x1874670272774656/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826878 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826856.083869:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826856.083871:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826856.083874:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272774656:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787826856.083885:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826853/real 1787826856]  req@ffff9ee005728f00 x1874670272774784/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826878 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826856.083896:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728f00 x1874670272774784/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826878 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826856.083903:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826856.083907:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826856.083910:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272774784:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787826856.083916:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826853/real 1787826856]  req@ffff9ee00572a1c0 x1874670272774400/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787826878 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826856.083928:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a1c0 x1874670272774400/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787826878 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826856.083935:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826856.083938:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826856.083940:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272774400:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787826856.083971:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826853/real 1787826856]  req@ffff9ee0057283c0 x1874670272775168/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826878 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826856.083983:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057283c0 x1874670272775168/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826878 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826856.083990:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826856.083993:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826856.083996:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272775168:192.168.203.121@tcp:8:kworker.0
00010000:00010000:0.0:1787826856.915485:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787826857.107448:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787826857.939549:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1787826858.131485:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787826858.131496:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1787826858.131500:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787826858.131510:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2021
00000100:00080000:0.0:1787826858.131520:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787826858.131528:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787826858.131557:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8f00 x1874670272775296/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787826858.131601:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00100000:2.0:1787826858.131611:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272775296:192.168.203.121@tcp:250:kworker.0
00000800:00000100:2.0:1787826858.131675:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:0.0:1787826858.131701:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787826858.131705:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787826858.131707:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787826858.131710:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2021
00000100:00080000:0.0:1787826858.131713:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787826858.131716:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787826858.131724:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787826858.131733:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ebc00 x1874670272775424/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787826858.131872:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826858/real 1787826858]  req@ffff9ee0056e8f00 x1874670272775296/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787826883 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826858.131889:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8f00 x1874670272775296/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787826883 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826858.131899:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826858.131903:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826858.131908:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272775296:192.168.203.121@tcp:250:kworker.0
00000100:00100000:2.0:1787826858.131929:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272775424:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787826858.131952:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826858.131964:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826858/real 1787826858]  req@ffff9ee0056ebc00 x1874670272775424/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826883 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826858.132564:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787826858.132570:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787826858.132572:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787826858.132576:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2021
00000100:00080000:0.0:1787826858.132581:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787826858.132585:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787826858.132592:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787826858.132640:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8f00 x1874670272775552/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787826858.132651:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787826858.132653:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787826858.132655:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787826858.132658:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2021
00000100:00080000:0.0:1787826858.132662:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787826858.132665:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787826858.132669:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787826858.132678:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb840 x1874670272775680/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787826858.132685:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787826858.132688:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787826858.132689:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787826858.132692:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2021
00000100:00080000:0.0:1787826858.132695:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787826858.132698:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787826858.132702:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787826858.132711:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9680 x1874670272775808/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787826858.132718:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787826858.132721:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787826858.132723:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787826858.132726:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2021
00000100:00080000:0.0:1787826858.132729:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787826858.132732:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787826858.132737:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787826858.132745:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e92c0 x1874670272775936/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787826858.132758:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787826858.132761:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787826858.132763:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787826858.132766:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2021
00000100:00080000:0.0:1787826858.132770:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787826858.132773:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787826858.132777:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787826858.132786:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e83c0 x1874670272776064/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787826858.132889:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ebc00 x1874670272775424/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826883 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826858.132898:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826858.132901:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826858.132905:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272775424:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787826858.132923:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272775552:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787826858.134113:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826858.134139:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826858/real 1787826858]  req@ffff9ee0056e8f00 x1874670272775552/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826883 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826858.134154:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8f00 x1874670272775552/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826883 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826858.134162:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826858.134166:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826858.134169:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272775552:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787826858.134176:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272775680:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787826858.134215:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826858.134225:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826858/real 1787826858]  req@ffff9ee0056eb840 x1874670272775680/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826883 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826858.134236:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb840 x1874670272775680/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826883 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826858.134247:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826858.134249:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826858.134252:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272775680:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787826858.134258:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272775808:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787826858.134277:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826858.134286:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826858/real 1787826858]  req@ffff9ee0056e9680 x1874670272775808/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826883 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826858.134295:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9680 x1874670272775808/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826883 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826858.134301:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826858.134304:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826858.134306:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272775808:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787826858.134311:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272775936:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787826858.134342:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826858.134352:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826858/real 1787826858]  req@ffff9ee0056e92c0 x1874670272775936/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826883 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826858.134363:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e92c0 x1874670272775936/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826883 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826858.134370:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826858.134373:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826858.134376:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272775936:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787826858.134382:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272776064:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787826858.134399:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826858.134410:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826858/real 1787826858]  req@ffff9ee0056e83c0 x1874670272776064/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826883 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826858.134417:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e83c0 x1874670272776064/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826883 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826858.134425:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826858.134427:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826858.134430:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272776064:192.168.203.121@tcp:8:kworker.0
00010000:00010000:3.0:1787826858.963490:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787826859.155548:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787826859.987497:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787826860.179614:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787826861.011451:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787826861.203426:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787826862.035611:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787826862.227453:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787826863.059507:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1787826863.253283:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1787826863.253288:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787826863.253295:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787826863.253299:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787826863.253310:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2026
00000100:00080000:3.0:1787826863.253341:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787826863.253361:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787826863.253404:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704000 x1874670272776192/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787826863.253449:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787826863.253453:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787826863.253455:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787826863.253459:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2026
00000100:00080000:3.0:1787826863.253462:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787826863.253466:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787826863.253474:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787826863.253486:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706580 x1874670272776320/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787826863.253511:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787826863.253515:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787826863.253517:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787826863.253519:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2026
00000100:00080000:3.0:1787826863.253522:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787826863.253524:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787826863.253528:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787826863.253537:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705680 x1874670272776448/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787826863.253545:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787826863.253547:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787826863.253549:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787826863.253552:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2026
00000100:00080000:3.0:1787826863.253555:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787826863.253559:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787826863.253563:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787826863.253572:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706940 x1874670272776576/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787826863.253580:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787826863.253583:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787826863.253593:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787826863.253600:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2026
00000100:00080000:3.0:1787826863.253604:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787826863.253609:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787826863.253613:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787826863.253623:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707c00 x1874670272776704/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787826863.253631:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787826863.253634:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787826863.253636:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787826863.253639:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2026
00000100:00080000:3.0:1787826863.253642:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787826863.253644:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787826863.253648:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787826863.253671:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057052c0 x1874670272776832/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787826863.253678:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787826863.253681:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787826863.253683:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787826863.253686:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2026
00000100:00080000:3.0:1787826863.253689:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787826863.253693:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787826863.253697:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787826863.253705:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057043c0 x1874670272776960/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787826863.254197:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272776192:192.168.203.121@tcp:250:kworker.0
00000800:00000100:2.0:1787826863.254256:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826863.254296:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826863/real 1787826863]  req@ffff9ee005704000 x1874670272776192/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787826888 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826863.254313:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704000 x1874670272776192/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787826888 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826863.254354:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826863.254358:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826863.254362:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272776192:192.168.203.121@tcp:250:kworker.0
00000100:00100000:2.0:1787826863.254369:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272776320:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787826863.254392:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826863.254404:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826863/real 1787826863]  req@ffff9ee005706580 x1874670272776320/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826888 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826863.254417:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706580 x1874670272776320/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826888 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826863.254424:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826863.254427:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826863.254431:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272776320:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787826863.254437:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272776448:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787826863.254456:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826863.254466:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826863/real 1787826863]  req@ffff9ee005705680 x1874670272776448/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826888 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826863.254478:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705680 x1874670272776448/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826888 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826863.254486:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826863.254489:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826863.254492:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272776448:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787826863.254498:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272776576:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787826863.254515:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826863.254524:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826863/real 1787826863]  req@ffff9ee005706940 x1874670272776576/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826888 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826863.254534:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706940 x1874670272776576/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826888 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826863.254542:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826863.254545:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826863.254548:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272776576:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787826863.254555:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272776704:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787826863.254570:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826863.254577:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826863/real 1787826863]  req@ffff9ee005707c00 x1874670272776704/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826888 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826863.254584:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707c00 x1874670272776704/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826888 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826863.254589:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826863.254591:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826863.254594:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272776704:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787826863.254599:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272776832:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787826863.254615:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826863.254625:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826863/real 1787826863]  req@ffff9ee0057052c0 x1874670272776832/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826888 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826863.254636:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057052c0 x1874670272776832/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826888 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826863.254643:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826863.254645:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826863.254647:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272776832:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787826863.254651:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272776960:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787826863.254664:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826863.254670:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826863/real 1787826863]  req@ffff9ee0057043c0 x1874670272776960/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826888 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826863.254676:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057043c0 x1874670272776960/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826888 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826863.254681:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826863.254682:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826863.254684:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272776960:192.168.203.121@tcp:8:kworker.0
00010000:00010000:3.0:1787826864.083549:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787826864.275455:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787826865.107496:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787826865.299452:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787826866.131512:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787826866.323480:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787826867.156155:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787826867.347436:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787826868.179521:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787826868.371413:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:0.0:1787826868.374280:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787826868.374289:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1787826868.374293:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787826868.374302:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2032
00000100:00080000:0.0:1787826868.374313:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787826868.374341:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787826868.374377:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8000 x1874670272777088/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787826868.374413:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787826868.374417:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787826868.374419:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787826868.374422:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2032
00000100:00080000:0.0:1787826868.374426:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787826868.374430:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787826868.374439:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787826868.374446:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272777088:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787826868.374450:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8b40 x1874670272777216/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787826868.374460:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787826868.374463:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787826868.374464:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787826868.374467:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2032
00000100:00080000:0.0:1787826868.374470:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787826868.374473:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787826868.374477:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787826868.374486:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8780 x1874670272777344/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787826868.374493:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787826868.374495:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787826868.374497:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787826868.374500:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2032
00000100:00080000:0.0:1787826868.374503:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787826868.374506:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787826868.374510:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:2.0:1787826868.374517:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787826868.374518:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb480 x1874670272777472/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787826868.374526:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787826868.374528:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787826868.374530:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787826868.374533:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2032
00000100:00080000:0.0:1787826868.374536:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787826868.374540:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787826868.374543:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787826868.374551:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9e00 x1874670272777600/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787826868.374558:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787826868.374561:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787826868.374562:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787826868.374565:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2032
00000100:00080000:0.0:1787826868.374568:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787826868.374571:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787826868.374572:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826868/real 1787826868]  req@ffff9ee0056e8000 x1874670272777088/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787826893 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:0.0:1787826868.374574:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787826868.374582:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ea940 x1874670272777728/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787826868.374587:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8000 x1874670272777088/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787826893 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826868.374591:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787826868.374594:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787826868.374596:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787826868.374597:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826868.374599:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2032
00000100:00080000:2.0:1787826868.374601:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:0.0:1787826868.374602:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787826868.374605:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787826868.374605:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272777088:192.168.203.121@tcp:250:kworker.0
00000008:00100000:0.0:1787826868.374608:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787826868.374616:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb0c0 x1874670272777856/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787826868.374624:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272777216:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787826868.374645:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826868.374657:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826868/real 1787826868]  req@ffff9ee0056e8b40 x1874670272777216/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826893 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826868.374668:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8b40 x1874670272777216/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826893 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826868.374676:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826868.374678:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826868.374681:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272777216:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787826868.374687:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272777344:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787826868.374707:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826868.374718:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826868/real 1787826868]  req@ffff9ee0056e8780 x1874670272777344/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826893 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826868.374729:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8780 x1874670272777344/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826893 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826868.374736:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826868.374739:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826868.374743:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272777344:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787826868.374748:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272777472:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787826868.374786:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826868.374797:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826868/real 1787826868]  req@ffff9ee0056eb480 x1874670272777472/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826893 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826868.374809:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb480 x1874670272777472/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826893 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826868.374817:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826868.374820:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826868.374823:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272777472:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787826868.374828:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272777600:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787826868.374846:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826868.374856:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826868/real 1787826868]  req@ffff9ee0056e9e00 x1874670272777600/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826893 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826868.374880:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9e00 x1874670272777600/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826893 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826868.374887:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826868.374889:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826868.374892:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272777600:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787826868.374906:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272777728:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787826868.374933:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826868.374944:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826868/real 1787826868]  req@ffff9ee0056ea940 x1874670272777728/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826893 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826868.374955:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ea940 x1874670272777728/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826893 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826868.374962:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826868.374964:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826868.374968:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272777728:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787826868.374973:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272777856:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787826868.374991:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826868.375002:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826868/real 1787826868]  req@ffff9ee0056eb0c0 x1874670272777856/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826893 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826868.375009:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb0c0 x1874670272777856/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826893 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826868.375014:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826868.375015:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826868.375017:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272777856:192.168.203.121@tcp:8:kworker.0
00010000:00010000:3.0:1787826869.203608:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787826869.395911:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787826870.227544:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787826870.419408:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787826871.251946:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787826871.444226:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787826872.275507:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787826872.467435:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787826873.300296:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1787826873.491455:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1787826873.491458:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787826873.491467:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787826873.491471:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787826873.491480:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2037
00000100:00080000:3.0:1787826873.491491:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787826873.491499:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787826873.491533:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057070c0 x1874670272777984/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787826873.491567:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787826873.491570:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787826873.491575:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787826873.491579:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2037
00000100:00080000:3.0:1787826873.491583:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787826873.491587:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787826873.491596:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787826873.491609:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706d00 x1874670272778112/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787826873.491614:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272777984:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787826873.491633:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787826873.491636:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787826873.491637:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787826873.491641:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2037
00000100:00080000:3.0:1787826873.491645:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787826873.491649:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787826873.491653:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787826873.491666:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057043c0 x1874670272778240/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787826873.491674:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:2.0:1787826873.491677:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787826873.491679:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787826873.491682:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787826873.491686:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2037
00000100:00080000:3.0:1787826873.491691:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787826873.491695:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787826873.491700:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787826873.491710:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057052c0 x1874670272778368/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787826873.491718:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787826873.491720:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787826873.491722:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1787826873.491732:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826873/real 1787826873]  req@ffff9ee0057070c0 x1874670272777984/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787826898 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787826873.491745:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2037
00000100:00080000:3.0:1787826873.491751:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1787826873.491753:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057070c0 x1874670272777984/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787826898 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787826873.491757:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787826873.491766:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00080000:2.0:1787826873.491770:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826873.491776:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787826873.491780:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707c00 x1874670272778496/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787826873.491783:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272777984:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787826873.491797:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787826873.491800:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787826873.491802:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787826873.491807:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2037
00000100:00100000:2.0:1787826873.491811:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272778112:192.168.203.121@tcp:38:kworker.0
00000100:00080000:3.0:1787826873.491811:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787826873.491832:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787826873.491837:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:2.0:1787826873.491841:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787826873.491853:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706940 x1874670272778624/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787826873.491859:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826873/real 1787826873]  req@ffff9ee005706d00 x1874670272778112/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826898 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787826873.491865:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787826873.491880:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:2.0:1787826873.491883:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706d00 x1874670272778112/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826898 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787826873.491884:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787826873.491891:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2037
00000100:00080000:3.0:1787826873.491897:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787826873.491900:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787826873.491904:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00080000:2.0:1787826873.491909:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000008:00100000:3.0:1787826873.491912:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787826873.491915:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272778112:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787826873.491926:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705680 x1874670272778752/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787826873.491927:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272778240:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787826873.491951:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826873.491971:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826873/real 1787826873]  req@ffff9ee0057043c0 x1874670272778240/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826898 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826873.491983:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057043c0 x1874670272778240/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826898 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826873.491991:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826873.491995:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826873.491998:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272778240:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787826873.492004:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272778368:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787826873.492023:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826873.492035:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826873/real 1787826873]  req@ffff9ee0057052c0 x1874670272778368/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826898 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826873.492046:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057052c0 x1874670272778368/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826898 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826873.492054:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826873.492057:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826873.492060:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272778368:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787826873.492065:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272778496:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787826873.492097:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826873.492109:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826873/real 1787826873]  req@ffff9ee005707c00 x1874670272778496/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826898 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826873.492120:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707c00 x1874670272778496/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826898 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826873.492138:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826873.492142:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826873.492145:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272778496:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787826873.492163:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272778624:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787826873.492180:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826873.492202:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826873/real 1787826873]  req@ffff9ee005706940 x1874670272778624/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826898 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826873.492214:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706940 x1874670272778624/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826898 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826873.492221:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826873.492224:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826873.492228:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272778624:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787826873.492233:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272778752:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787826873.492248:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826873.492258:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826873/real 1787826873]  req@ffff9ee005705680 x1874670272778752/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826898 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826873.492279:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705680 x1874670272778752/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826898 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826873.492287:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826873.492289:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826873.492291:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272778752:192.168.203.121@tcp:8:kworker.0
00010000:00010000:3.0:1787826874.323510:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787826874.515460:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787826875.347502:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787826875.539412:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787826876.371491:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787826876.563405:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787826877.395478:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787826877.587501:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787826878.419520:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787826878.611454:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:2.0:1787826878.611458:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787826878.611466:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787826878.611470:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787826878.611479:0:8:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2042
00000100:00080000:2.0:1787826878.611496:0:8:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787826878.611504:0:8:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787826878.611538:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b840 x1874670272778880/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787826878.611571:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787826878.611574:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787826878.611576:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787826878.611580:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2042
00000100:00080000:2.0:1787826878.611583:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787826878.611587:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787826878.611596:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787826878.611606:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a940 x1874670272779008/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787826878.611612:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787826878.611614:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787826878.611615:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787826878.611619:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2042
00000100:00100000:0.0:1787826878.611624:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272778880:192.168.203.121@tcp:250:kworker.0
00000100:00080000:2.0:1787826878.611625:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787826878.611633:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787826878.611638:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787826878.611650:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729e00 x1874670272779136/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787826878.611660:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787826878.611664:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787826878.611666:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787826878.611669:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2042
00000100:00080000:2.0:1787826878.611673:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787826878.611676:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787826878.611679:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787826878.611687:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728000 x1874670272779264/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1787826878.611691:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:2.0:1787826878.611709:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787826878.611713:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787826878.611714:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787826878.611720:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2042
00000100:00080000:2.0:1787826878.611724:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1787826878.611729:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826878/real 1787826878]  req@ffff9ee00572b840 x1874670272778880/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787826903 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826878.611731:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787826878.611739:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787826878.611752:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b840 x1874670272778880/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787826903 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826878.611754:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b0c0 x1874670272779392/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787826878.611764:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787826878.611770:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787826878.611773:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787826878.611780:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826878.611787:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2042
00000100:00080000:0.0:1787826878.611788:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:2.0:1787826878.611794:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1787826878.611795:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272778880:192.168.203.121@tcp:250:kworker.0
00000100:00080000:2.0:1787826878.611801:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787826878.611806:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272779008:192.168.203.121@tcp:38:kworker.0
00000008:00100000:2.0:1787826878.611809:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787826878.611825:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b480 x1874670272779520/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1787826878.611833:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:2.0:1787826878.611841:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787826878.611845:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787826878.611848:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1787826878.611849:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826878/real 1787826878]  req@ffff9ee00572a940 x1874670272779008/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826903 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826878.611854:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2042
00000100:00080000:2.0:1787826878.611861:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787826878.611868:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787826878.611870:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a940 x1874670272779008/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826903 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:2.0:1787826878.611875:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:0.0:1787826878.611884:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826878.611888:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826878.611893:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572ad00 x1874670272779648/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787826878.611895:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272779008:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787826878.611925:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272779136:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787826878.611943:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787826878.611960:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826878/real 1787826878]  req@ffff9ee005729e00 x1874670272779136/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826903 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826878.611971:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729e00 x1874670272779136/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826903 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826878.611979:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826878.611982:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826878.611985:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272779136:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787826878.611990:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272779264:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787826878.612008:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787826878.612017:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826878/real 1787826878]  req@ffff9ee005728000 x1874670272779264/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826903 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826878.612027:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728000 x1874670272779264/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826903 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826878.612034:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826878.612047:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826878.612051:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272779264:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787826878.612056:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272779392:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787826878.612071:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787826878.612080:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826878/real 1787826878]  req@ffff9ee00572b0c0 x1874670272779392/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826903 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826878.612091:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b0c0 x1874670272779392/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826903 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826878.612098:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826878.612101:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826878.612104:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272779392:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787826878.612109:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272779520:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787826878.612122:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787826878.612135:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826878/real 1787826878]  req@ffff9ee00572b480 x1874670272779520/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826903 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826878.612146:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b480 x1874670272779520/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826903 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826878.612154:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826878.612157:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826878.612160:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272779520:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787826878.612165:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272779648:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787826878.612184:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787826878.612192:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826878/real 1787826878]  req@ffff9ee00572ad00 x1874670272779648/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826903 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826878.612203:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572ad00 x1874670272779648/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826903 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826878.612210:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826878.612213:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826878.612216:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272779648:192.168.203.121@tcp:8:kworker.0
00010000:00010000:3.0:1787826879.443520:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787826879.635411:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787826880.467731:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787826880.659457:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787826881.491525:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787826881.683470:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787826882.515438:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787826882.707419:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787826883.539513:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787826883.731435:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:0.0:1787826883.731450:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787826883.731456:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1787826883.731460:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787826883.731469:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2047
00000100:00080000:0.0:1787826883.731480:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787826883.731486:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787826883.731520:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ea580 x1874670272779776/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787826883.731553:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787826883.731557:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787826883.731559:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787826883.731563:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2047
00000100:00080000:0.0:1787826883.731567:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787826883.731571:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787826883.731579:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787826883.731591:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ead00 x1874670272779904/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787826883.731600:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787826883.731603:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787826883.731604:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787826883.731608:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2047
00000100:00080000:0.0:1787826883.731611:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787826883.731615:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787826883.731619:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787826883.731628:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9a40 x1874670272780032/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787826883.731635:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787826883.731639:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787826883.731640:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787826883.731643:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2047
00000100:00080000:0.0:1787826883.731646:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787826883.731650:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787826883.731654:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787826883.731664:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb0c0 x1874670272780160/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787826883.731673:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787826883.731676:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787826883.731678:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787826883.731682:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2047
00000100:00080000:0.0:1787826883.731685:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787826883.731688:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787826883.731692:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787826883.731700:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ea940 x1874670272780288/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787826883.731708:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787826883.731712:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787826883.731713:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787826883.731717:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2047
00000100:00080000:0.0:1787826883.731720:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787826883.731723:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787826883.731727:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787826883.731735:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9e00 x1874670272780416/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787826883.731744:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787826883.731747:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787826883.731749:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787826883.731752:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2047
00000100:00080000:0.0:1787826883.731755:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787826883.731758:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787826883.731762:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787826883.731770:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb480 x1874670272780544/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787826883.731842:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272779776:192.168.203.121@tcp:250:kworker.0
00000800:00000100:2.0:1787826883.731901:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826883.731940:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826883/real 1787826883]  req@ffff9ee0056ea580 x1874670272779776/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787826908 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826883.731957:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ea580 x1874670272779776/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787826908 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826883.731963:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826883.731966:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826883.731969:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272779776:192.168.203.121@tcp:250:kworker.0
00000100:00100000:2.0:1787826883.731973:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272779904:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787826883.731990:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826883.731997:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826883/real 1787826883]  req@ffff9ee0056ead00 x1874670272779904/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826908 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826883.732020:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ead00 x1874670272779904/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826908 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826883.732025:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826883.732027:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826883.732029:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272779904:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787826883.732033:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272780032:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787826883.732047:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826883.732053:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826883/real 1787826883]  req@ffff9ee0056e9a40 x1874670272780032/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826908 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826883.732059:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9a40 x1874670272780032/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826908 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826883.732064:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826883.732065:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826883.732067:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272780032:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787826883.732070:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272780160:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787826883.732079:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826883.732086:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826883/real 1787826883]  req@ffff9ee0056eb0c0 x1874670272780160/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826908 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826883.732096:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb0c0 x1874670272780160/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826908 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826883.732102:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826883.732105:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826883.732108:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272780160:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787826883.732113:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272780288:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787826883.732131:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826883.732141:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826883/real 1787826883]  req@ffff9ee0056ea940 x1874670272780288/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826908 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826883.732157:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ea940 x1874670272780288/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826908 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826883.732163:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826883.732166:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826883.732169:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272780288:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787826883.732174:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272780416:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787826883.732192:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826883.732203:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826883/real 1787826883]  req@ffff9ee0056e9e00 x1874670272780416/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826908 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826883.732214:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9e00 x1874670272780416/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826908 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826883.732221:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826883.732223:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826883.732226:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272780416:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787826883.732231:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272780544:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787826883.732246:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826883.732253:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826883/real 1787826883]  req@ffff9ee0056eb480 x1874670272780544/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826908 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826883.732259:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb480 x1874670272780544/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826908 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826883.732268:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826883.732269:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826883.732271:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272780544:192.168.203.121@tcp:8:kworker.0
00010000:00010000:3.0:1787826884.564290:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787826884.755426:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787826885.588858:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787826885.779483:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787826886.611557:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787826886.803430:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787826887.635524:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787826887.828935:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787826888.659546:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787826888.851397:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00100000:2.0:1787826888.851574:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272780672:192.168.203.121@tcp:250:kworker.0
00000800:00000100:2.0:1787826888.851645:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826888.851686:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826888/real 1787826888]  req@ffff9ee0056a30c0 x1874670272780672/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787826913 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826888.851711:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a30c0 x1874670272780672/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787826913 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826888.851722:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826888.851731:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826888.851739:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272780672:192.168.203.121@tcp:250:kworker.0
00000100:00100000:2.0:1787826888.851765:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272780800:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787826888.851802:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826888.851821:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826888/real 1787826888]  req@ffff9ee0056a0b40 x1874670272780800/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826913 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826888.851842:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0b40 x1874670272780800/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826913 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826888.851868:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826888.851874:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826888.851878:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272780800:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787826888.851886:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272780928:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787826888.851919:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826888.851929:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826888/real 1787826888]  req@ffff9ee0056a3480 x1874670272780928/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826913 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826888.851940:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a3480 x1874670272780928/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826913 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826888.851947:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826888.851950:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826888.851953:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272780928:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787826888.851959:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272781056:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787826888.851989:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826888.852001:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826888/real 1787826888]  req@ffff9ee0056a2580 x1874670272781056/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826913 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826888.852011:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a2580 x1874670272781056/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826913 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826888.852018:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826888.852020:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826888.852023:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272781056:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787826888.852028:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272781184:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787826888.852045:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826888.852055:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826888/real 1787826888]  req@ffff9ee0056a03c0 x1874670272781184/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826913 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826888.852065:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a03c0 x1874670272781184/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826913 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826888.852073:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826888.852076:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826888.852078:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272781184:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787826888.852094:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272781312:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787826888.852112:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826888.852121:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826888/real 1787826888]  req@ffff9ee0056a1e00 x1874670272781312/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826913 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826888.852146:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1e00 x1874670272781312/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826913 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826888.852152:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826888.852156:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826888.852158:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272781312:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787826888.852163:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272781440:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787826888.852180:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826888.852189:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826888/real 1787826888]  req@ffff9ee0056a0000 x1874670272781440/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826913 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826888.852200:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0000 x1874670272781440/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826913 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826888.852213:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826888.852216:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826888.852218:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272781440:192.168.203.121@tcp:8:kworker.0
00010000:00010000:3.0:1787826889.683482:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787826889.875810:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787826890.707503:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787826890.899395:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787826891.731515:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787826891.923607:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787826892.755607:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787826892.947377:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787826893.779457:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1787826893.971405:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787826893.971414:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787826893.971419:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1787826893.971428:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787826893.971428:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2057
00000100:00080000:3.0:1787826893.971442:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787826893.971450:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787826893.971482:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706580 x1874670272781568/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787826893.971501:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787826893.971504:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787826893.971505:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787826893.971508:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2057
00000100:00080000:3.0:1787826893.971510:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787826893.971513:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787826893.971519:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787826893.971527:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704000 x1874670272781696/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787826893.971533:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787826893.971535:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787826893.971536:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787826893.971538:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2057
00000100:00080000:3.0:1787826893.971541:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787826893.971543:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787826893.971546:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787826893.971552:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704b40 x1874670272781824/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787826893.971554:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272781568:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787826893.971563:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787826893.971566:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787826893.971567:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787826893.971569:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2057
00000100:00080000:3.0:1787826893.971570:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787826893.971572:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787826893.971574:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787826893.971581:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707480 x1874670272781952/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787826893.971586:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787826893.971588:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787826893.971589:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787826893.971591:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2057
00000100:00080000:3.0:1787826893.971605:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787826893.971607:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787826893.971610:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787826893.971617:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057061c0 x1874670272782080/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1787826893.971621:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787826893.971630:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787826893.971633:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787826893.971634:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787826893.971637:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2057
00000100:00080000:3.0:1787826893.971640:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787826893.971642:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787826893.971645:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787826893.971651:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705a40 x1874670272782208/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787826893.971656:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787826893.971658:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787826893.971659:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787826893.971663:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2057
00000100:00100000:2.0:1787826893.971664:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826893/real 1787826893]  req@ffff9ee005706580 x1874670272781568/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787826918 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787826893.971665:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787826893.971669:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787826893.971675:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787826893.971684:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704780 x1874670272782336/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787826893.971693:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706580 x1874670272781568/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787826918 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826893.971706:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826893.971710:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826893.971715:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272781568:192.168.203.121@tcp:250:kworker.0
00000100:00100000:2.0:1787826893.971721:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272781696:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787826893.971740:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826893.971748:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826893/real 1787826893]  req@ffff9ee005704000 x1874670272781696/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826918 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826893.971755:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704000 x1874670272781696/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826918 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826893.971760:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826893.971762:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826893.971764:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272781696:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787826893.971780:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272781824:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787826893.971790:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826893.971795:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826893/real 1787826893]  req@ffff9ee005704b40 x1874670272781824/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826918 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826893.971802:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704b40 x1874670272781824/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826918 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826893.971806:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826893.971808:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826893.971809:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272781824:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787826893.971812:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272781952:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787826893.971821:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826893.971828:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826893/real 1787826893]  req@ffff9ee005707480 x1874670272781952/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826918 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826893.971834:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707480 x1874670272781952/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826918 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826893.971839:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826893.971840:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826893.971842:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272781952:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787826893.971845:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272782080:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787826893.971854:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826893.971859:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826893/real 1787826893]  req@ffff9ee0057061c0 x1874670272782080/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826918 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826893.971865:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057061c0 x1874670272782080/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826918 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826893.971869:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826893.971871:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826893.971873:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272782080:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787826893.971875:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272782208:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787826893.971883:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826893.971888:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826893/real 1787826893]  req@ffff9ee005705a40 x1874670272782208/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826918 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826893.971893:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705a40 x1874670272782208/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826918 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826893.971897:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826893.971899:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826893.971901:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272782208:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787826893.971904:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272782336:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787826893.971911:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826893.971916:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826893/real 1787826893]  req@ffff9ee005704780 x1874670272782336/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826918 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826893.971921:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704780 x1874670272782336/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826918 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826893.971929:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826893.971946:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826893.971949:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272782336:192.168.203.121@tcp:8:kworker.0
00010000:00010000:3.0:1787826894.803503:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787826894.995420:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787826895.827527:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787826896.019482:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787826896.851512:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787826897.043459:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787826897.875577:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787826898.067445:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787826898.899501:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787826899.091435:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00100000:2.0:1787826899.091634:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272782464:192.168.203.121@tcp:250:kworker.0
00000800:00000100:2.0:1787826899.091693:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826899.091732:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826899/real 1787826899]  req@ffff9ee0056a0780 x1874670272782464/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787826924 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826899.091757:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0780 x1874670272782464/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787826924 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826899.091772:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826899.091778:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826899.091783:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272782464:192.168.203.121@tcp:250:kworker.0
00000100:00100000:2.0:1787826899.091807:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272782592:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787826899.091832:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826899.091847:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826899/real 1787826899]  req@ffff9ee0056a12c0 x1874670272782592/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826924 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826899.091859:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a12c0 x1874670272782592/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826924 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826899.091875:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826899.091882:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826899.091888:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272782592:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787826899.091911:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272782720:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787826899.091938:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826899.091952:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826899/real 1787826899]  req@ffff9ee0056a1a40 x1874670272782720/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826924 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826899.091982:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1a40 x1874670272782720/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826924 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826899.091992:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826899.091995:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826899.091999:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272782720:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787826899.092005:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272782848:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787826899.092021:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826899.092031:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826899/real 1787826899]  req@ffff9ee0056a3c00 x1874670272782848/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826924 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826899.092040:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a3c00 x1874670272782848/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826924 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826899.092047:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826899.092049:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826899.092052:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272782848:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787826899.092066:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272782976:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787826899.092092:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826899.092101:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826899/real 1787826899]  req@ffff9ee0056a2940 x1874670272782976/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826924 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826899.092111:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a2940 x1874670272782976/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826924 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826899.092118:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826899.092121:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826899.092124:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272782976:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787826899.092129:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272783104:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787826899.092144:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826899.092154:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826899/real 1787826899]  req@ffff9ee0056a1680 x1874670272783104/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826924 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826899.092163:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1680 x1874670272783104/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826924 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826899.092170:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826899.092173:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826899.092176:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272783104:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787826899.092181:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272783232:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787826899.092195:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826899.092203:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826899/real 1787826899]  req@ffff9ee0056a0f00 x1874670272783232/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826924 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826899.092212:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0f00 x1874670272783232/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826924 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826899.092224:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826899.092227:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826899.092230:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272783232:192.168.203.121@tcp:8:kworker.0
00010000:00010000:3.0:1787826899.923441:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787826900.115424:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787826900.947488:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1787826901.971505:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1787826902.995484:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1787826904.019561:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1787826904.211449:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787826904.211459:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787826904.211464:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787826904.211474:0:8:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2067
00000100:00080000:2.0:1787826904.211485:0:8:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787826904.211492:0:8:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787826904.211533:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a580 x1874670272783360/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787826904.211556:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787826904.211559:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787826904.211560:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787826904.211563:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2067
00000100:00080000:2.0:1787826904.211565:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787826904.211567:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787826904.211577:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787826904.211590:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728b40 x1874670272783488/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787826904.211598:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272783360:192.168.203.121@tcp:250:kworker.0
00000100:00080000:2.0:1787826904.211604:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787826904.211609:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787826904.211612:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787826904.211616:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2067
00000100:00080000:2.0:1787826904.211621:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787826904.211625:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787826904.211631:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787826904.211643:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729a40 x1874670272783616/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787826904.211653:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787826904.211656:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787826904.211658:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787826904.211662:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2067
00000100:00080000:2.0:1787826904.211666:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787826904.211671:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000800:00000100:0.0:1787826904.211674:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000008:00100000:2.0:1787826904.211679:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787826904.211693:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572ad00 x1874670272783744/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787826904.211712:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787826904.211716:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787826904.211717:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787826904.211722:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2067
00000100:00080000:2.0:1787826904.211727:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1787826904.211729:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826904/real 1787826904]  req@ffff9ee00572a580 x1874670272783360/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787826929 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826904.211734:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787826904.211742:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787826904.211755:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b480 x1874670272783872/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787826904.211758:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a580 x1874670272783360/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787826929 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826904.211766:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787826904.211772:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787826904.211774:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787826904.211779:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2067
00000100:00080000:0.0:1787826904.211782:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826904.211782:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787826904.211788:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00080000:0.0:1787826904.211792:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000008:00100000:2.0:1787826904.211793:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787826904.211798:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272783360:192.168.203.121@tcp:250:kworker.0
00000100:00100000:2.0:1787826904.211803:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b0c0 x1874670272784000/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787826904.211809:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787826904.211812:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787826904.211813:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787826904.211816:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2067
00000100:00080000:2.0:1787826904.211817:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787826904.211819:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787826904.211821:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787826904.211827:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272783488:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787826904.211829:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728000 x1874670272784128/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1787826904.211851:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787826904.211876:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826904/real 1787826904]  req@ffff9ee005728b40 x1874670272783488/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826929 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826904.211890:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728b40 x1874670272783488/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826929 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826904.211898:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826904.211901:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826904.211904:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272783488:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787826904.211910:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272783616:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787826904.211932:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787826904.211944:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826904/real 1787826904]  req@ffff9ee005729a40 x1874670272783616/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826929 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826904.211952:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729a40 x1874670272783616/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826929 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826904.211958:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826904.211960:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826904.211962:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272783616:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787826904.211966:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272783744:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787826904.211978:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787826904.211985:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826904/real 1787826904]  req@ffff9ee00572ad00 x1874670272783744/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826929 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826904.211992:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572ad00 x1874670272783744/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826929 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826904.211997:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826904.211998:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826904.212000:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272783744:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787826904.212003:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272783872:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787826904.212012:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787826904.212017:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826904/real 1787826904]  req@ffff9ee00572b480 x1874670272783872/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826929 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826904.212024:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b480 x1874670272783872/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826929 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826904.212028:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826904.212030:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826904.212031:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272783872:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787826904.212034:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272784000:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787826904.212042:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787826904.212047:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826904/real 1787826904]  req@ffff9ee00572b0c0 x1874670272784000/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826929 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826904.212053:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b0c0 x1874670272784000/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826929 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826904.212058:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826904.212059:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826904.212061:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272784000:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787826904.212076:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272784128:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787826904.212085:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787826904.212090:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826904/real 1787826904]  req@ffff9ee005728000 x1874670272784128/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826929 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826904.212096:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728000 x1874670272784128/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826929 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826904.212101:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826904.212103:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826904.212104:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272784128:192.168.203.121@tcp:8:kworker.0
00010000:00010000:3.0:1787826905.043491:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787826905.235458:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787826906.067596:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787826906.259426:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787826907.091545:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787826907.283962:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787826908.115475:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787826908.307422:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787826909.139509:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787826909.331379:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00100000:0.0:1787826909.331554:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272784256:192.168.203.121@tcp:250:kworker.0
00000800:00000100:0.0:1787826909.331622:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787826909.331667:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826909/real 1787826909]  req@ffff9ee0056a21c0 x1874670272784256/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787826934 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826909.331693:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a21c0 x1874670272784256/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787826934 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826909.331711:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826909.331720:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826909.331727:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272784256:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787826909.331757:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272784384:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787826909.331780:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787826909.331793:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826909/real 1787826909]  req@ffff9ee0056a0f00 x1874670272784384/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826934 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826909.331807:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0f00 x1874670272784384/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826934 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826909.331818:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826909.331945:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826909.331949:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272784384:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787826909.331956:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272784512:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787826909.331988:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787826909.332000:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826909/real 1787826909]  req@ffff9ee0056a1680 x1874670272784512/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826934 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826909.332012:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1680 x1874670272784512/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826934 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826909.332020:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826909.332023:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826909.332031:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272784512:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787826909.332037:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272784640:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787826909.332057:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787826909.332068:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826909/real 1787826909]  req@ffff9ee0056a2940 x1874670272784640/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826934 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826909.332079:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a2940 x1874670272784640/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826934 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826909.332087:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826909.332090:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826909.332093:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272784640:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787826909.332098:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272784768:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787826909.332113:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787826909.332120:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826909/real 1787826909]  req@ffff9ee0056a3c00 x1874670272784768/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826934 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826909.332127:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a3c00 x1874670272784768/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826934 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826909.332131:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826909.332133:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826909.332135:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272784768:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787826909.332148:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272784896:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787826909.332157:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787826909.332162:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826909/real 1787826909]  req@ffff9ee0056a1a40 x1874670272784896/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826934 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826909.332172:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1a40 x1874670272784896/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826934 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826909.332180:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826909.332183:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826909.332186:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272784896:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787826909.332192:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272785024:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787826909.332209:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787826909.332219:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826909/real 1787826909]  req@ffff9ee0056a12c0 x1874670272785024/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826934 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826909.332228:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a12c0 x1874670272785024/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826934 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826909.332235:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826909.332238:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826909.332241:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272785024:192.168.203.121@tcp:8:kworker.0
00010000:00010000:3.0:1787826910.163489:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1787826911.187496:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1787826912.211546:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1787826913.235467:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1787826914.259502:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1787826914.451442:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787826914.451454:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787826914.451459:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787826914.451469:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2078
00000100:00080000:3.0:1787826914.451479:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787826914.451486:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787826914.451527:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707840 x1874670272785152/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787826914.451554:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787826914.451558:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787826914.451560:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787826914.451563:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2078
00000100:00080000:3.0:1787826914.451567:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787826914.451570:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787826914.451579:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787826914.451591:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705e00 x1874670272785280/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787826914.451602:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787826914.451606:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00100000:0.0:1787826914.451608:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272785152:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787826914.451609:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787826914.451616:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2078
00000100:00080000:3.0:1787826914.451620:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787826914.451623:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787826914.451628:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787826914.451640:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704780 x1874670272785408/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787826914.451649:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787826914.451652:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787826914.451654:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787826914.451658:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2078
00000100:00080000:3.0:1787826914.451661:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787826914.451665:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000800:00000100:0.0:1787826914.451670:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000008:00100000:3.0:1787826914.451673:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787826914.451685:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705a40 x1874670272785536/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787826914.451694:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787826914.451697:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787826914.451699:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787826914.451704:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2078
00000100:00100000:0.0:1787826914.451711:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826914/real 1787826914]  req@ffff9ee005707840 x1874670272785152/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787826939 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787826914.451716:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787826914.451723:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787826914.451730:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787826914.451735:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707840 x1874670272785152/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787826939 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787826914.451741:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057061c0 x1874670272785664/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787826914.451753:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787826914.451756:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787826914.451761:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787826914.451762:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:3.0:1787826914.451764:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1787826914.451770:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272785152:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787826914.451779:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2078
00000100:00080000:3.0:1787826914.451784:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787826914.451798:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787826914.451803:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787826914.451804:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272785280:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787826914.451817:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707480 x1874670272785792/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787826914.451827:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:0.0:1787826914.451832:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787826914.451834:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787826914.451837:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1787826914.451847:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826914/real 1787826914]  req@ffff9ee005705e00 x1874670272785280/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826939 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787826914.451848:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2078
00000100:00080000:3.0:1787826914.451854:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787826914.451861:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787826914.451867:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787826914.451872:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705e00 x1874670272785280/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826939 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787826914.451880:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704b40 x1874670272785920/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787826914.451885:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826914.451893:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826914.451899:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272785280:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787826914.451906:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272785408:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787826914.451928:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787826914.451939:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826914/real 1787826914]  req@ffff9ee005704780 x1874670272785408/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826939 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826914.451949:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704780 x1874670272785408/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826939 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826914.451957:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826914.451960:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826914.451963:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272785408:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787826914.451968:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272785536:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787826914.451986:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787826914.452007:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826914/real 1787826914]  req@ffff9ee005705a40 x1874670272785536/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826939 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826914.452018:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705a40 x1874670272785536/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826939 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826914.452025:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826914.452028:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826914.452031:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272785536:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787826914.452037:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272785664:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787826914.452054:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787826914.452064:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826914/real 1787826914]  req@ffff9ee0057061c0 x1874670272785664/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826939 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826914.452075:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057061c0 x1874670272785664/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826939 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826914.452082:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826914.452085:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826914.452088:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272785664:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787826914.452103:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272785792:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787826914.452121:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787826914.452132:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826914/real 1787826914]  req@ffff9ee005707480 x1874670272785792/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826939 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826914.452142:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707480 x1874670272785792/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826939 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826914.452149:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826914.452152:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826914.452155:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272785792:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787826914.452160:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272785920:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787826914.452177:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787826914.452187:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826914/real 1787826914]  req@ffff9ee005704b40 x1874670272785920/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826939 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826914.452197:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704b40 x1874670272785920/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826939 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826914.452205:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826914.452208:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826914.452210:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272785920:192.168.203.121@tcp:8:kworker.0
00010000:00010000:3.0:1787826915.283453:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787826915.475409:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787826916.307521:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787826916.499404:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787826917.331508:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787826917.523513:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787826918.355579:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787826918.547442:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787826919.379455:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787826919.571491:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:2.0:1787826919.571494:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787826919.571506:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787826919.571512:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787826919.571527:0:8:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2083
00000100:00080000:2.0:1787826919.571543:0:8:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787826919.571553:0:8:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787826919.571609:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729e00 x1874670272786048/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787826919.571641:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787826919.571645:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787826919.571647:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787826919.571651:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2083
00000100:00080000:2.0:1787826919.571655:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787826919.571660:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787826919.571673:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787826919.571688:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272786048:192.168.203.121@tcp:250:kworker.0
00000100:00100000:2.0:1787826919.571688:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a940 x1874670272786176/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787826919.571704:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787826919.571707:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787826919.571710:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787826919.571714:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2083
00000100:00080000:2.0:1787826919.571718:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787826919.571722:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787826919.571727:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787826919.571739:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b840 x1874670272786304/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787826919.571767:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787826919.571770:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787826919.571773:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787826919.571777:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2083
00000100:00080000:2.0:1787826919.571781:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787826919.571786:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787826919.571791:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787826919.571803:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057283c0 x1874670272786432/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787826919.571813:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1787826919.571818:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272786176:192.168.203.121@tcp:38:kworker.0
00000100:00080000:2.0:1787826919.571820:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787826919.571824:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787826919.571830:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2083
00000100:00080000:2.0:1787826919.571833:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787826919.571839:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787826919.571844:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787826919.571849:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272786304:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787826919.571859:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a1c0 x1874670272786560/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787826919.571870:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272786432:192.168.203.121@tcp:8:kworker.0
00000100:00080000:2.0:1787826919.571872:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787826919.571879:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787826919.571881:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787826919.571887:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2083
00000100:00080000:2.0:1787826919.571893:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787826919.571898:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787826919.571903:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272786560:192.168.203.121@tcp:38:kworker.0
00000008:00100000:2.0:1787826919.571905:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787826919.571923:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728f00 x1874670272786688/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787826919.571948:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787826919.571952:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787826919.571955:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787826919.571960:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2083
00000100:00100000:0.0:1787826919.571964:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272786688:192.168.203.121@tcp:8:kworker.0
00000100:00080000:2.0:1787826919.571965:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787826919.571974:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787826919.571981:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787826919.571995:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572bc00 x1874670272786816/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787826919.572047:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272786816:192.168.203.121@tcp:8:kworker.0
00010000:00010000:3.0:1787826920.403545:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787826920.595426:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787826921.427508:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787826921.619453:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787826922.451486:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787826922.643416:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00100000:0.0:1787826922.643687:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826919/real 1787826922]  req@ffff9ee00572bc00 x1874670272786816/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826944 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826922.643710:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572bc00 x1874670272786816/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826944 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826922.643721:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826922.643726:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826922.643729:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272786816:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787826922.643748:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826919/real 1787826922]  req@ffff9ee005728f00 x1874670272786688/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826944 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826922.643759:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728f00 x1874670272786688/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826944 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826922.643766:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826922.643769:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826922.643772:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272786688:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787826922.643778:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826919/real 1787826922]  req@ffff9ee00572a1c0 x1874670272786560/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826944 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826922.643788:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a1c0 x1874670272786560/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826944 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826922.643795:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826922.643798:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826922.643801:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272786560:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787826922.643807:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826919/real 1787826922]  req@ffff9ee00572a940 x1874670272786176/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826944 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826922.643816:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a940 x1874670272786176/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826944 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826922.643823:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826922.643825:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826922.643828:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272786176:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787826922.643833:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826919/real 1787826922]  req@ffff9ee00572b840 x1874670272786304/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826944 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826922.643842:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b840 x1874670272786304/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826944 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826922.643848:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826922.643851:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826922.643853:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272786304:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787826922.643859:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826919/real 1787826922]  req@ffff9ee0057283c0 x1874670272786432/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826944 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826922.643867:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057283c0 x1874670272786432/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826944 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826922.643874:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826922.643877:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826922.643879:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272786432:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787826922.643885:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826919/real 1787826922]  req@ffff9ee005729e00 x1874670272786048/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787826944 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826922.643894:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729e00 x1874670272786048/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787826944 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826922.643901:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826922.643904:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826922.643906:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272786048:192.168.203.121@tcp:250:kworker.0
00010000:00010000:0.0:1787826923.475507:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787826923.667434:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787826924.499494:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787826924.691417:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787826924.691458:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787826924.691463:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787826924.691467:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787826924.691475:0:8:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2088
00000100:00080000:3.0:1787826924.691484:0:8:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787826924.691491:0:8:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787826924.691520:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704000 x1874670272786944/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787826924.691563:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787826924.691567:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787826924.691568:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787826924.691572:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2088
00000100:00080000:3.0:1787826924.691577:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787826924.691581:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787826924.691591:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787826924.691605:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706580 x1874670272787072/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787826924.691611:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272786944:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787826924.691621:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787826924.691625:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787826924.691627:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787826924.691632:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2088
00000100:00080000:3.0:1787826924.691637:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787826924.691641:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787826924.691647:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787826924.691660:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705680 x1874670272787200/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787826924.691670:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:2.0:1787826924.691673:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787826924.691676:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787826924.691679:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787826924.691684:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2088
00000100:00080000:3.0:1787826924.691689:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787826924.691693:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787826924.691698:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787826924.691709:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706940 x1874670272787328/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787826924.691714:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826924/real 1787826924]  req@ffff9ee005704000 x1874670272786944/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787826949 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787826924.691741:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787826924.691746:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787826924.691748:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1787826924.691752:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704000 x1874670272786944/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787826949 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787826924.691756:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2088
00000100:00080000:3.0:1787826924.691762:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787826924.691768:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787826924.691769:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00080000:2.0:1787826924.691776:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000008:00100000:3.0:1787826924.691777:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787826924.691783:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272786944:192.168.203.121@tcp:250:kworker.0
00000100:00100000:3.0:1787826924.691792:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707c00 x1874670272787456/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787826924.691802:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787826924.691806:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00100000:2.0:1787826924.691810:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272787072:192.168.203.121@tcp:38:kworker.0
00000100:00080000:3.0:1787826924.691810:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787826924.691818:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2088
00000100:00080000:3.0:1787826924.691824:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787826924.691828:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787826924.691833:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:2.0:1787826924.691842:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787826924.691847:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057052c0 x1874670272787584/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787826924.691860:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826924/real 1787826924]  req@ffff9ee005706580 x1874670272787072/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826949 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787826924.691879:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787826924.691887:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787826924.691891:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787826924.691897:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2088
00000100:00100000:2.0:1787826924.691901:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706580 x1874670272787072/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826949 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787826924.691902:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787826924.691909:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787826924.691917:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:2.0:1787826924.691918:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826924.691924:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826924.691929:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272787072:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787826924.691932:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057043c0 x1874670272787712/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787826924.691939:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272787200:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787826924.691967:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826924.691978:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826924/real 1787826924]  req@ffff9ee005705680 x1874670272787200/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826949 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826924.691988:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705680 x1874670272787200/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826949 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826924.691995:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826924.691998:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826924.692001:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272787200:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787826924.692006:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272787328:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787826924.692022:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826924.692031:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826924/real 1787826924]  req@ffff9ee005706940 x1874670272787328/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826949 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826924.692043:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706940 x1874670272787328/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826949 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826924.692050:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826924.692052:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826924.692055:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272787328:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787826924.692060:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272787456:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787826924.692077:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826924.692088:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826924/real 1787826924]  req@ffff9ee005707c00 x1874670272787456/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826949 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826924.692099:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707c00 x1874670272787456/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826949 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826924.692105:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826924.692108:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826924.692111:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272787456:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787826924.692131:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272787584:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787826924.692150:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826924.692161:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826924/real 1787826924]  req@ffff9ee0057052c0 x1874670272787584/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826949 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826924.692171:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057052c0 x1874670272787584/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826949 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826924.692190:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826924.692193:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826924.692195:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272787584:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787826924.692201:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272787712:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787826924.692217:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826924.692228:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826924/real 1787826924]  req@ffff9ee0057043c0 x1874670272787712/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826949 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826924.692239:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057043c0 x1874670272787712/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826949 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826924.692246:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826924.692248:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826924.692251:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272787712:192.168.203.121@tcp:8:kworker.0
00010000:00010000:3.0:1787826925.523489:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787826925.715432:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787826926.547486:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787826926.739416:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787826927.571500:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787826927.763414:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787826928.595526:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787826928.787422:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787826929.619531:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1787826929.811485:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787826929.811495:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787826929.811499:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787826929.811511:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2093
00000100:00080000:3.0:1787826929.811522:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787826929.811530:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787826929.811565:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706d00 x1874670272787840/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787826929.811603:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787826929.811607:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787826929.811609:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787826929.811613:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2093
00000100:00080000:3.0:1787826929.811616:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787826929.811620:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787826929.811629:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787826929.811639:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057070c0 x1874670272787968/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787826929.811648:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787826929.811651:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787826929.811652:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787826929.811655:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2093
00000100:00080000:3.0:1787826929.811659:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787826929.811662:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787826929.811666:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787826929.811677:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057043c0 x1874670272788096/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787826929.811697:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787826929.811700:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787826929.811702:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787826929.811705:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2093
00000100:00080000:3.0:1787826929.811708:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787826929.811711:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787826929.811714:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787826929.811721:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057052c0 x1874670272788224/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787826929.811727:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787826929.811729:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787826929.811730:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787826929.811732:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2093
00000100:00080000:3.0:1787826929.811734:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787826929.811736:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787826929.811738:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787826929.811742:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707c00 x1874670272788352/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787826929.811748:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787826929.811750:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787826929.811751:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787826929.811753:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2093
00000100:00080000:3.0:1787826929.811754:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787826929.811756:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787826929.811758:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787826929.811762:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706940 x1874670272788480/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787826929.811771:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787826929.811774:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787826929.811776:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787826929.811779:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2093
00000100:00080000:3.0:1787826929.811782:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787826929.811785:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787826929.811789:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787826929.811797:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705680 x1874670272788608/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787826929.814372:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272787840:192.168.203.121@tcp:250:kworker.0
00000800:00000100:2.0:1787826929.814439:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826929.814483:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826929/real 1787826929]  req@ffff9ee005706d00 x1874670272787840/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787826954 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826929.814500:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706d00 x1874670272787840/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787826954 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826929.814511:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826929.814515:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826929.814519:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272787840:192.168.203.121@tcp:250:kworker.0
00000100:00100000:2.0:1787826929.814527:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272787968:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787826929.814561:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826929.814574:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826929/real 1787826929]  req@ffff9ee0057070c0 x1874670272787968/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826954 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826929.814586:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057070c0 x1874670272787968/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826954 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826929.814594:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826929.814597:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826929.814600:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272787968:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787826929.814606:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272788096:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787826929.814626:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826929.814637:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826929/real 1787826929]  req@ffff9ee0057043c0 x1874670272788096/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826954 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826929.814648:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057043c0 x1874670272788096/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826954 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826929.814656:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826929.814658:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826929.814661:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272788096:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787826929.814668:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272788224:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787826929.814701:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826929.814712:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826929/real 1787826929]  req@ffff9ee0057052c0 x1874670272788224/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826954 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826929.814723:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057052c0 x1874670272788224/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826954 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826929.814730:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826929.814733:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826929.814736:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272788224:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787826929.814742:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272788352:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787826929.814760:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826929.814771:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826929/real 1787826929]  req@ffff9ee005707c00 x1874670272788352/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826954 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826929.814782:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707c00 x1874670272788352/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826954 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826929.814790:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826929.814793:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826929.814796:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272788352:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787826929.814802:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272788480:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787826929.814820:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826929.814830:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826929/real 1787826929]  req@ffff9ee005706940 x1874670272788480/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826954 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826929.814840:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706940 x1874670272788480/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826954 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826929.814852:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826929.814855:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826929.814857:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272788480:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787826929.814863:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272788608:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787826929.814880:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826929.814891:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826929/real 1787826929]  req@ffff9ee005705680 x1874670272788608/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826954 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826929.814901:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705680 x1874670272788608/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826954 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826929.814909:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826929.814912:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826929.814915:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272788608:192.168.203.121@tcp:8:kworker.0
00010000:00010000:3.0:1787826930.643530:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1787826931.667577:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1787826932.691499:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1787826933.715509:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1787826934.739455:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1787826934.931461:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787826934.931468:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787826934.931479:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787826934.931489:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2098
00000100:00080000:3.0:1787826934.931499:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787826934.931506:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787826934.931538:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706580 x1874670272788736/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787826934.931564:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787826934.931567:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787826934.931569:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787826934.931573:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2098
00000100:00080000:3.0:1787826934.931575:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787826934.931579:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787826934.931587:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787826934.931598:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704000 x1874670272788864/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787826934.931607:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787826934.931612:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00100000:2.0:1787826934.931613:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272788736:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787826934.931614:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787826934.931622:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2098
00000100:00080000:3.0:1787826934.931625:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787826934.931629:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787826934.931634:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787826934.931657:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704b40 x1874670272788992/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787826934.931666:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787826934.931670:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787826934.931671:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787826934.931675:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2098
00000100:00080000:3.0:1787826934.931678:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787826934.931683:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787826934.931687:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:2.0:1787826934.931692:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787826934.931701:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707480 x1874670272789120/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787826934.931711:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787826934.931713:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787826934.931715:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787826934.931719:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2098
00000100:00080000:3.0:1787826934.931722:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787826934.931727:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787826934.931731:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787826934.931732:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826934/real 1787826934]  req@ffff9ee005706580 x1874670272788736/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787826959 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787826934.931746:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057061c0 x1874670272789248/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787826934.931752:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706580 x1874670272788736/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787826959 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787826934.931767:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787826934.931770:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787826934.931771:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787826934.931772:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787826934.931780:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:3.0:1787826934.931780:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2098
00000100:00080000:3.0:1787826934.931786:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1787826934.931790:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272788736:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787826934.931793:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787826934.931800:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787826934.931808:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705a40 x1874670272789376/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787826934.931815:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1787826934.931816:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272788864:192.168.203.121@tcp:38:kworker.0
00000100:00080000:3.0:1787826934.931818:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787826934.931829:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787826934.931837:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2098
00000100:00080000:3.0:1787826934.931841:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000800:00000100:2.0:1787826934.931842:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787826934.931850:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787826934.931856:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787826934.931859:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826934/real 1787826934]  req@ffff9ee005704000 x1874670272788864/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826959 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787826934.931870:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704780 x1874670272789504/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787826934.931876:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704000 x1874670272788864/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826959 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826934.931892:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826934.931896:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826934.931899:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272788864:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787826934.931906:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272788992:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787826934.931924:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826934.931934:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826934/real 1787826934]  req@ffff9ee005704b40 x1874670272788992/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826959 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826934.931945:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704b40 x1874670272788992/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826959 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826934.931952:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826934.931955:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826934.931958:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272788992:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787826934.931963:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272789120:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787826934.931979:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826934.931988:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826934/real 1787826934]  req@ffff9ee005707480 x1874670272789120/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826959 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826934.932000:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707480 x1874670272789120/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826959 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826934.932006:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826934.932008:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826934.932011:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272789120:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787826934.932016:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272789248:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787826934.932032:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826934.932041:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826934/real 1787826934]  req@ffff9ee0057061c0 x1874670272789248/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826959 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826934.932051:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057061c0 x1874670272789248/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826959 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826934.932057:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826934.932060:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826934.932062:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272789248:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787826934.932076:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272789376:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787826934.932091:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826934.932100:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826934/real 1787826934]  req@ffff9ee005705a40 x1874670272789376/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826959 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826934.932108:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705a40 x1874670272789376/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826959 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826934.932120:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826934.932122:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826934.932125:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272789376:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787826934.932129:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272789504:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787826934.932143:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826934.932152:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826934/real 1787826934]  req@ffff9ee005704780 x1874670272789504/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826959 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826934.932162:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704780 x1874670272789504/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826959 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826934.932168:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826934.932171:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826934.932174:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272789504:192.168.203.121@tcp:8:kworker.0
00010000:00010000:3.0:1787826935.763504:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1787826936.787501:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1787826937.811504:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1787826938.835561:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1787826939.859503:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1787826940.052106:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787826940.052112:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787826940.052116:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787826940.052125:0:8:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2103
00000100:00080000:2.0:1787826940.052136:0:8:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787826940.052143:0:8:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787826940.052177:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728780 x1874670272789632/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787826940.052209:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787826940.052214:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787826940.052215:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787826940.052219:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2103
00000100:00080000:2.0:1787826940.052223:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787826940.052227:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787826940.052236:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787826940.052247:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057292c0 x1874670272789760/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787826940.052257:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787826940.052260:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787826940.052261:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787826940.052265:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2103
00000100:00080000:2.0:1787826940.052268:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787826940.052272:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787826940.052276:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787826940.052285:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729680 x1874670272789888/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787826940.052294:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787826940.052297:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787826940.052299:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787826940.052302:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2103
00000100:00080000:2.0:1787826940.052305:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787826940.052308:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787826940.052313:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787826940.052460:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272789632:192.168.203.121@tcp:250:kworker.0
00000800:00000100:0.0:1787826940.052517:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787826940.052555:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826940/real 1787826940]  req@ffff9ee005728780 x1874670272789632/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787826965 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826940.052570:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728780 x1874670272789632/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787826965 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826940.052580:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826940.052584:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826940.052587:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272789632:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787826940.052594:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057292c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272789760:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787826940.052631:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787826940.052643:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826940/real 1787826940]  req@ffff9ee0057292c0 x1874670272789760/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826965 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826940.052655:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057292c0 x1874670272789760/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826965 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826940.052663:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826940.052666:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826940.052669:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057292c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272789760:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787826940.052675:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272789888:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787826940.052694:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787826940.052704:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826940/real 1787826940]  req@ffff9ee005729680 x1874670272789888/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826965 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826940.052715:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729680 x1874670272789888/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826965 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826940.052723:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826940.052726:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826940.052729:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272789888:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787826940.052811:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729680 x1874670272790016/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787826940.052831:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787826940.052834:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787826940.052836:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787826940.052840:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2103
00000100:00080000:2.0:1787826940.052844:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787826940.052849:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787826940.052854:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787826940.052864:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057292c0 x1874670272790144/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787826940.052873:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787826940.052876:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787826940.052878:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787826940.052881:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2103
00000100:00080000:2.0:1787826940.052884:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787826940.052888:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787826940.052891:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787826940.052899:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728780 x1874670272790272/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787826940.052908:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787826940.052911:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787826940.052913:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787826940.052916:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2103
00000100:00080000:2.0:1787826940.052919:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787826940.052922:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787826940.052926:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787826940.052936:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729e00 x1874670272790400/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787826940.053427:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272790016:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787826940.053453:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787826940.053465:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826940/real 1787826940]  req@ffff9ee005729680 x1874670272790016/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826965 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826940.053478:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729680 x1874670272790016/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826965 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826940.053484:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826940.053486:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826940.053488:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272790016:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787826940.053492:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057292c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272790144:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787826940.053505:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787826940.053511:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826940/real 1787826940]  req@ffff9ee0057292c0 x1874670272790144/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826965 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826940.053518:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057292c0 x1874670272790144/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826965 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826940.053523:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826940.053525:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826940.053527:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057292c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272790144:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787826940.053530:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272790272:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787826940.053538:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787826940.053543:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826940/real 1787826940]  req@ffff9ee005728780 x1874670272790272/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826965 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826940.053549:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728780 x1874670272790272/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826965 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826940.053557:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826940.053559:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826940.053561:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272790272:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787826940.053564:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272790400:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787826940.053574:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787826940.053582:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826940/real 1787826940]  req@ffff9ee005729e00 x1874670272790400/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826965 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826940.053591:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729e00 x1874670272790400/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826965 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826940.053597:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826940.053600:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826940.053603:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272790400:192.168.203.121@tcp:8:kworker.0
00010000:00010000:3.0:1787826940.883499:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1787826941.907493:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1787826942.931497:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1787826943.955701:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1787826944.979866:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1787826945.171443:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787826945.171455:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787826945.171459:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787826945.171469:0:8:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2108
00000100:00080000:2.0:1787826945.171480:0:8:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787826945.171487:0:8:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787826945.171537:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057283c0 x1874670272790528/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787826945.171582:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787826945.171586:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787826945.171588:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787826945.171592:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2108
00000100:00080000:2.0:1787826945.171596:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787826945.171600:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787826945.171610:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787826945.171622:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b840 x1874670272790656/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787826945.171635:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272790528:192.168.203.121@tcp:250:kworker.0
00000100:00080000:2.0:1787826945.171641:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787826945.171645:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787826945.171648:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787826945.171652:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2108
00000100:00080000:2.0:1787826945.171656:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787826945.171659:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787826945.171664:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787826945.171676:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a940 x1874670272790784/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787826945.171685:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787826945.171688:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787826945.171690:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787826945.171695:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2108
00000800:00000100:0.0:1787826945.171697:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:2.0:1787826945.171700:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787826945.171706:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787826945.171711:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787826945.171737:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a1c0 x1874670272790912/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787826945.171741:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826945/real 1787826945]  req@ffff9ee0057283c0 x1874670272790528/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787826970 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826945.171753:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787826945.171759:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787826945.171761:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787826945.171767:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2108
00000100:00100000:0.0:1787826945.171768:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057283c0 x1874670272790528/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787826970 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826945.171773:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787826945.171780:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00080000:0.0:1787826945.171786:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000008:00100000:2.0:1787826945.171787:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00080000:0.0:1787826945.171795:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826945.171801:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728f00 x1874670272791040/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787826945.171802:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272790528:192.168.203.121@tcp:250:kworker.0
00000100:00080000:2.0:1787826945.171817:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787826945.171820:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787826945.171822:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787826945.171826:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2108
00000100:00080000:2.0:1787826945.171829:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1787826945.171832:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272790656:192.168.203.121@tcp:38:kworker.0
00000100:00080000:2.0:1787826945.171836:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787826945.171842:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787826945.171853:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572bc00 x1874670272791168/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1787826945.171865:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:2.0:1787826945.171870:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787826945.171875:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787826945.171877:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787826945.171881:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2108
00000100:00100000:0.0:1787826945.171882:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826945/real 1787826945]  req@ffff9ee00572b840 x1874670272790656/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826970 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826945.171887:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787826945.171893:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787826945.171900:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787826945.171905:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b840 x1874670272790656/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826970 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826945.171913:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728000 x1874670272791296/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787826945.171916:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826945.171926:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826945.171933:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272790656:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787826945.171945:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272790784:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787826945.171967:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787826945.171978:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826945/real 1787826945]  req@ffff9ee00572a940 x1874670272790784/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826970 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826945.171990:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a940 x1874670272790784/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826970 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826945.171997:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826945.172000:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826945.172003:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272790784:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787826945.172009:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272790912:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787826945.172025:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787826945.172035:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826945/real 1787826945]  req@ffff9ee00572a1c0 x1874670272790912/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826970 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826945.172045:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a1c0 x1874670272790912/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826970 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826945.172053:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826945.172055:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826945.172059:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272790912:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787826945.172065:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272791040:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787826945.172082:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787826945.172092:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826945/real 1787826945]  req@ffff9ee005728f00 x1874670272791040/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826970 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826945.172103:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728f00 x1874670272791040/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826970 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826945.172110:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826945.172114:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826945.172117:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272791040:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787826945.172135:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272791168:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787826945.172152:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787826945.172161:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826945/real 1787826945]  req@ffff9ee00572bc00 x1874670272791168/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826970 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826945.172171:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572bc00 x1874670272791168/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826970 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826945.172179:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826945.172182:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826945.172185:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272791168:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787826945.172190:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272791296:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787826945.172207:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787826945.172217:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826945/real 1787826945]  req@ffff9ee005728000 x1874670272791296/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826970 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826945.172228:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728000 x1874670272791296/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826970 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826945.172235:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826945.172238:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826945.172241:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272791296:192.168.203.121@tcp:8:kworker.0
00010000:00010000:3.0:1787826946.003692:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787826946.195516:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787826947.027717:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787826947.219434:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787826948.051581:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787826948.243803:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787826949.075477:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787826949.267448:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787826950.099582:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1787826950.291446:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787826950.291456:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787826950.291461:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1787826950.291465:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787826950.291473:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2114
00000100:00080000:3.0:1787826950.291483:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787826950.291490:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787826950.291523:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705e00 x1874670272791424/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787826950.291563:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787826950.291567:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787826950.291568:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787826950.291577:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2114
00000100:00080000:3.0:1787826950.291583:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787826950.291588:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787826950.291597:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787826950.291608:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707840 x1874670272791552/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787826950.291617:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787826950.291620:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787826950.291622:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787826950.291626:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2114
00000100:00080000:3.0:1787826950.291629:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787826950.291633:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787826950.291637:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787826950.291647:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704780 x1874670272791680/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787826950.291655:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787826950.291658:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787826950.291659:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787826950.291662:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2114
00000100:00080000:3.0:1787826950.291665:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787826950.291668:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787826950.291673:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787826950.291681:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705a40 x1874670272791808/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787826950.291688:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787826950.291691:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787826950.291693:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787826950.291696:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2114
00000100:00080000:3.0:1787826950.291700:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787826950.291704:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787826950.291707:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787826950.291716:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057061c0 x1874670272791936/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787826950.291724:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787826950.291727:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787826950.291729:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787826950.291733:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2114
00000100:00080000:3.0:1787826950.291735:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787826950.291738:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787826950.291742:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787826950.291748:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707480 x1874670272792064/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787826950.291757:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787826950.291760:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787826950.291761:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787826950.291764:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2114
00000100:00080000:3.0:1787826950.291767:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787826950.291770:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787826950.291773:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787826950.291781:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704b40 x1874670272792192/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787826950.291921:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272791424:192.168.203.121@tcp:250:kworker.0
00000800:00000100:0.0:1787826950.291986:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787826950.292023:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826950/real 1787826950]  req@ffff9ee005705e00 x1874670272791424/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787826975 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826950.292039:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705e00 x1874670272791424/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787826975 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826950.292049:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826950.292053:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826950.292057:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272791424:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787826950.292077:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272791552:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787826950.292100:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787826950.292112:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826950/real 1787826950]  req@ffff9ee005707840 x1874670272791552/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826975 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826950.292123:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707840 x1874670272791552/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826975 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826950.292130:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826950.292134:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826950.292137:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272791552:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787826950.292143:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272791680:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787826950.292162:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787826950.292172:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826950/real 1787826950]  req@ffff9ee005704780 x1874670272791680/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826975 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826950.292197:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704780 x1874670272791680/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826975 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826950.292204:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826950.292207:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826950.292211:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272791680:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787826950.292225:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272791808:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787826950.292244:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787826950.292255:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826950/real 1787826950]  req@ffff9ee005705a40 x1874670272791808/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826975 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826950.292267:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705a40 x1874670272791808/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826975 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826950.292274:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826950.292277:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826950.292280:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272791808:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787826950.292286:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272791936:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787826950.292304:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787826950.292530:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826950/real 1787826950]  req@ffff9ee0057061c0 x1874670272791936/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826975 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826950.292557:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057061c0 x1874670272791936/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826975 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826950.292565:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826950.292568:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826950.292571:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272791936:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787826950.292576:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272792064:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787826950.292596:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787826950.292607:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826950/real 1787826950]  req@ffff9ee005707480 x1874670272792064/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826975 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826950.292617:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707480 x1874670272792064/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826975 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826950.292624:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826950.292627:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826950.292629:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272792064:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787826950.292635:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272792192:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787826950.292652:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787826950.292661:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826950/real 1787826950]  req@ffff9ee005704b40 x1874670272792192/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826975 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826950.292671:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704b40 x1874670272792192/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826975 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826950.292677:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826950.292680:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826950.292682:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272792192:192.168.203.121@tcp:8:kworker.0
00010000:00010000:3.0:1787826951.123521:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787826951.315436:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787826952.147514:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787826952.339784:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787826953.171555:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1787826954.195528:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1787826955.219561:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1787826955.412461:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787826955.412475:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787826955.412480:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787826955.412493:0:8:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2119
00000100:00080000:3.0:1787826955.412519:0:8:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787826955.412531:0:8:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787826955.412584:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704000 x1874670272792320/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787826955.412616:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787826955.412619:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787826955.412622:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787826955.412626:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2119
00000100:00080000:3.0:1787826955.412630:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787826955.412634:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787826955.412647:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787826955.412659:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706580 x1874670272792448/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787826955.412669:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1787826955.412675:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272792320:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787826955.412675:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787826955.412677:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787826955.412686:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2119
00000100:00080000:3.0:1787826955.412690:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787826955.412694:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787826955.412699:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787826955.412712:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705680 x1874670272792576/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787826955.412721:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787826955.412724:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787826955.412726:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787826955.412729:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2119
00000100:00080000:3.0:1787826955.412733:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787826955.412737:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787826955.412741:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787826955.412751:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706940 x1874670272792704/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787826955.412759:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787826955.412763:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787826955.412764:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:0.0:1787826955.412769:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787826955.412772:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2119
00000100:00080000:3.0:1787826955.412777:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787826955.412781:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787826955.412786:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787826955.412797:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707c00 x1874670272792832/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787826955.412816:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787826955.412819:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787826955.412821:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1787826955.412826:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826955/real 1787826955]  req@ffff9ee005704000 x1874670272792320/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787826980 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787826955.412829:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2119
00000100:00080000:3.0:1787826955.412836:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787826955.412842:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787826955.412847:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787826955.412851:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704000 x1874670272792320/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787826980 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826955.412867:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:3.0:1787826955.412870:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057052c0 x1874670272792960/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787826955.412875:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826955.412884:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272792320:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787826955.412887:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787826955.412894:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787826955.412896:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787826955.412901:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2119
00000100:00080000:3.0:1787826955.412905:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787826955.412911:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787826955.412915:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787826955.412925:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057043c0 x1874670272793088/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787826955.412982:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272792448:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787826955.413010:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787826955.413025:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826955/real 1787826955]  req@ffff9ee005706580 x1874670272792448/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826980 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826955.413048:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706580 x1874670272792448/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826980 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826955.413056:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826955.413060:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826955.413063:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272792448:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787826955.413069:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272792576:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787826955.413092:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787826955.413104:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826955/real 1787826955]  req@ffff9ee005705680 x1874670272792576/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826980 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826955.413115:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705680 x1874670272792576/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826980 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826955.413123:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826955.413125:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826955.413127:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272792576:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787826955.413132:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272792704:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787826955.413146:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787826955.413161:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826955/real 1787826955]  req@ffff9ee005706940 x1874670272792704/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826980 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826955.413173:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706940 x1874670272792704/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826980 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826955.413181:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826955.413184:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826955.413187:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272792704:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787826955.413192:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272792832:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787826955.413211:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787826955.413222:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826955/real 1787826955]  req@ffff9ee005707c00 x1874670272792832/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826980 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826955.413233:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707c00 x1874670272792832/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826980 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826955.413239:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826955.413241:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826955.413243:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272792832:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787826955.413247:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272792960:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787826955.413261:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787826955.413274:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826955/real 1787826955]  req@ffff9ee0057052c0 x1874670272792960/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826980 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826955.413289:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057052c0 x1874670272792960/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826980 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826955.413296:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826955.413300:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826955.413303:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272792960:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787826955.413309:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272793088:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787826955.413355:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787826955.413367:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826955/real 1787826955]  req@ffff9ee0057043c0 x1874670272793088/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826980 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826955.413383:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057043c0 x1874670272793088/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826980 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826955.413392:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826955.413396:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826955.413400:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272793088:192.168.203.121@tcp:8:kworker.0
00010000:00010000:3.0:1787826956.243465:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1787826957.267523:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1787826958.291546:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1787826959.315664:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1787826960.339651:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1787826960.531445:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787826960.531457:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787826960.531462:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787826960.531484:0:8:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2124
00000100:00080000:3.0:1787826960.531493:0:8:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787826960.531501:0:8:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787826960.531537:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057070c0 x1874670272793216/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787826960.531575:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787826960.531580:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787826960.531581:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787826960.531585:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2124
00000100:00080000:3.0:1787826960.531589:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787826960.531593:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787826960.531602:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787826960.531620:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272793216:192.168.203.121@tcp:250:kworker.0
00000100:00100000:3.0:1787826960.531627:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706d00 x1874670272793344/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787826960.531639:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787826960.531643:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787826960.531645:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787826960.531648:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2124
00000100:00080000:3.0:1787826960.531652:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787826960.531657:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787826960.531662:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787826960.531675:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057043c0 x1874670272793472/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787826960.531685:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787826960.531688:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787826960.531690:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787826960.531696:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2124
00000800:00000100:0.0:1787826960.531697:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787826960.531702:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787826960.531708:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787826960.531714:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787826960.531726:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057052c0 x1874670272793600/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787826960.531737:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1787826960.531741:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826960/real 1787826960]  req@ffff9ee0057070c0 x1874670272793216/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787826985 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787826960.531741:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787826960.531744:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787826960.531754:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2124
00000100:00100000:0.0:1787826960.531763:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057070c0 x1874670272793216/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787826985 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826960.531771:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787826960.531771:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787826960.531776:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:3.0:1787826960.531780:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787826960.531783:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272793216:192.168.203.121@tcp:250:kworker.0
00000008:00100000:3.0:1787826960.531790:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787826960.531804:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707c00 x1874670272793728/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787826960.531806:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272793344:192.168.203.121@tcp:38:kworker.0
00000100:00080000:3.0:1787826960.531823:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787826960.531827:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787826960.531829:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787826960.531833:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2124
00000800:00000100:0.0:1787826960.531838:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787826960.531839:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787826960.531845:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787826960.531850:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787826960.531856:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826960/real 1787826960]  req@ffff9ee005706d00 x1874670272793344/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826985 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787826960.531863:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706940 x1874670272793856/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787826960.531885:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706d00 x1874670272793344/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826985 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787826960.531892:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787826960.531900:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787826960.531904:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787826960.531905:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787826960.531911:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2124
00000100:00080000:0.0:1787826960.531912:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00080000:3.0:1787826960.531917:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1787826960.531919:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272793344:192.168.203.121@tcp:38:kworker.0
00000100:00080000:3.0:1787826960.531925:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787826960.531931:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272793472:192.168.203.121@tcp:8:kworker.0
00000008:00100000:3.0:1787826960.531932:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787826960.531949:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705680 x1874670272793984/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1787826960.531964:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787826960.531988:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826960/real 1787826960]  req@ffff9ee0057043c0 x1874670272793472/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826985 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826960.531997:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057043c0 x1874670272793472/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826985 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826960.532004:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826960.532007:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826960.532009:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272793472:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787826960.532024:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272793600:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787826960.532049:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787826960.532063:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826960/real 1787826960]  req@ffff9ee0057052c0 x1874670272793600/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826985 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826960.532073:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057052c0 x1874670272793600/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826985 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826960.532080:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826960.532083:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826960.532086:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272793600:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787826960.532103:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272793728:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787826960.532124:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787826960.532138:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826960/real 1787826960]  req@ffff9ee005707c00 x1874670272793728/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826985 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826960.532152:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707c00 x1874670272793728/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826985 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826960.532160:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826960.532163:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826960.532166:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272793728:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787826960.532172:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272793856:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787826960.532190:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787826960.532200:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826960/real 1787826960]  req@ffff9ee005706940 x1874670272793856/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826985 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826960.532211:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706940 x1874670272793856/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826985 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826960.532220:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826960.532222:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826960.532225:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272793856:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787826960.532231:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272793984:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787826960.532249:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787826960.532259:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826960/real 1787826960]  req@ffff9ee005705680 x1874670272793984/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826985 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826960.532269:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705680 x1874670272793984/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826985 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826960.532276:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826960.532279:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826960.532281:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272793984:192.168.203.121@tcp:8:kworker.0
00010000:00010000:3.0:1787826961.363526:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1787826962.387519:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1787826963.411536:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1787826964.435510:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1787826965.459549:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787826965.651853:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272794112:192.168.203.121@tcp:250:kworker.0
00000800:00000100:0.0:1787826965.651899:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787826965.651927:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826965/real 1787826965]  req@ffff9ee0056a0780 x1874670272794112/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787826990 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826965.651937:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0780 x1874670272794112/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787826990 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826965.651944:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826965.651947:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826965.651949:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272794112:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787826965.651953:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272794240:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787826965.651968:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787826965.651978:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826965/real 1787826965]  req@ffff9ee0056a0000 x1874670272794240/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826990 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826965.651988:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0000 x1874670272794240/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826990 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826965.651996:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826965.651999:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826965.652002:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272794240:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787826965.652018:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272794368:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787826965.652033:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787826965.652040:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826965/real 1787826965]  req@ffff9ee0056a1e00 x1874670272794368/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826990 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826965.652047:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1e00 x1874670272794368/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826990 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826965.652052:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826965.652054:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826965.652056:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272794368:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787826965.652059:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272794496:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787826965.652067:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787826965.652072:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826965/real 1787826965]  req@ffff9ee0056a03c0 x1874670272794496/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826990 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826965.652079:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a03c0 x1874670272794496/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826990 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826965.652083:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826965.652084:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826965.652086:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272794496:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787826965.652089:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272794624:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787826965.652097:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787826965.652102:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826965/real 1787826965]  req@ffff9ee0056a2580 x1874670272794624/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826990 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826965.652121:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a2580 x1874670272794624/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826990 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826965.652129:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826965.652132:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826965.652135:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272794624:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787826965.652141:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272794752:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787826965.652159:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787826965.652170:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826965/real 1787826965]  req@ffff9ee0056a3480 x1874670272794752/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826990 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826965.652181:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a3480 x1874670272794752/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826990 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826965.652188:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826965.652191:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826965.652194:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272794752:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787826965.652199:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272794880:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787826965.652218:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787826965.652228:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826965/real 1787826965]  req@ffff9ee0056a0b40 x1874670272794880/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826990 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826965.652239:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0b40 x1874670272794880/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826990 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826965.652246:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826965.652249:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826965.652252:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272794880:192.168.203.121@tcp:8:kworker.0
00010000:00010000:3.0:1787826966.483510:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1787826967.507513:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787826967.700801:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787826968.531517:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787826968.723441:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787826969.555500:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787826969.747449:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787826970.579534:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1787826970.771511:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787826970.771517:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1787826970.771521:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787826970.771530:0:8:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2134
00000100:00080000:0.0:1787826970.771540:0:8:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787826970.771545:0:8:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787826970.771574:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8780 x1874670272795008/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787826970.771600:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787826970.771603:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787826970.771605:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787826970.771608:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2134
00000100:00080000:0.0:1787826970.771612:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787826970.771617:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787826970.771631:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787826970.771638:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272795008:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787826970.771648:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8b40 x1874670272795136/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787826970.771659:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787826970.771663:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787826970.771665:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787826970.771669:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2134
00000100:00080000:0.0:1787826970.771673:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787826970.771677:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787826970.771683:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:2.0:1787826970.771693:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787826970.771697:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8000 x1874670272795264/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787826970.771705:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787826970.771708:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787826970.771709:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787826970.771712:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2134
00000100:00080000:0.0:1787826970.771714:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787826970.771717:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787826970.771721:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787826970.771728:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826970/real 1787826970]  req@ffff9ee0056e8780 x1874670272795008/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787826995 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826970.771731:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e83c0 x1874670272795392/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787826970.771746:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8780 x1874670272795008/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787826995 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826970.771759:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787826970.771761:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826970.771766:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787826970.771767:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:0.0:1787826970.771772:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1787826970.771773:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272795008:192.168.203.121@tcp:250:kworker.0
00000100:00080000:0.0:1787826970.771781:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2134
00000100:00080000:0.0:1787826970.771786:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787826970.771791:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787826970.771794:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272795136:192.168.203.121@tcp:38:kworker.0
00000008:00100000:0.0:1787826970.771798:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787826970.771814:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e92c0 x1874670272795520/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1787826970.771820:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:0.0:1787826970.771832:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787826970.771836:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00100000:2.0:1787826970.771839:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826970/real 1787826970]  req@ffff9ee0056e8b40 x1874670272795136/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826995 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826970.771840:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787826970.771848:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2134
00000100:00080000:0.0:1787826970.771855:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787826970.771861:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787826970.771865:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8b40 x1874670272795136/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826995 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:0.0:1787826970.771868:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787826970.771880:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9680 x1874670272795648/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787826970.771882:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826970.771889:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826970.771896:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272795136:192.168.203.121@tcp:38:kworker.0
00000100:00080000:0.0:1787826970.771901:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1787826970.771904:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272795264:192.168.203.121@tcp:8:kworker.0
00000100:00080000:0.0:1787826970.771911:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787826970.771914:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787826970.771918:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2134
00000100:00080000:0.0:1787826970.771921:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000800:00000100:2.0:1787826970.771925:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:0.0:1787826970.771927:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787826970.771933:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787826970.771946:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb840 x1874670272795776/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787826970.771946:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826970/real 1787826970]  req@ffff9ee0056e8000 x1874670272795264/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826995 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826970.771976:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8000 x1874670272795264/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826995 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826970.771984:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826970.771986:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826970.771989:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272795264:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787826970.771993:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272795392:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787826970.772006:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826970.772013:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826970/real 1787826970]  req@ffff9ee0056e83c0 x1874670272795392/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826995 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826970.772019:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e83c0 x1874670272795392/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826995 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826970.772024:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826970.772026:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826970.772028:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272795392:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787826970.772040:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272795520:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787826970.772056:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826970.772067:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826970/real 1787826970]  req@ffff9ee0056e92c0 x1874670272795520/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826995 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826970.772078:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e92c0 x1874670272795520/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787826995 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826970.772086:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826970.772089:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826970.772092:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272795520:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787826970.772096:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272795648:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787826970.772109:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826970.772116:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826970/real 1787826970]  req@ffff9ee0056e9680 x1874670272795648/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826995 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826970.772122:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9680 x1874670272795648/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826995 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826970.772127:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826970.772129:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826970.772130:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272795648:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787826970.772133:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272795776:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787826970.772141:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787826970.772146:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826970/real 1787826970]  req@ffff9ee0056eb840 x1874670272795776/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826995 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787826970.772152:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb840 x1874670272795776/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787826995 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787826970.772157:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787826970.772158:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787826970.772160:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272795776:192.168.203.121@tcp:8:kworker.0
00010000:00010000:3.0:1787826971.603419:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1787826972.627488:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1787826973.651482:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1787826974.675529:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1787826975.699505:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1787826975.891469:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787826975.891478:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787826975.891483:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787826975.891493:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2139
00000100:00080000:3.0:1787826975.891504:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787826975.891510:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787826975.891545:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706580 x1874670272795904/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787826975.891573:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787826975.891577:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787826975.891578:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787826975.891582:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2139
00000100:00080000:3.0:1787826975.891585:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787826975.891590:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787826975.891611:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787826975.891623:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704000 x1874670272796032/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787826975.891633:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787826975.891637:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787826975.891639:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787826975.891644:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2139
00000100:00080000:3.0:1787826975.891647:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787826975.891659:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787826975.891667:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787826975.891680:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00100000:3.0:1787826975.891680:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704b40 x1874670272796160/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787826975.891700:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787826975.891704:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787826975.891706:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787826975.891711:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2139
00000100:00080000:3.0:1787826975.891716:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1787826975.891717:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272795904:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787826975.891722:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787826975.891730:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787826975.891743:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707480 x1874670272796288/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787826975.891753:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787826975.891768:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787826975.891771:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787826975.891774:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2139
00000100:00080000:3.0:1787826975.891778:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000800:00000100:0.0:1787826975.891783:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787826975.891785:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787826975.891792:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787826975.891804:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057061c0 x1874670272796416/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787826975.891813:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787826975.891817:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787826975.891818:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787826975.891822:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2139
00000100:00080000:3.0:1787826975.891826:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1787826975.891831:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826975/real 1787826975]  req@ffff9ee005706580 x1874670272795904/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827000 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787826975.891833:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787826975.891838:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787826975.891847:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705a40 x1874670272796544/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787826975.891873:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787826975.891876:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787826975.891877:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787826975.891881:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2139
00000100:00080000:3.0:1787826975.891885:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1787826975.891890:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706580 x1874670272795904/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827000 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787826975.891890:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787826975.891898:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:0.0:1787826975.891908:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:3.0:1787826975.891914:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704780 x1874670272796672/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787826975.891917:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826975.891925:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272795904:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787826975.891937:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272796032:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787826975.891961:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787826975.891973:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826975/real 1787826975]  req@ffff9ee005704000 x1874670272796032/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827000 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826975.891985:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704000 x1874670272796032/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827000 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826975.891998:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826975.892001:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826975.892004:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272796032:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787826975.892010:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272796160:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787826975.892028:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787826975.892038:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826975/real 1787826975]  req@ffff9ee005704b40 x1874670272796160/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827000 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826975.892049:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704b40 x1874670272796160/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827000 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826975.892057:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826975.892060:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826975.892063:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272796160:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787826975.892086:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272796288:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787826975.892106:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787826975.892116:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826975/real 1787826975]  req@ffff9ee005707480 x1874670272796288/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827000 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826975.892128:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707480 x1874670272796288/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827000 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826975.892135:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826975.892138:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826975.892141:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272796288:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787826975.892147:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272796416:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787826975.892166:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787826975.892176:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826975/real 1787826975]  req@ffff9ee0057061c0 x1874670272796416/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827000 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826975.892187:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057061c0 x1874670272796416/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827000 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826975.892195:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826975.892198:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826975.892201:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272796416:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787826975.892207:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272796544:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787826975.892224:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787826975.892233:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826975/real 1787826975]  req@ffff9ee005705a40 x1874670272796544/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827000 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826975.892244:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705a40 x1874670272796544/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827000 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826975.892250:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826975.892254:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826975.892257:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272796544:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787826975.892262:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272796672:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787826975.892280:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787826975.892290:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826975/real 1787826975]  req@ffff9ee005704780 x1874670272796672/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827000 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826975.892302:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704780 x1874670272796672/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827000 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826975.892309:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826975.892311:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826975.892333:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272796672:192.168.203.121@tcp:8:kworker.0
00010000:00010000:3.0:1787826976.723507:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787826976.915471:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787826977.747523:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787826977.939454:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787826978.771510:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787826978.963473:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787826979.796396:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787826979.987491:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787826980.819517:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1787826981.011456:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787826981.011466:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787826981.011475:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1787826981.011488:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787826981.011489:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2144
00000100:00080000:3.0:1787826981.011515:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787826981.011525:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787826981.011568:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707840 x1874670272796800/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787826981.011603:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787826981.011608:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787826981.011610:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787826981.011614:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2144
00000100:00080000:3.0:1787826981.011628:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787826981.011633:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787826981.011642:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787826981.011654:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705e00 x1874670272796928/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787826981.011664:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787826981.011667:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787826981.011670:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787826981.011673:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2144
00000100:00080000:3.0:1787826981.011676:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787826981.011681:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787826981.011686:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787826981.011701:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272796800:192.168.203.121@tcp:250:kworker.0
00000100:00100000:3.0:1787826981.011702:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704780 x1874670272797056/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787826981.011718:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787826981.011721:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787826981.011723:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787826981.011726:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2144
00000100:00080000:3.0:1787826981.011729:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787826981.011732:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787826981.011737:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787826981.011750:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705a40 x1874670272797184/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787826981.011758:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787826981.011762:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787826981.011764:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787826981.011767:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2144
00000100:00080000:3.0:1787826981.011771:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000800:00000100:0.0:1787826981.011776:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787826981.011778:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787826981.011785:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787826981.011798:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057061c0 x1874670272797312/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787826981.011806:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787826981.011809:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787826981.011811:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787826981.011815:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2144
00000100:00080000:3.0:1787826981.011819:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787826981.011825:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787826981.011830:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826981/real 1787826981]  req@ffff9ee005707840 x1874670272796800/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827006 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:3.0:1787826981.011830:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787826981.011842:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707480 x1874670272797440/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787826981.011853:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787826981.011857:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:0.0:1787826981.011858:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707840 x1874670272796800/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827006 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787826981.011860:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787826981.011868:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2144
00000100:00080000:3.0:1787826981.011874:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787826981.011880:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00080000:0.0:1787826981.011881:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000008:00100000:3.0:1787826981.011886:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:0.0:1787826981.011888:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826981.011895:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272796800:192.168.203.121@tcp:250:kworker.0
00000100:00100000:3.0:1787826981.011901:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704b40 x1874670272797568/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787826981.011905:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272796928:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787826981.011938:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787826981.011953:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826981/real 1787826981]  req@ffff9ee005705e00 x1874670272796928/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827006 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826981.011966:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705e00 x1874670272796928/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827006 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826981.011974:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826981.011978:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826981.011982:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272796928:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787826981.012004:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272797056:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787826981.012026:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787826981.012037:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826981/real 1787826981]  req@ffff9ee005704780 x1874670272797056/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827006 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826981.012048:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704780 x1874670272797056/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827006 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826981.012056:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826981.012059:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826981.012062:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272797056:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787826981.012068:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272797184:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787826981.012086:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787826981.012095:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826981/real 1787826981]  req@ffff9ee005705a40 x1874670272797184/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827006 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826981.012102:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705a40 x1874670272797184/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827006 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826981.012107:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826981.012109:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826981.012111:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272797184:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787826981.012116:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272797312:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787826981.012133:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787826981.012143:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826981/real 1787826981]  req@ffff9ee0057061c0 x1874670272797312/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827006 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826981.012154:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057061c0 x1874670272797312/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827006 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826981.012162:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826981.012165:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826981.012168:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272797312:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787826981.012173:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272797440:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787826981.012204:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787826981.012216:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826981/real 1787826981]  req@ffff9ee005707480 x1874670272797440/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827006 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826981.012226:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707480 x1874670272797440/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827006 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826981.012231:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826981.012233:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826981.012235:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272797440:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787826981.012239:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272797568:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787826981.012256:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787826981.012266:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826981/real 1787826981]  req@ffff9ee005704b40 x1874670272797568/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827006 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826981.012277:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704b40 x1874670272797568/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827006 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826981.012285:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826981.012288:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826981.012291:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272797568:192.168.203.121@tcp:8:kworker.0
00010000:00010000:3.0:1787826981.843480:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787826982.035470:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787826982.867529:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787826983.059370:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787826983.891513:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787826984.083438:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787826984.915549:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787826985.107401:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787826985.939577:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1787826986.131467:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787826986.131482:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787826986.131489:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1787826986.131490:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787826986.131503:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2149
00000100:00080000:3.0:1787826986.131518:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787826986.131528:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787826986.131578:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704000 x1874670272797696/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787826986.131610:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787826986.131615:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787826986.131617:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787826986.131621:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2149
00000100:00080000:3.0:1787826986.131625:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787826986.131629:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787826986.131643:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787826986.131655:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706580 x1874670272797824/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787826986.131665:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272797696:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787826986.131667:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787826986.131676:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787826986.131678:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787826986.131682:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2149
00000100:00080000:3.0:1787826986.131685:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787826986.131689:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787826986.131694:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787826986.131706:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705680 x1874670272797952/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787826986.131716:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787826986.131720:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787826986.131722:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787826986.131725:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2149
00000100:00080000:3.0:1787826986.131729:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787826986.131732:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787826986.131736:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787826986.131746:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706940 x1874670272798080/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787826986.131755:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787826986.131758:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787826986.131760:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787826986.131764:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2149
00000100:00080000:3.0:1787826986.131768:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787826986.131772:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787826986.131776:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787826986.131788:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707c00 x1874670272798208/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787826986.131797:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787826986.131801:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787826986.131804:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1787826986.131806:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272797824:192.168.203.121@tcp:38:kworker.0
00000100:00080000:3.0:1787826986.131812:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2149
00000100:00080000:3.0:1787826986.131817:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787826986.131822:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787826986.131828:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787826986.131840:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057052c0 x1874670272798336/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787826986.131844:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272797952:192.168.203.121@tcp:8:kworker.0
00000100:00080000:3.0:1787826986.131858:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787826986.131862:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787826986.131863:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787826986.131868:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2149
00000100:00080000:3.0:1787826986.131873:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1787826986.131879:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272798080:192.168.203.121@tcp:8:kworker.0
00000100:00080000:3.0:1787826986.131879:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787826986.131888:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787826986.131903:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057043c0 x1874670272798464/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787826986.131911:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272798208:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787826986.131939:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272798336:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787826986.131960:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272798464:192.168.203.121@tcp:8:kworker.0
00010000:00010000:3.0:1787826986.963499:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787826987.155405:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787826987.987550:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787826988.179428:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787826989.011465:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787826989.203655:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00100000:0.0:1787826989.203909:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826986/real 1787826989]  req@ffff9ee0057052c0 x1874670272798336/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827011 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826989.203932:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057052c0 x1874670272798336/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827011 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826989.203941:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826989.203946:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826989.203950:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272798336:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787826989.203958:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826986/real 1787826989]  req@ffff9ee0057043c0 x1874670272798464/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827011 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826989.203969:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057043c0 x1874670272798464/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827011 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826989.203976:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826989.203979:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826989.203982:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272798464:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787826989.203988:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826986/real 1787826989]  req@ffff9ee005706580 x1874670272797824/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827011 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826989.204006:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706580 x1874670272797824/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827011 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826989.204014:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826989.204017:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826989.204020:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272797824:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787826989.204026:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826986/real 1787826989]  req@ffff9ee005705680 x1874670272797952/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827011 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826989.204036:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705680 x1874670272797952/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827011 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826989.204043:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826989.204047:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826989.204050:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272797952:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787826989.204060:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826986/real 1787826989]  req@ffff9ee005706940 x1874670272798080/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827011 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826989.204073:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706940 x1874670272798080/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827011 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826989.204080:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826989.204084:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826989.204087:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272798080:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787826989.204092:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826986/real 1787826989]  req@ffff9ee005707c00 x1874670272798208/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827011 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826989.204103:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707c00 x1874670272798208/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827011 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826989.204110:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826989.204113:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826989.204117:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272798208:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787826989.204123:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826986/real 1787826989]  req@ffff9ee005704000 x1874670272797696/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827011 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826989.204134:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704000 x1874670272797696/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827011 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826989.204141:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826989.204144:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826989.204147:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272797696:192.168.203.121@tcp:250:kworker.0
00010000:00010000:0.0:1787826990.035507:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787826990.227525:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787826991.060528:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1787826991.251423:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1787826991.251424:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:2.0:1787826991.251430:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787826991.251434:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787826991.251441:0:8:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2154
00000100:00080000:2.0:1787826991.251451:0:8:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787826991.251457:0:8:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787826991.251503:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b0c0 x1874670272798592/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787826991.251524:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787826991.251528:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787826991.251530:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787826991.251534:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2154
00000100:00080000:2.0:1787826991.251537:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787826991.251542:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787826991.251555:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787826991.251567:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b480 x1874670272798720/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787826991.251588:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787826991.251591:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787826991.251593:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787826991.251597:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2154
00000100:00080000:2.0:1787826991.251600:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787826991.251604:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787826991.251608:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787826991.251615:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572ad00 x1874670272798848/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787826991.251621:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787826991.251623:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787826991.251624:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787826991.251626:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2154
00000100:00080000:2.0:1787826991.251627:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787826991.251629:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787826991.251632:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787826991.251637:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729a40 x1874670272798976/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787826991.251642:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787826991.251644:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787826991.251645:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787826991.251646:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2154
00000100:00080000:2.0:1787826991.251648:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787826991.251650:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787826991.251652:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787826991.251656:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728b40 x1874670272799104/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787826991.251660:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787826991.251662:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787826991.251663:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787826991.251665:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2154
00000100:00080000:2.0:1787826991.251666:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787826991.251669:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787826991.251673:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787826991.251680:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a580 x1874670272799232/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787826991.251688:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787826991.251691:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787826991.251693:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787826991.251696:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2154
00000100:00080000:2.0:1787826991.251699:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787826991.251703:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787826991.251707:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787826991.251726:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728000 x1874670272799360/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787826991.251892:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272798592:192.168.203.121@tcp:250:kworker.0
00000800:00000100:0.0:1787826991.251950:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787826991.251985:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826991/real 1787826991]  req@ffff9ee00572b0c0 x1874670272798592/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827016 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826991.252000:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b0c0 x1874670272798592/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827016 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826991.252009:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826991.252013:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826991.252016:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272798592:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787826991.252023:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272798720:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787826991.252043:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787826991.252054:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826991/real 1787826991]  req@ffff9ee00572b480 x1874670272798720/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827016 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826991.252066:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b480 x1874670272798720/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827016 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826991.252073:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826991.252076:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826991.252079:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272798720:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787826991.252085:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272798848:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787826991.252105:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787826991.252116:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826991/real 1787826991]  req@ffff9ee00572ad00 x1874670272798848/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827016 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826991.252127:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572ad00 x1874670272798848/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827016 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826991.252134:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826991.252137:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826991.252139:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272798848:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787826991.252145:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272798976:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787826991.252162:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787826991.252171:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826991/real 1787826991]  req@ffff9ee005729a40 x1874670272798976/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827016 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826991.252181:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729a40 x1874670272798976/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827016 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826991.252188:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826991.252191:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826991.252193:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272798976:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787826991.252198:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272799104:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787826991.252216:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787826991.252226:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826991/real 1787826991]  req@ffff9ee005728b40 x1874670272799104/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827016 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826991.252242:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728b40 x1874670272799104/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827016 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826991.252249:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826991.252251:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826991.252268:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272799104:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787826991.252274:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272799232:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787826991.252292:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787826991.252302:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826991/real 1787826991]  req@ffff9ee00572a580 x1874670272799232/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827016 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826991.252313:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a580 x1874670272799232/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827016 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826991.252340:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826991.252343:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826991.252351:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272799232:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787826991.252357:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272799360:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787826991.252376:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787826991.252387:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826991/real 1787826991]  req@ffff9ee005728000 x1874670272799360/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827016 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826991.252398:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728000 x1874670272799360/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827016 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826991.252410:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826991.252412:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826991.252415:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272799360:192.168.203.121@tcp:8:kworker.0
00010000:00010000:3.0:1787826992.083510:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787826992.275429:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787826993.107531:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787826993.299430:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787826994.131706:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787826994.324052:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787826995.155498:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787826995.347431:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787826996.179504:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787826996.371428:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00100000:0.0:1787826996.371754:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272799488:192.168.203.121@tcp:250:kworker.0
00000800:00000100:0.0:1787826996.371904:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787826996.371969:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826996/real 1787826996]  req@ffff9ee0056a30c0 x1874670272799488/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827021 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826996.371989:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a30c0 x1874670272799488/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827021 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826996.372002:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826996.372007:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826996.372012:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272799488:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787826996.372020:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272799616:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787826996.372046:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787826996.372060:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826996/real 1787826996]  req@ffff9ee0056a0b40 x1874670272799616/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827021 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826996.372072:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0b40 x1874670272799616/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827021 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826996.372080:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826996.372084:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826996.372088:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272799616:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787826996.372095:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272799744:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787826996.372117:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787826996.372128:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826996/real 1787826996]  req@ffff9ee0056a3480 x1874670272799744/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827021 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826996.372140:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a3480 x1874670272799744/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827021 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826996.372147:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826996.372149:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826996.372152:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272799744:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787826996.372159:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272799872:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787826996.372176:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787826996.372187:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826996/real 1787826996]  req@ffff9ee0056a2580 x1874670272799872/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827021 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826996.372198:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a2580 x1874670272799872/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827021 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826996.372205:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826996.372209:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826996.372212:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272799872:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787826996.372218:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272800000:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787826996.372249:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787826996.372261:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826996/real 1787826996]  req@ffff9ee0056a03c0 x1874670272800000/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827021 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826996.372271:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a03c0 x1874670272800000/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827021 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826996.372279:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826996.372283:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826996.372286:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272800000:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787826996.372351:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272800128:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787826996.372375:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787826996.372387:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826996/real 1787826996]  req@ffff9ee0056a1e00 x1874670272800128/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827021 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826996.372400:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1e00 x1874670272800128/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827021 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826996.372407:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826996.372411:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826996.372414:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272800128:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787826996.372420:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272800256:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787826996.372438:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787826996.372450:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787826996/real 1787826996]  req@ffff9ee0056a0000 x1874670272800256/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827021 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787826996.372461:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0000 x1874670272800256/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827021 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787826996.372470:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787826996.372473:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787826996.372476:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272800256:192.168.203.121@tcp:8:kworker.0
00010000:00010000:3.0:1787826997.205883:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787826997.395462:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787826998.227494:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787826998.419564:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787826999.251539:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787826999.443467:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787827000.275618:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827000.467430:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827001.299942:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827001.491509:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:2.0:1787827001.491573:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827001.491580:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787827001.491583:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827001.491593:0:8:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2165
00000100:00080000:2.0:1787827001.491602:0:8:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827001.491609:0:8:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787827001.491642:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572bc00 x1874670272800384/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827001.491675:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827001.491679:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787827001.491680:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827001.491684:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2165
00000100:00080000:2.0:1787827001.491687:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827001.491691:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827001.491701:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787827001.491713:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728f00 x1874670272800512/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827001.491728:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827001.491730:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787827001.491732:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827001.491736:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2165
00000100:00080000:2.0:1787827001.491739:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827001.491742:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827001.491747:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787827001.491757:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a1c0 x1874670272800640/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827001.491765:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827001.491768:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787827001.491769:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827001.491772:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2165
00000100:00080000:2.0:1787827001.491775:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827001.491778:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827001.491782:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787827001.491790:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a940 x1874670272800768/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827001.491798:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827001.491801:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787827001.491803:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827001.491806:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2165
00000100:00080000:2.0:1787827001.491809:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827001.491812:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827001.491816:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787827001.491825:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b840 x1874670272800896/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827001.491833:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827001.491836:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787827001.491837:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827001.491841:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2165
00000100:00080000:2.0:1787827001.491843:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827001.491846:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827001.491850:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787827001.491858:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057283c0 x1874670272801024/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827001.491866:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827001.491869:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787827001.491871:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827001.491873:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2165
00000100:00080000:2.0:1787827001.491876:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827001.491879:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827001.491882:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787827001.491890:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729e00 x1874670272801152/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787827001.491977:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272800384:192.168.203.121@tcp:250:kworker.0
00000800:00000100:0.0:1787827001.492030:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827001.492065:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827001/real 1787827001]  req@ffff9ee00572bc00 x1874670272800384/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827026 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827001.492081:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572bc00 x1874670272800384/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827026 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827001.492091:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827001.492094:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827001.492098:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272800384:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787827001.492104:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272800512:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787827001.492125:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827001.492136:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827001/real 1787827001]  req@ffff9ee005728f00 x1874670272800512/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827026 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827001.492148:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728f00 x1874670272800512/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827026 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827001.492171:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827001.492175:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827001.492178:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272800512:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787827001.492197:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272800640:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787827001.492217:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827001.492228:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827001/real 1787827001]  req@ffff9ee00572a1c0 x1874670272800640/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827026 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827001.492239:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a1c0 x1874670272800640/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827026 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827001.492246:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827001.492249:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827001.492252:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272800640:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787827001.492258:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272800768:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787827001.492274:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827001.492284:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827001/real 1787827001]  req@ffff9ee00572a940 x1874670272800768/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827026 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827001.492294:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a940 x1874670272800768/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827026 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827001.492301:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827001.492304:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827001.492307:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272800768:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787827001.492312:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272800896:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787827001.492357:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827001.492369:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827001/real 1787827001]  req@ffff9ee00572b840 x1874670272800896/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827026 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827001.492380:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b840 x1874670272800896/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827026 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827001.492387:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827001.492390:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827001.492392:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272800896:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787827001.492398:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272801024:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787827001.492416:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827001.492426:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827001/real 1787827001]  req@ffff9ee0057283c0 x1874670272801024/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827026 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827001.492437:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057283c0 x1874670272801024/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827026 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827001.492443:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827001.492445:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827001.492448:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272801024:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787827001.492453:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272801152:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787827001.492471:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827001.492480:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827001/real 1787827001]  req@ffff9ee005729e00 x1874670272801152/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827026 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827001.492490:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729e00 x1874670272801152/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827026 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827001.492497:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827001.492499:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827001.492502:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272801152:192.168.203.121@tcp:8:kworker.0
00010000:00010000:3.0:1787827002.323498:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827002.515508:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827003.347562:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827003.539430:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827004.372526:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827004.563442:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787827005.395918:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827005.588295:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827006.419591:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827006.611543:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:2.0:1787827006.611649:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827006.611654:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787827006.611659:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827006.611667:0:8:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2170
00000100:00080000:2.0:1787827006.611677:0:8:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827006.611684:0:8:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787827006.611718:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728780 x1874670272801280/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827006.611750:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827006.611753:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787827006.611755:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827006.611758:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2170
00000100:00080000:2.0:1787827006.611762:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827006.611765:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827006.611774:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787827006.611785:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057292c0 x1874670272801408/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827006.611794:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827006.611796:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787827006.611798:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827006.611801:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2170
00000100:00080000:2.0:1787827006.611804:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827006.611808:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827006.611814:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787827006.611824:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729680 x1874670272801536/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827006.611832:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827006.611835:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787827006.611836:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827006.611839:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2170
00000100:00080000:2.0:1787827006.611842:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827006.611845:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827006.611849:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787827006.611858:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729e00 x1874670272801664/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827006.611866:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827006.611869:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787827006.611870:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827006.611874:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2170
00000100:00080000:2.0:1787827006.611877:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827006.611881:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827006.611884:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787827006.611894:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057283c0 x1874670272801792/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827006.611903:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827006.611906:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787827006.611908:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827006.611911:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2170
00000100:00080000:2.0:1787827006.611915:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827006.611918:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827006.611922:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787827006.611931:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b840 x1874670272801920/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827006.611940:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827006.611943:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787827006.611944:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827006.611947:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2170
00000100:00080000:2.0:1787827006.611950:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827006.611953:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827006.611956:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787827006.611965:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a940 x1874670272802048/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787827006.612078:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272801280:192.168.203.121@tcp:250:kworker.0
00000800:00000100:0.0:1787827006.612128:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827006.612176:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827006/real 1787827006]  req@ffff9ee005728780 x1874670272801280/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827031 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827006.612191:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728780 x1874670272801280/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827031 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827006.612200:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827006.612203:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827006.612207:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272801280:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787827006.612213:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057292c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272801408:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787827006.612232:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827006.612243:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827006/real 1787827006]  req@ffff9ee0057292c0 x1874670272801408/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827031 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827006.612253:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057292c0 x1874670272801408/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827031 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827006.612260:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827006.612263:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827006.612267:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057292c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272801408:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787827006.612272:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272801536:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787827006.612290:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827006.612301:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827006/real 1787827006]  req@ffff9ee005729680 x1874670272801536/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827031 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827006.612312:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729680 x1874670272801536/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827031 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827006.612342:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827006.612355:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827006.612358:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272801536:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787827006.612364:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272801664:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787827006.612382:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827006.612393:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827006/real 1787827006]  req@ffff9ee005729e00 x1874670272801664/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827031 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827006.612404:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729e00 x1874670272801664/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827031 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827006.612412:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827006.612414:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827006.612417:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272801664:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787827006.612422:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272801792:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787827006.612440:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827006.612451:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827006/real 1787827006]  req@ffff9ee0057283c0 x1874670272801792/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827031 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827006.612462:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057283c0 x1874670272801792/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827031 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827006.612469:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827006.612472:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827006.612474:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272801792:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787827006.612480:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272801920:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787827006.612497:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827006.612506:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827006/real 1787827006]  req@ffff9ee00572b840 x1874670272801920/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827031 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827006.612517:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b840 x1874670272801920/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827031 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827006.612523:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827006.612526:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827006.612529:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272801920:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787827006.612535:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272802048:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787827006.612551:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827006.612561:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827006/real 1787827006]  req@ffff9ee00572a940 x1874670272802048/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827031 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827006.612571:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a940 x1874670272802048/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827031 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827006.612578:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827006.612581:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827006.612584:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272802048:192.168.203.121@tcp:8:kworker.0
00010000:00010000:3.0:1787827007.443758:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827007.635408:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827008.467574:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827008.659430:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827009.491487:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827009.683527:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787827010.515509:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787827010.708426:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827011.539495:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787827011.731748:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:0.0:1787827011.732782:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827011.732788:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1787827011.732792:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827011.732810:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2175
00000100:00080000:0.0:1787827011.732820:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827011.732827:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787827011.732862:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8f00 x1874670272802176/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827011.732890:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827011.732897:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787827011.732899:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827011.732903:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2175
00000100:00080000:0.0:1787827011.732907:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827011.732912:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827011.732921:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787827011.732933:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272802176:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787827011.732935:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ebc00 x1874670272802304/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827011.732955:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827011.732958:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787827011.732960:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827011.732965:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2175
00000100:00080000:0.0:1787827011.732968:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827011.732972:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827011.732977:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787827011.732990:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb840 x1874670272802432/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1787827011.732999:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:0.0:1787827011.733002:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827011.733006:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787827011.733008:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827011.733013:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2175
00000100:00100000:2.0:1787827011.733040:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827011/real 1787827011]  req@ffff9ee0056e8f00 x1874670272802176/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827036 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827011.733057:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8f00 x1874670272802176/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827036 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827011.733067:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827011.733071:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827011.733074:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272802176:192.168.203.121@tcp:250:kworker.0
00000100:00100000:2.0:1787827011.733095:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272802304:192.168.203.121@tcp:38:kworker.0
00000100:00080000:0.0:1787827011.733147:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000800:00000100:2.0:1787827011.733154:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:0.0:1787827011.733163:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827011.733169:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787827011.733171:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827011/real 1787827011]  req@ffff9ee0056ebc00 x1874670272802304/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827036 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827011.733184:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9680 x1874670272802560/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827011.733198:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827011.733200:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787827011.733202:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827011.733206:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2175
00000100:00080000:0.0:1787827011.733210:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827011.733214:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827011.733218:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787827011.733228:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e92c0 x1874670272802688/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827011.733236:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827011.733239:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787827011.733241:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827011.733245:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2175
00000100:00080000:0.0:1787827011.733248:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827011.733251:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827011.733254:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787827011.733261:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e83c0 x1874670272802816/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827011.733269:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827011.733271:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787827011.733273:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827011.733275:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2175
00000100:00080000:0.0:1787827011.733278:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827011.733281:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827011.733284:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787827011.733290:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8000 x1874670272802944/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787827011.733892:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ebc00 x1874670272802304/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827036 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827011.733900:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827011.733903:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827011.733906:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272802304:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787827011.733913:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272802432:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787827011.733937:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827011.733949:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827011/real 1787827011]  req@ffff9ee0056eb840 x1874670272802432/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827036 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827011.733959:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb840 x1874670272802432/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827036 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827011.733965:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827011.733968:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827011.733971:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272802432:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787827011.733983:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272802560:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787827011.733999:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827011.734007:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827011/real 1787827011]  req@ffff9ee0056e9680 x1874670272802560/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827036 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827011.734017:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9680 x1874670272802560/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827036 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827011.734024:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827011.734027:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827011.734030:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272802560:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787827011.734035:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272802688:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787827011.734050:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827011.734060:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827011/real 1787827011]  req@ffff9ee0056e92c0 x1874670272802688/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827036 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827011.734070:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e92c0 x1874670272802688/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827036 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827011.734078:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827011.734081:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827011.734083:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272802688:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787827011.734089:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272802816:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787827011.734105:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827011.734127:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827011/real 1787827011]  req@ffff9ee0056e83c0 x1874670272802816/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827036 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827011.734144:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e83c0 x1874670272802816/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827036 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827011.734150:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827011.734153:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827011.734156:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272802816:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787827011.734162:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272802944:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787827011.734193:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827011.734204:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827011/real 1787827011]  req@ffff9ee0056e8000 x1874670272802944/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827036 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827011.734215:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8000 x1874670272802944/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827036 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827011.734221:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827011.734224:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827011.734226:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272802944:192.168.203.121@tcp:8:kworker.0
00010000:00010000:3.0:1787827012.563493:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787827012.755437:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827013.587533:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787827013.779421:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827014.611498:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787827014.803510:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787827015.635490:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787827015.827425:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827016.659530:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787827016.851619:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787827016.851673:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827016.851679:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787827016.851684:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827016.851693:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2180
00000100:00080000:3.0:1787827016.851703:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827016.851709:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787827016.851744:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706d00 x1874670272803072/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827016.851770:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827016.851773:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787827016.851775:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827016.851779:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2180
00000100:00080000:3.0:1787827016.851783:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827016.851786:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827016.851795:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787827016.851807:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057070c0 x1874670272803200/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787827016.851818:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272803072:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787827016.851818:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827016.851826:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787827016.851829:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827016.851834:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2180
00000100:00080000:3.0:1787827016.851837:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827016.851841:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827016.851846:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827016.851860:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704000 x1874670272803328/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827016.851868:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827016.851872:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787827016.851873:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827016.851876:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2180
00000100:00080000:3.0:1787827016.851880:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827016.851883:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827016.851887:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:2.0:1787827016.851893:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827016.851901:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707c00 x1874670272803456/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827016.851912:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827016.851915:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787827016.851916:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827016.851925:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2180
00000100:00080000:3.0:1787827016.851929:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827016.851933:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827016.851938:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787827016.851942:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827016/real 1787827016]  req@ffff9ee005706d00 x1874670272803072/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827041 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827016.851951:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706940 x1874670272803584/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787827016.851963:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706d00 x1874670272803072/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827041 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827016.851963:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827016.851971:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787827016.851976:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827016.851985:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2180
00000100:00080000:3.0:1787827016.851992:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827016.851996:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827016.852001:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:2.0:1787827016.852002:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827016.852008:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827016.852013:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272803072:192.168.203.121@tcp:250:kworker.0
00000100:00100000:3.0:1787827016.852015:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705680 x1874670272803712/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827016.852025:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827016.852028:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787827016.852030:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827016.852033:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2180
00000100:00080000:3.0:1787827016.852037:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1787827016.852038:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272803200:192.168.203.121@tcp:38:kworker.0
00000100:00080000:3.0:1787827016.852044:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827016.852050:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827016.852061:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706580 x1874670272803840/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1787827016.852072:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827016.852099:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827016/real 1787827016]  req@ffff9ee0057070c0 x1874670272803200/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827041 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827016.852111:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057070c0 x1874670272803200/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827041 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827016.852118:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827016.852131:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827016.852137:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272803200:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787827016.852142:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272803328:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787827016.852160:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827016.852170:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827016/real 1787827016]  req@ffff9ee005704000 x1874670272803328/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827041 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827016.852181:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704000 x1874670272803328/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827041 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827016.852188:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827016.852191:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827016.852193:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272803328:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787827016.852199:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272803456:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787827016.852214:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827016.852223:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827016/real 1787827016]  req@ffff9ee005707c00 x1874670272803456/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827041 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827016.852232:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707c00 x1874670272803456/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827041 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827016.852245:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827016.852248:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827016.852251:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272803456:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787827016.852256:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272803584:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787827016.852271:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827016.852280:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827016/real 1787827016]  req@ffff9ee005706940 x1874670272803584/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827041 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827016.852290:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706940 x1874670272803584/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827041 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827016.852296:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827016.852300:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827016.852302:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272803584:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787827016.852308:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272803712:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787827016.852348:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827016.852358:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827016/real 1787827016]  req@ffff9ee005705680 x1874670272803712/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827041 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827016.852368:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705680 x1874670272803712/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827041 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827016.852374:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827016.852377:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827016.852380:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272803712:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787827016.852395:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272803840:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787827016.852411:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827016.852419:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827016/real 1787827016]  req@ffff9ee005706580 x1874670272803840/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827041 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827016.852428:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706580 x1874670272803840/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827041 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827016.852434:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827016.852436:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827016.852439:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272803840:192.168.203.121@tcp:8:kworker.0
00010000:00010000:3.0:1787827017.683603:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827017.875459:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827018.707527:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827018.899470:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827019.732137:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787827019.924375:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787827020.756534:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787827020.947504:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827021.779583:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1787827021.971427:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1787827021.971433:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787827021.971438:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787827021.971443:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827021.971452:0:8:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2185
00000100:00080000:3.0:1787827021.971464:0:8:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827021.971472:0:8:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787827021.971508:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057043c0 x1874670272803968/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827021.971538:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827021.971542:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787827021.971543:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827021.971547:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2185
00000100:00080000:3.0:1787827021.971551:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827021.971555:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827021.971564:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787827021.971576:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057052c0 x1874670272804096/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827021.971584:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827021.971586:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787827021.971588:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827021.971591:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2185
00000100:00080000:3.0:1787827021.971594:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827021.971597:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827021.971602:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827021.971609:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704b40 x1874670272804224/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827021.971617:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827021.971621:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787827021.971622:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827021.971625:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2185
00000100:00080000:3.0:1787827021.971628:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827021.971631:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827021.971635:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827021.971643:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707480 x1874670272804352/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827021.971651:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827021.971654:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787827021.971656:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827021.971659:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2185
00000100:00080000:3.0:1787827021.971662:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827021.971666:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827021.971669:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787827021.971679:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057061c0 x1874670272804480/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827021.971686:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827021.971705:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00100000:2.0:1787827021.971870:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272803968:192.168.203.121@tcp:250:kworker.0
00000800:00000100:2.0:1787827021.971929:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827021.971973:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827021/real 1787827021]  req@ffff9ee0057043c0 x1874670272803968/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827046 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827021.971984:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057043c0 x1874670272803968/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827046 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827021.971994:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827021.971997:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827021.971999:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272803968:192.168.203.121@tcp:250:kworker.0
00000100:00100000:2.0:1787827021.972004:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272804096:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787827021.972019:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827021.972026:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827021/real 1787827021]  req@ffff9ee0057052c0 x1874670272804096/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827046 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827021.972033:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057052c0 x1874670272804096/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827046 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827021.972037:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827021.972039:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827021.972055:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272804096:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787827021.972061:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272804224:192.168.203.121@tcp:8:kworker.0
00000100:00080000:3.0:1787827021.972070:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827021.972075:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2185
00000100:00080000:3.0:1787827021.972079:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000800:00000100:2.0:1787827021.972081:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787827021.972083:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787827021.972092:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827021/real 1787827021]  req@ffff9ee005704b40 x1874670272804224/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827046 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:3.0:1787827021.972095:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787827021.972103:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704b40 x1874670272804224/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827046 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827021.972107:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705a40 x1874670272804608/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827021.972111:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827021.972113:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827021.972116:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272804224:192.168.203.121@tcp:8:kworker.0
00000100:00080000:3.0:1787827021.972117:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827021.972120:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:2.0:1787827021.972122:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272804352:192.168.203.121@tcp:8:kworker.0
00000100:00080000:3.0:1787827021.972122:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827021.972125:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2185
00000100:00080000:3.0:1787827021.972128:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827021.972136:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000800:00000100:2.0:1787827021.972139:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000008:00100000:3.0:1787827021.972141:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787827021.972148:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827021/real 1787827021]  req@ffff9ee005707480 x1874670272804352/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827046 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827021.972149:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704780 x1874670272804736/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787827021.972160:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707480 x1874670272804352/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827046 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827021.972167:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827021.972170:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827021.972173:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272804352:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787827021.972178:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272804480:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787827021.972196:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827021.972206:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827021/real 1787827021]  req@ffff9ee0057061c0 x1874670272804480/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827046 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827021.972216:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057061c0 x1874670272804480/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827046 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827021.972223:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827021.972225:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827021.972228:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272804480:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787827021.972251:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272804608:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787827021.972268:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827021.972279:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827021/real 1787827021]  req@ffff9ee005705a40 x1874670272804608/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827046 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827021.972292:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705a40 x1874670272804608/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827046 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827021.972300:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827021.972302:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827021.972305:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272804608:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787827021.972311:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272804736:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787827021.972355:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827021.972369:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827021/real 1787827021]  req@ffff9ee005704780 x1874670272804736/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827046 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827021.972379:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704780 x1874670272804736/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827046 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827021.972386:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827021.972389:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827021.972392:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272804736:192.168.203.121@tcp:8:kworker.0
00010000:00010000:3.0:1787827022.803510:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787827022.997529:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827023.827951:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787827024.019390:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827024.851950:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787827025.043494:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787827025.876076:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787827026.067431:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827026.899498:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787827027.091450:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00100000:2.0:1787827027.091596:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272804864:192.168.203.121@tcp:250:kworker.0
00000800:00000100:2.0:1787827027.091658:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827027.091707:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827027/real 1787827027]  req@ffff9ee0056a0780 x1874670272804864/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827052 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827027.091740:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0780 x1874670272804864/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827052 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827027.091763:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827027.091770:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827027.091778:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272804864:192.168.203.121@tcp:250:kworker.0
00000100:00100000:2.0:1787827027.091808:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272804992:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787827027.091838:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827027.091859:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827027/real 1787827027]  req@ffff9ee0056a12c0 x1874670272804992/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827052 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827027.091882:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a12c0 x1874670272804992/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827052 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827027.091893:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827027.091896:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827027.091898:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272804992:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787827027.091902:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272805120:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787827027.091918:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827027.091925:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827027/real 1787827027]  req@ffff9ee0056a1a40 x1874670272805120/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827052 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827027.091932:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1a40 x1874670272805120/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827052 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827027.091936:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827027.091938:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827027.091940:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272805120:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787827027.091943:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272805248:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787827027.091952:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827027.091957:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827027/real 1787827027]  req@ffff9ee0056a3c00 x1874670272805248/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827052 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827027.091963:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a3c00 x1874670272805248/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827052 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827027.091967:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827027.091969:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827027.091970:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272805248:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787827027.091973:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272805376:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787827027.091981:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827027.091986:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827027/real 1787827027]  req@ffff9ee0056a2940 x1874670272805376/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827052 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827027.091992:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a2940 x1874670272805376/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827052 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827027.091996:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827027.091998:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827027.091999:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272805376:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787827027.092026:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272805504:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787827027.092038:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827027.092045:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827027/real 1787827027]  req@ffff9ee0056a1680 x1874670272805504/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827052 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827027.092052:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1680 x1874670272805504/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827052 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827027.092057:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827027.092058:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827027.092060:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272805504:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787827027.092063:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272805632:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787827027.092071:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827027.092075:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827027/real 1787827027]  req@ffff9ee0056a0f00 x1874670272805632/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827052 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827027.092082:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0f00 x1874670272805632/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827052 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827027.092086:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827027.092087:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827027.092089:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272805632:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827027.923563:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827028.115511:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827028.947554:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827029.139435:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827029.971503:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827030.163421:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787827030.995675:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827031.187468:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827032.019472:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1787827032.212547:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827032.212557:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787827032.212562:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827032.212574:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2195
00000100:00100000:0.0:1787827032.212576:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787827032.212584:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827032.212593:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787827032.212635:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705e00 x1874670272805760/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827032.212668:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827032.212672:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787827032.212674:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827032.212677:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2195
00000100:00080000:3.0:1787827032.212681:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827032.212685:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827032.212693:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787827032.212704:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707840 x1874670272805888/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827032.212714:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827032.212717:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787827032.212718:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827032.212722:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2195
00000100:00080000:3.0:1787827032.212725:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827032.212729:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827032.212733:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827032.212744:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704780 x1874670272806016/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827032.212758:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827032.212761:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787827032.212762:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827032.212765:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2195
00000100:00080000:3.0:1787827032.212768:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827032.212771:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827032.212775:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827032.212782:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705a40 x1874670272806144/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827032.212790:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827032.212792:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787827032.212794:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827032.212797:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2195
00000100:00080000:3.0:1787827032.212800:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827032.212803:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827032.212807:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787827032.212816:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057061c0 x1874670272806272/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827032.212824:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827032.212827:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787827032.212829:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827032.212832:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2195
00000100:00080000:3.0:1787827032.212836:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827032.212839:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827032.212843:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827032.212851:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707480 x1874670272806400/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827032.212858:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827032.212861:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787827032.212862:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827032.212866:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2195
00000100:00080000:3.0:1787827032.212868:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827032.212871:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827032.212875:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827032.212884:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704b40 x1874670272806528/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787827032.213651:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272805760:192.168.203.121@tcp:250:kworker.0
00000800:00000100:2.0:1787827032.213715:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827032.213751:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827032/real 1787827032]  req@ffff9ee005705e00 x1874670272805760/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827057 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827032.213769:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705e00 x1874670272805760/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827057 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827032.213781:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827032.213785:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827032.213790:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272805760:192.168.203.121@tcp:250:kworker.0
00000100:00100000:2.0:1787827032.213797:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272805888:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787827032.213819:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827032.213831:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827032/real 1787827032]  req@ffff9ee005707840 x1874670272805888/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827057 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827032.213843:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707840 x1874670272805888/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827057 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827032.213850:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827032.213853:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827032.213857:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272805888:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787827032.213863:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272806016:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787827032.213883:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827032.213894:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827032/real 1787827032]  req@ffff9ee005704780 x1874670272806016/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827057 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827032.213906:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704780 x1874670272806016/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827057 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827032.213913:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827032.213916:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827032.213919:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272806016:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787827032.213926:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272806144:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787827032.213944:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827032.213954:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827032/real 1787827032]  req@ffff9ee005705a40 x1874670272806144/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827057 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827032.213966:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705a40 x1874670272806144/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827057 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827032.213987:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827032.213991:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827032.213994:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272806144:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787827032.214000:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272806272:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787827032.214020:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827032.214031:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827032/real 1787827032]  req@ffff9ee0057061c0 x1874670272806272/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827057 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827032.214042:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057061c0 x1874670272806272/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827057 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827032.214049:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827032.214052:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827032.214055:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272806272:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787827032.214062:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272806400:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787827032.214081:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827032.214092:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827032/real 1787827032]  req@ffff9ee005707480 x1874670272806400/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827057 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827032.214104:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707480 x1874670272806400/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827057 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827032.214110:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827032.214113:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827032.214116:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272806400:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787827032.214121:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272806528:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787827032.214140:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827032.214150:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827032/real 1787827032]  req@ffff9ee005704b40 x1874670272806528/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827057 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827032.214161:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704b40 x1874670272806528/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827057 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827032.214169:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827032.214172:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827032.214175:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272806528:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827033.043721:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787827033.235952:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827034.067558:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787827034.259425:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827035.091504:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787827035.283431:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787827036.115510:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787827036.307429:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827037.139487:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787827037.331419:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:2.0:1787827037.331431:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827037.331438:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787827037.331442:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827037.331450:0:8:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2201
00000100:00080000:2.0:1787827037.331459:0:8:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827037.331464:0:8:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787827037.331494:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a1c0 x1874670272806656/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827037.331533:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827037.331536:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787827037.331537:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827037.331540:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2201
00000100:00080000:2.0:1787827037.331542:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827037.331545:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827037.331553:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787827037.331563:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728f00 x1874670272806784/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827037.331569:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827037.331572:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787827037.331573:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827037.331575:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2201
00000100:00080000:2.0:1787827037.331577:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827037.331581:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787827037.331582:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272806656:192.168.203.121@tcp:250:kworker.0
00000008:00100000:2.0:1787827037.331584:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787827037.331594:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572bc00 x1874670272806912/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827037.331599:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827037.331601:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787827037.331603:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827037.331605:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2201
00000100:00080000:2.0:1787827037.331607:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827037.331610:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827037.331615:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787827037.331625:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728000 x1874670272807040/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827037.331633:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827037.331637:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787827037.331638:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827037.331642:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2201
00000100:00080000:2.0:1787827037.331646:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827037.331650:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000800:00000100:0.0:1787827037.331656:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000008:00100000:2.0:1787827037.331657:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787827037.331670:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a580 x1874670272807168/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827037.331677:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827037.331680:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787827037.331682:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827037.331685:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2201
00000100:00080000:2.0:1787827037.331689:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827037.331693:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787827037.331698:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827037/real 1787827037]  req@ffff9ee00572a1c0 x1874670272806656/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827062 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:2.0:1787827037.331700:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787827037.331717:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728b40 x1874670272807296/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787827037.331722:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a1c0 x1874670272806656/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827062 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827037.331735:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827037.331740:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787827037.331742:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827037.331744:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827037.331746:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2201
00000100:00080000:2.0:1787827037.331750:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827037.331752:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:2.0:1787827037.331755:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827037.331760:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787827037.331761:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272806656:192.168.203.121@tcp:250:kworker.0
00000100:00100000:2.0:1787827037.331770:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729a40 x1874670272807424/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787827037.331774:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272806784:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787827037.331803:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827037.331815:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827037/real 1787827037]  req@ffff9ee005728f00 x1874670272806784/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827062 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827037.331826:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728f00 x1874670272806784/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827062 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827037.331833:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827037.331836:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827037.331840:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272806784:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787827037.331862:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272806912:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787827037.331881:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827037.331892:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827037/real 1787827037]  req@ffff9ee00572bc00 x1874670272806912/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827062 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827037.331903:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572bc00 x1874670272806912/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827062 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827037.331911:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827037.331915:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827037.331918:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272806912:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787827037.331924:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272807040:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787827037.331955:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827037.331966:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827037/real 1787827037]  req@ffff9ee005728000 x1874670272807040/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827062 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827037.331978:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728000 x1874670272807040/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827062 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827037.331985:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827037.331988:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827037.331991:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272807040:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787827037.331997:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272807168:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787827037.332013:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827037.332022:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827037/real 1787827037]  req@ffff9ee00572a580 x1874670272807168/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827062 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827037.332033:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a580 x1874670272807168/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827062 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827037.332041:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827037.332044:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827037.332046:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272807168:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787827037.332052:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272807296:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787827037.332068:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827037.332086:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827037/real 1787827037]  req@ffff9ee005728b40 x1874670272807296/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827062 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827037.332097:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728b40 x1874670272807296/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827062 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827037.332105:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827037.332108:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827037.332111:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272807296:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787827037.332116:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272807424:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787827037.332132:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827037.332142:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827037/real 1787827037]  req@ffff9ee005729a40 x1874670272807424/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827062 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827037.332165:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729a40 x1874670272807424/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827062 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827037.332172:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827037.332175:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827037.332178:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272807424:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827038.163442:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827038.355472:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827039.187494:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827039.379446:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827040.211521:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827040.403447:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787827041.235531:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827041.427511:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827042.259491:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827042.451472:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:2.0:1787827042.451484:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827042.451495:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787827042.451499:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827042.451509:0:8:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2206
00000100:00080000:2.0:1787827042.451520:0:8:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827042.451528:0:8:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787827042.451562:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572ad00 x1874670272807552/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827042.451590:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827042.451594:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787827042.451596:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827042.451600:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2206
00000100:00080000:2.0:1787827042.451603:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827042.451608:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827042.451617:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787827042.451630:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b480 x1874670272807680/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827042.451642:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827042.451645:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787827042.451647:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1787827042.451656:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272807552:192.168.203.121@tcp:250:kworker.0
00000100:00080000:2.0:1787827042.451656:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2206
00000100:00080000:2.0:1787827042.451669:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827042.451675:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827042.451680:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787827042.451694:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b0c0 x1874670272807808/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827042.451704:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827042.451708:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787827042.451710:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827042.451713:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2206
00000100:00080000:2.0:1787827042.451716:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827042.451722:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827042.451726:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787827042.451738:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729a40 x1874670272807936/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827042.451747:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827042.451751:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787827042.451752:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827042.451757:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2206
00000100:00080000:2.0:1787827042.451761:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000800:00000100:0.0:1787827042.451767:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:2.0:1787827042.451773:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827042.451780:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787827042.451793:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728b40 x1874670272808064/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827042.451802:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827042.451805:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787827042.451807:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827042.451812:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2206
00000100:00080000:2.0:1787827042.451816:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827042.451821:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787827042.451826:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827042/real 1787827042]  req@ffff9ee00572ad00 x1874670272807552/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827067 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:2.0:1787827042.451829:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787827042.451850:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a580 x1874670272808192/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787827042.451858:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572ad00 x1874670272807552/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827067 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827042.451873:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827042.451879:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787827042.451882:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827042.451883:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827042.451894:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:2.0:1787827042.451895:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2206
00000100:00080000:2.0:1787827042.451916:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1787827042.451919:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272807552:192.168.203.121@tcp:250:kworker.0
00000100:00080000:2.0:1787827042.451925:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827042.451933:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787827042.451946:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728000 x1874670272808320/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787827042.451960:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272807680:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787827042.451991:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827042.452004:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827042/real 1787827042]  req@ffff9ee00572b480 x1874670272807680/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827067 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827042.452016:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b480 x1874670272807680/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827067 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827042.452022:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827042.452024:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827042.452026:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272807680:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787827042.452031:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272807808:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787827042.452046:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827042.452053:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827042/real 1787827042]  req@ffff9ee00572b0c0 x1874670272807808/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827067 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827042.452059:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b0c0 x1874670272807808/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827067 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827042.452064:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827042.452066:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827042.452068:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272807808:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787827042.452073:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272807936:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787827042.452082:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827042.452087:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827042/real 1787827042]  req@ffff9ee005729a40 x1874670272807936/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827067 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827042.452093:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729a40 x1874670272807936/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827067 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827042.452098:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827042.452099:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827042.452101:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272807936:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787827042.452104:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272808064:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787827042.452113:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827042.452118:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827042/real 1787827042]  req@ffff9ee005728b40 x1874670272808064/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827067 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827042.452123:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728b40 x1874670272808064/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827067 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827042.452127:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827042.452129:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827042.452130:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272808064:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787827042.452134:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272808192:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787827042.452142:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827042.452147:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827042/real 1787827042]  req@ffff9ee00572a580 x1874670272808192/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827067 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827042.452154:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a580 x1874670272808192/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827067 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827042.452158:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827042.452160:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827042.452161:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272808192:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787827042.452174:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272808320:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787827042.452183:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827042.452189:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827042/real 1787827042]  req@ffff9ee005728000 x1874670272808320/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827067 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827042.452194:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728000 x1874670272808320/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827067 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827042.452199:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827042.452201:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827042.452203:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272808320:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827043.283479:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827043.475427:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827044.307497:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827044.499481:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827045.331474:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827045.523428:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787827046.355495:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827046.547438:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827047.379593:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827047.571465:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00100000:0.0:1787827047.571645:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272808448:192.168.203.121@tcp:250:kworker.0
00000800:00000100:0.0:1787827047.571753:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827047.571801:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827047/real 1787827047]  req@ffff9ee0056a21c0 x1874670272808448/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827072 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827047.571831:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a21c0 x1874670272808448/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827072 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827047.571896:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827047.571906:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827047.571922:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272808448:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787827047.571967:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272808576:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787827047.571997:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827047.572008:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827047/real 1787827047]  req@ffff9ee0056a0f00 x1874670272808576/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827072 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827047.572016:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0f00 x1874670272808576/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827072 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827047.572022:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827047.572024:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827047.572026:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272808576:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787827047.572030:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272808704:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787827047.572053:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827047.572064:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827047/real 1787827047]  req@ffff9ee0056a1680 x1874670272808704/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827072 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827047.572076:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1680 x1874670272808704/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827072 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827047.572084:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827047.572087:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827047.572090:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272808704:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787827047.572094:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272808832:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787827047.572111:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827047.572120:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827047/real 1787827047]  req@ffff9ee0056a2940 x1874670272808832/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827072 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827047.572131:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a2940 x1874670272808832/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827072 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827047.572139:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827047.572142:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827047.572145:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272808832:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787827047.572152:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272808960:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787827047.572170:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827047.572181:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827047/real 1787827047]  req@ffff9ee0056a3c00 x1874670272808960/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827072 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827047.572192:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a3c00 x1874670272808960/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827072 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827047.572199:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827047.572202:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827047.572205:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272808960:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787827047.572211:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272809088:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787827047.572238:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827047.572249:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827047/real 1787827047]  req@ffff9ee0056a1a40 x1874670272809088/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827072 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827047.572261:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1a40 x1874670272809088/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827072 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827047.572269:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827047.572272:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827047.572275:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272809088:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787827047.572281:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272809216:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787827047.572297:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827047.572311:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827047/real 1787827047]  req@ffff9ee0056a12c0 x1874670272809216/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827072 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827047.572354:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a12c0 x1874670272809216/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827072 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827047.572366:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827047.572370:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827047.572373:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272809216:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827048.403487:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827048.595428:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827049.427504:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827049.619435:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827050.451710:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827050.643995:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787827051.475670:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827051.667418:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827052.499568:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827052.691430:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00100000:0.0:1787827052.691598:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272809344:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787827052.691870:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272809472:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787827052.692072:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272809600:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787827052.692112:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272809728:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787827052.692479:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272809856:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787827052.692965:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272809984:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787827052.692994:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272810112:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827053.523495:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827053.715427:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827054.547555:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827054.739434:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827055.571520:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000400:00000100:2.0:1787827055.763639:0:2353:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.203.121:988
00000400:00000100:2.0:1787827055.763679:0:2353:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.203.121@tcp at host 192.168.203.121 was unreachable: the network or that node may be down, or Lustre may be misconfigured.
00000800:00000100:2.0:1787827055.763696:0:2353:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:2.0:1787827055.763735:0:2353:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:2.0:1787827055.763744:0:2353:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:2.0:1787827055.763751:0:2353:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:2.0:1787827055.763758:0:2353:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:2.0:1787827055.763765:0:2353:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:2.0:1787827055.763772:0:2353:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000100:00100000:0.0:1787827055.763863:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827052/real 1787827055]  req@ffff9ee0056a3480 x1874670272809984/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827077 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827055.763869:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00100000:0.0:1787827055.763886:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a3480 x1874670272809984/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827077 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827055.763899:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827055.763904:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827055.763908:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272809984:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787827055.763914:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827052/real 1787827055]  req@ffff9ee0056a0b40 x1874670272810112/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827077 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827055.763925:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0b40 x1874670272810112/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827077 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827055.763932:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827055.763935:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827055.763938:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272810112:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787827055.763945:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827052/real 1787827055]  req@ffff9ee0056a2580 x1874670272809856/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827077 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827055.763957:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a2580 x1874670272809856/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827077 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827055.763965:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827055.763968:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827055.763971:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272809856:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787827055.763977:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827052/real 1787827055]  req@ffff9ee0056a03c0 x1874670272809728/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827077 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827055.763988:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a03c0 x1874670272809728/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827077 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827055.763995:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827055.763998:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827055.764001:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272809728:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787827055.764006:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827052/real 1787827055]  req@ffff9ee0056a1e00 x1874670272809600/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827077 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827055.764017:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1e00 x1874670272809600/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827077 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827055.764025:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827055.764029:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827055.764032:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272809600:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787827055.764037:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827052/real 1787827055]  req@ffff9ee0056a0000 x1874670272809472/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827077 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827055.764048:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0000 x1874670272809472/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827077 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827055.764056:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827055.764059:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827055.764062:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272809472:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787827055.764068:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827052/real 1787827055]  req@ffff9ee0056a0780 x1874670272809344/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827077 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827055.764080:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0780 x1874670272809344/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827077 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827055.764087:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827055.764090:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827055.764101:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272809344:192.168.203.121@tcp:250:kworker.0
00010000:00010000:0.0:1787827056.595614:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827056.787441:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827057.619549:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827057.811458:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00100000:0.0:1787827057.811664:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272810240:192.168.203.121@tcp:250:kworker.0
00000800:00000100:0.0:1787827057.811739:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827057.811802:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827057/real 1787827057]  req@ffff9ee0056a30c0 x1874670272810240/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827082 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827057.811841:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a30c0 x1874670272810240/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827082 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827057.811868:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827057.811883:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827057.811909:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272810240:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787827057.811925:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272810368:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787827057.811963:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827057.811993:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827057/real 1787827057]  req@ffff9ee0056a0780 x1874670272810368/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827082 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827057.812019:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0780 x1874670272810368/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827082 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827057.812058:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827057.812066:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827057.812071:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272810368:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787827057.812117:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272810496:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787827057.812140:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827057.812152:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827057/real 1787827057]  req@ffff9ee0056a0000 x1874670272810496/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827082 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827057.812165:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0000 x1874670272810496/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827082 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827057.812172:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827057.812176:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827057.812178:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272810496:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787827057.812184:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272810624:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787827057.812203:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827057.812214:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827057/real 1787827057]  req@ffff9ee0056a1e00 x1874670272810624/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827082 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827057.812229:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1e00 x1874670272810624/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827082 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827057.812236:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827057.812239:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827057.812242:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272810624:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787827057.812254:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272810752:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787827057.812274:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827057.812285:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827057/real 1787827057]  req@ffff9ee0056a03c0 x1874670272810752/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827082 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827057.812296:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a03c0 x1874670272810752/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827082 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827057.812303:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827057.812306:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827057.812310:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272810752:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787827057.812349:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272810880:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787827057.812369:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827057.812379:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827057/real 1787827057]  req@ffff9ee0056a2580 x1874670272810880/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827082 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827057.812389:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a2580 x1874670272810880/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827082 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827057.812401:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827057.812404:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827057.812407:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272810880:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787827057.812412:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272811008:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787827057.812429:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827057.812439:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827057/real 1787827057]  req@ffff9ee0056a0b40 x1874670272811008/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827082 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827057.812448:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0b40 x1874670272811008/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827082 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827057.812455:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827057.812458:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827057.812460:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272811008:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827058.643485:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827058.835403:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827059.667808:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827059.859485:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827060.691838:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827060.883460:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787827061.715526:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827061.907450:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827062.740540:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827062.931454:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787827062.932642:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827062.932650:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787827062.932653:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827062.932661:0:8:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2226
00000100:00080000:3.0:1787827062.932671:0:8:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827062.932678:0:8:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787827062.932713:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057052c0 x1874670272811136/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827062.932743:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827062.932746:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787827062.932748:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827062.932751:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2226
00000100:00080000:3.0:1787827062.932754:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827062.932770:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827062.932779:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787827062.932791:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057043c0 x1874670272811264/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827062.932800:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827062.932803:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787827062.932804:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827062.932807:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2226
00000100:00080000:3.0:1787827062.932810:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827062.932813:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827062.932818:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827062.932827:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706580 x1874670272811392/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827062.932835:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827062.932838:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787827062.932839:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827062.932843:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2226
00000100:00080000:3.0:1787827062.932846:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827062.932849:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827062.932853:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827062.932861:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705680 x1874670272811520/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827062.932869:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827062.932871:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787827062.932873:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827062.932876:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2226
00000100:00080000:3.0:1787827062.932879:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827062.932883:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827062.932887:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787827062.932897:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706940 x1874670272811648/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827062.932905:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827062.932908:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787827062.932910:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827062.932913:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2226
00000100:00080000:3.0:1787827062.932916:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827062.932920:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827062.932924:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827062.932933:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707c00 x1874670272811776/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827062.932942:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827062.932944:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787827062.932946:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827062.932949:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2226
00000100:00080000:3.0:1787827062.932951:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827062.932954:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827062.932958:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827062.932968:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704000 x1874670272811904/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787827062.933185:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272811136:192.168.203.121@tcp:250:kworker.0
00000800:00000100:0.0:1787827062.933242:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827062.933279:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827062/real 1787827062]  req@ffff9ee0057052c0 x1874670272811136/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827087 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827062.933295:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057052c0 x1874670272811136/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827087 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827062.933305:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827062.933309:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827062.933313:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272811136:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787827062.933355:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272811264:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787827062.933379:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827062.933392:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827062/real 1787827062]  req@ffff9ee0057043c0 x1874670272811264/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827087 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827062.933403:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057043c0 x1874670272811264/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827087 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827062.933411:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827062.933414:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827062.933417:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272811264:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787827062.933423:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272811392:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787827062.933442:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827062.933453:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827062/real 1787827062]  req@ffff9ee005706580 x1874670272811392/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827087 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827062.933464:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706580 x1874670272811392/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827087 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827062.933471:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827062.933475:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827062.933478:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272811392:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787827062.933483:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272811520:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787827062.933500:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827062.933510:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827062/real 1787827062]  req@ffff9ee005705680 x1874670272811520/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827087 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827062.933521:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705680 x1874670272811520/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827087 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827062.933528:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827062.933531:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827062.933534:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272811520:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787827062.933539:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272811648:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787827062.934986:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827062.935110:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827062/real 1787827062]  req@ffff9ee005706940 x1874670272811648/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827087 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827062.935128:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706940 x1874670272811648/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827087 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827062.935137:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827062.935141:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827062.935144:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272811648:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787827062.935165:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272811776:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787827062.935195:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827062.935206:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827062/real 1787827062]  req@ffff9ee005707c00 x1874670272811776/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827087 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827062.935217:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707c00 x1874670272811776/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827087 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827062.935226:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827062.935229:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827062.935232:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272811776:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787827062.935238:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272811904:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787827062.935253:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827062.935261:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827062/real 1787827062]  req@ffff9ee005704000 x1874670272811904/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827087 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827062.935284:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704000 x1874670272811904/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827087 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827062.935292:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827062.935295:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827062.935298:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272811904:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827063.763657:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827063.955576:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827064.787971:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827064.980233:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827065.811484:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827066.003495:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787827066.835616:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827067.027692:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827067.859559:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787827068.051944:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787827068.051961:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827068.051966:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787827068.051971:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827068.051979:0:8:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2231
00000100:00080000:3.0:1787827068.051989:0:8:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827068.051995:0:8:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787827068.052025:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057070c0 x1874670272812032/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827068.052045:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827068.052049:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787827068.052050:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827068.052054:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2231
00000100:00080000:3.0:1787827068.052059:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827068.052063:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827068.052071:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787827068.052085:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706d00 x1874670272812160/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827068.052096:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827068.052099:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787827068.052101:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827068.052104:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2231
00000100:00080000:3.0:1787827068.052108:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827068.052113:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827068.052118:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827068.052129:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704000 x1874670272812288/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827068.052135:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827068.052138:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787827068.052139:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827068.052141:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2231
00000100:00080000:3.0:1787827068.052144:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827068.052146:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827068.052149:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827068.052165:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707c00 x1874670272812416/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827068.052176:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827068.052179:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787827068.052181:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827068.052184:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2231
00000100:00080000:3.0:1787827068.052262:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827068.052270:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827068.052279:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787827068.052295:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706940 x1874670272812544/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827068.052306:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827068.052311:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787827068.052343:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827068.052348:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2231
00000100:00080000:3.0:1787827068.052352:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827068.052357:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827068.052365:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827068.052380:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705680 x1874670272812672/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827068.052400:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827068.052413:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787827068.052418:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827068.052425:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2231
00000100:00080000:3.0:1787827068.052431:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827068.052439:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827068.052443:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827068.052455:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706580 x1874670272812800/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00010000:00010000:2.0:1787827068.883706:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827069.075484:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827069.907530:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827070.099414:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827070.931488:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827071.123498:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787827071.955512:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827072.148715:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827072.979771:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1787827073.172713:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1787827073.172716:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:2.0:1787827073.172721:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787827073.172727:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827073.172734:0:8:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2236
00000100:00080000:2.0:1787827073.172742:0:8:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827073.172748:0:8:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787827073.172778:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572bc00 x1874670272812928/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827073.172810:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827073.172813:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787827073.172815:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827073.172819:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2236
00000100:00080000:2.0:1787827073.172823:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827073.172827:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827073.172836:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787827073.172849:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728f00 x1874670272813056/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827073.172859:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827073.172862:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787827073.172865:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827073.172869:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2236
00000100:00080000:2.0:1787827073.172872:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827073.172876:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827073.172881:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787827073.172904:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a1c0 x1874670272813184/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827073.172915:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827073.172918:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787827073.172921:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827073.172924:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2236
00000100:00080000:2.0:1787827073.172929:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827073.172933:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827073.172939:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787827073.172951:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a940 x1874670272813312/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827073.172960:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827073.172964:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787827073.172966:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827073.172970:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2236
00000100:00080000:2.0:1787827073.172974:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827073.172983:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827073.172995:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787827073.173007:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b840 x1874670272813440/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827073.173014:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827073.173016:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787827073.173017:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827073.173020:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2236
00000100:00080000:2.0:1787827073.173023:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827073.173026:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827073.173030:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787827073.173042:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057283c0 x1874670272813568/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827073.173054:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827073.173068:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787827073.173072:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827073.173091:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2236
00000100:00080000:2.0:1787827073.173096:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827073.173102:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827073.173116:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787827073.173134:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729e00 x1874670272813696/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00010000:00010000:2.0:1787827074.003819:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827074.197047:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827075.027519:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787827075.219522:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827076.051512:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787827076.243400:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787827077.075483:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787827077.267438:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827078.099492:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787827078.291385:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:2.0:1787827078.291392:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827078.291399:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787827078.291402:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827078.291411:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2242
00000100:00080000:2.0:1787827078.291422:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827078.291428:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787827078.291459:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729680 x1874670272813824/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827078.291483:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827078.291486:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787827078.291488:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827078.291491:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2242
00000100:00080000:2.0:1787827078.291494:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827078.291499:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827078.291508:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787827078.291521:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057292c0 x1874670272813952/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827078.291531:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827078.291535:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787827078.291537:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827078.291540:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2242
00000100:00080000:2.0:1787827078.291545:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827078.291549:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827078.291555:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787827078.291571:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728780 x1874670272814080/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827078.291581:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827078.291596:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787827078.291597:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827078.291600:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2242
00000100:00080000:2.0:1787827078.291603:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827078.291605:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827078.291608:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787827078.291616:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729e00 x1874670272814208/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827078.291622:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827078.291625:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787827078.291626:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827078.291629:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2242
00000100:00080000:2.0:1787827078.291631:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827078.291633:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827078.291635:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787827078.291640:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057283c0 x1874670272814336/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827078.291645:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827078.291647:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787827078.291648:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827078.291661:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2242
00000100:00080000:2.0:1787827078.291665:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827078.291667:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827078.291671:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787827078.291678:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b840 x1874670272814464/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827078.291683:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827078.291685:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787827078.291687:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827078.291689:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2242
00000100:00080000:2.0:1787827078.291691:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827078.291693:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827078.291697:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787827078.291707:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a940 x1874670272814592/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00010000:00010000:2.0:1787827079.123555:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827079.315452:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827080.147859:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827080.339449:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827081.171600:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827081.363423:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787827082.195493:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787827082.387505:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827083.219567:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787827083.411447:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787827083.411464:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827083.411480:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787827083.411485:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827083.411494:0:8:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2247
00000100:00080000:3.0:1787827083.411505:0:8:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827083.411511:0:8:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787827083.411544:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057043c0 x1874670272814720/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827083.411570:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827083.411586:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787827083.411588:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827083.411592:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2247
00000100:00080000:3.0:1787827083.411596:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827083.411600:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827083.411609:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787827083.411632:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057052c0 x1874670272814848/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827083.411645:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827083.411649:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787827083.411651:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827083.411654:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2247
00000100:00080000:3.0:1787827083.411658:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827083.411663:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827083.411669:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827083.411681:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704b40 x1874670272814976/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827083.411689:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827083.411693:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787827083.411694:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827083.411697:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2247
00000100:00080000:3.0:1787827083.411700:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827083.411706:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827083.411721:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827083.411734:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707480 x1874670272815104/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827083.411745:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827083.411752:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787827083.411756:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827083.411762:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2247
00000100:00080000:3.0:1787827083.411766:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827083.411772:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827083.411779:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787827083.411796:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057061c0 x1874670272815232/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827083.411808:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827083.411811:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787827083.411813:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827083.411815:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2247
00000100:00080000:3.0:1787827083.411818:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827083.411820:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827083.411823:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827083.411832:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705a40 x1874670272815360/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827083.411839:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827083.411841:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787827083.411842:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827083.411845:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2247
00000100:00080000:3.0:1787827083.411847:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827083.411853:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827083.411859:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827083.411872:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704780 x1874670272815488/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827083.412137:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827083.412139:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272815360:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827083.412143:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272815488:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827083.412154:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827083.412160:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827083/real 1787827083]  req@ffff9ee005704780 x1874670272815488/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827108 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827083.412166:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704780 x1874670272815488/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827108 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827083.412171:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827083.412172:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827083.412174:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272815488:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827084.243551:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787827084.435449:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827085.267496:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787827085.459394:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827086.291517:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827086.483834:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787827087.315765:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787827087.507800:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827088.339566:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1787827088.531397:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827088.531410:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787827088.531416:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827088.531430:0:8:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2252
00000100:00080000:3.0:1787827088.531458:0:8:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1787827088.531468:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787827088.531472:0:8:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787827088.531520:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707840 x1874670272815616/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827088.531548:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827088.531552:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787827088.531553:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827088.531557:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2252
00000100:00080000:3.0:1787827088.531568:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827088.531573:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827088.531598:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787827088.531613:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705e00 x1874670272815744/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787827088.531620:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272815616:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787827088.531634:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827088.531641:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787827088.531643:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827088.531648:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2252
00000100:00080000:3.0:1787827088.531652:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827088.531657:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827088.531663:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827088.531676:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704780 x1874670272815872/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827088.531692:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827088.531695:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787827088.531697:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827088.531702:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2252
00000800:00000100:1.0:1787827088.531704:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787827088.531707:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827088.531712:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827088.531717:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827088.531727:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705a40 x1874670272816000/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827088.531743:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827088.531747:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787827088.531750:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827088.531754:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2252
00000100:00080000:3.0:1787827088.531758:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827088.531763:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827088.531768:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787827088.531773:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827088/real 1787827088]  req@ffff9ee005707840 x1874670272815616/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827113 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827088.531783:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057061c0 x1874670272816128/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827088.531794:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1787827088.531798:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707840 x1874670272815616/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827113 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827088.531799:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787827088.531802:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827088.531810:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2252
00000100:00080000:1.0:1787827088.531817:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827088.531817:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827088.531825:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00080000:1.0:1787827088.531826:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000008:00100000:3.0:1787827088.531833:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787827088.531835:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272815616:192.168.203.121@tcp:250:kworker.0
00000100:00100000:3.0:1787827088.531849:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707480 x1874670272816256/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827088.531859:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827088.531863:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787827088.531865:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1787827088.531866:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272815744:192.168.203.121@tcp:38:kworker.0
00000100:00080000:3.0:1787827088.531873:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2252
00000100:00080000:3.0:1787827088.531877:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827088.531881:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827088.531885:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827088.531899:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704b40 x1874670272816384/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1787827088.531911:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827088.531927:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827088/real 1787827088]  req@ffff9ee005705e00 x1874670272815744/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827113 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827088.531937:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705e00 x1874670272815744/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827113 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827088.531945:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827088.531948:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827088.531952:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272815744:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787827088.531958:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272815872:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827088.531976:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827088.531986:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827088/real 1787827088]  req@ffff9ee005704780 x1874670272815872/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827113 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827088.531997:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704780 x1874670272815872/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827113 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827088.532009:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827088.532012:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827088.532015:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272815872:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827088.532020:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272816000:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827088.532043:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827088.532052:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827088/real 1787827088]  req@ffff9ee005705a40 x1874670272816000/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827113 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827088.532062:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705a40 x1874670272816000/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827113 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827088.532070:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827088.532074:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827088.532078:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272816000:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827088.532083:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272816128:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787827088.532100:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827088.532118:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827088/real 1787827088]  req@ffff9ee0057061c0 x1874670272816128/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827113 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827088.532129:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057061c0 x1874670272816128/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827113 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827088.532136:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827088.532138:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827088.532141:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272816128:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787827088.532146:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272816256:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827088.532164:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827088.532175:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827088/real 1787827088]  req@ffff9ee005707480 x1874670272816256/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827113 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827088.532195:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707480 x1874670272816256/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827113 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827088.532202:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827088.532205:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827088.532208:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272816256:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827088.532227:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272816384:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827088.532257:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827088.532268:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827088/real 1787827088]  req@ffff9ee005704b40 x1874670272816384/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827113 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827088.532280:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704b40 x1874670272816384/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827113 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827088.532287:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827088.532290:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827088.532293:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272816384:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827089.363552:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827089.555612:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827090.387500:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827090.579500:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827091.411512:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827091.603436:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787827092.435482:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827092.627441:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827093.459493:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1787827093.651447:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1787827093.651449:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:2.0:1787827093.651459:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787827093.651463:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827093.651473:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2257
00000100:00080000:2.0:1787827093.651483:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827093.651491:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787827093.651525:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a1c0 x1874670272816512/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827093.651563:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827093.651567:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787827093.651569:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827093.651572:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2257
00000100:00080000:2.0:1787827093.651576:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827093.651579:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827093.651589:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787827093.651605:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728f00 x1874670272816640/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827093.651616:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827093.651620:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787827093.651622:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827093.651626:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2257
00000100:00080000:2.0:1787827093.651629:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827093.651633:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827093.651638:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787827093.651643:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272816512:192.168.203.121@tcp:250:kworker.0
00000100:00100000:2.0:1787827093.651649:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572bc00 x1874670272816768/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827093.651660:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827093.651663:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787827093.651664:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827093.651668:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2257
00000100:00080000:2.0:1787827093.651671:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827093.651674:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827093.651678:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787827093.651687:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728000 x1874670272816896/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827093.651695:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827093.651698:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787827093.651699:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827093.651703:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2257
00000100:00080000:2.0:1787827093.651706:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827093.651710:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827093.651715:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000800:00000100:1.0:1787827093.651717:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827093.651728:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a580 x1874670272817024/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827093.651737:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827093.651740:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787827093.651742:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827093.651755:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2257
00000100:00100000:1.0:1787827093.651761:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827093/real 1787827093]  req@ffff9ee00572a1c0 x1874670272816512/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827118 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827093.651769:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827093.651776:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827093.651783:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787827093.651787:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a1c0 x1874670272816512/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827118 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827093.651796:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728b40 x1874670272817152/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827093.651806:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827093.651812:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827093.651816:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272816512:192.168.203.121@tcp:250:kworker.0
00000100:00080000:2.0:1787827093.651818:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827093.651824:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787827093.651827:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1787827093.651828:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272816640:192.168.203.121@tcp:38:kworker.0
00000100:00080000:2.0:1787827093.651835:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2257
00000100:00080000:2.0:1787827093.651839:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827093.651843:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827093.651848:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787827093.651860:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729a40 x1874670272817280/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1787827093.651864:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827093.651881:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827093/real 1787827093]  req@ffff9ee005728f00 x1874670272816640/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827118 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827093.651897:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728f00 x1874670272816640/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827118 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827093.651906:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827093.651909:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827093.651912:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272816640:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787827093.651936:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272816768:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827093.651956:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827093.651967:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827093/real 1787827093]  req@ffff9ee00572bc00 x1874670272816768/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827118 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827093.651977:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572bc00 x1874670272816768/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827118 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827093.651984:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827093.651987:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827093.651989:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272816768:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827093.651995:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272816896:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827093.652010:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827093.652020:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827093/real 1787827093]  req@ffff9ee005728000 x1874670272816896/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827118 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827093.652030:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728000 x1874670272816896/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827118 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827093.652036:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827093.652039:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827093.652042:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272816896:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827093.652047:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272817024:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787827093.652062:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827093.652071:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827093/real 1787827093]  req@ffff9ee00572a580 x1874670272817024/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827118 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827093.652081:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a580 x1874670272817024/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827118 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827093.652103:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827093.652107:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827093.652109:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272817024:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787827093.652115:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272817152:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827093.652131:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827093.652140:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827093/real 1787827093]  req@ffff9ee005728b40 x1874670272817152/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827118 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827093.652150:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728b40 x1874670272817152/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827118 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827093.652157:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827093.652160:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827093.652163:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272817152:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827093.652169:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272817280:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827093.652190:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827093.652200:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827093/real 1787827093]  req@ffff9ee005729a40 x1874670272817280/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827118 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827093.652210:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729a40 x1874670272817280/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827118 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827093.652217:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827093.652219:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827093.652222:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272817280:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827094.483485:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827094.675497:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827095.507508:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827095.699987:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827096.532247:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787827096.724171:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787827097.555484:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787827097.747428:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827098.579491:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1787827098.771681:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827098.771689:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1787827098.771692:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827098.771701:0:8:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2262
00000100:00080000:0.0:1787827098.771711:0:8:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827098.771719:0:8:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787827098.771727:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00100000:0.0:1787827098.771757:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8b40 x1874670272817408/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827098.771784:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827098.771786:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787827098.771788:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827098.771791:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2262
00000100:00080000:0.0:1787827098.771794:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827098.771796:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827098.771804:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787827098.771813:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8780 x1874670272817536/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827098.771820:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827098.771824:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787827098.771826:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827098.771829:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2262
00000100:00080000:0.0:1787827098.771833:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1787827098.771836:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272817408:192.168.203.121@tcp:250:kworker.0
00000100:00080000:0.0:1787827098.771839:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827098.771846:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787827098.771859:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb480 x1874670272817664/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827098.771869:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827098.771872:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787827098.771873:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827098.771876:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2262
00000100:00080000:0.0:1787827098.771889:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827098.771893:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827098.771897:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1787827098.771900:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827098.771912:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9e00 x1874670272817792/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827098.771922:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827098.771925:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787827098.771926:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827098.771930:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2262
00000100:00080000:0.0:1787827098.771934:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827098.771938:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827098.771943:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787827098.771959:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ea940 x1874670272817920/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787827098.771959:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827098/real 1787827098]  req@ffff9ee0056e8b40 x1874670272817408/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827123 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827098.771984:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827098.771989:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787827098.771991:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827098.771995:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2262
00000100:00100000:1.0:1787827098.771999:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8b40 x1874670272817408/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827123 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827098.772000:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827098.772008:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827098.772015:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:1.0:1787827098.772019:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827098.772026:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827098.772029:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb0c0 x1874670272818048/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827098.772039:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827098.772043:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787827098.772046:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1787827098.772046:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272817408:192.168.203.121@tcp:250:kworker.0
00000100:00080000:0.0:1787827098.772055:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2262
00000100:00080000:0.0:1787827098.772059:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1787827098.772062:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272817536:192.168.203.121@tcp:38:kworker.0
00000100:00080000:0.0:1787827098.772065:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827098.772073:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787827098.772085:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9a40 x1874670272818176/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1787827098.772099:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827098.772116:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827098/real 1787827098]  req@ffff9ee0056e8780 x1874670272817536/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827123 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827098.772128:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8780 x1874670272817536/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827123 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827098.772137:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827098.772140:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827098.772144:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272817536:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787827098.772171:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272817664:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827098.772200:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827098.772213:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827098/real 1787827098]  req@ffff9ee0056eb480 x1874670272817664/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827123 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827098.772236:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb480 x1874670272817664/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827123 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827098.772245:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827098.772248:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827098.772257:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272817664:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827098.772264:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272817792:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827098.772282:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827098.772293:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827098/real 1787827098]  req@ffff9ee0056e9e00 x1874670272817792/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827123 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827098.772304:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9e00 x1874670272817792/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827123 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827098.772313:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827098.772346:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827098.772350:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272817792:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827098.772356:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272817920:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787827098.772376:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827098.772386:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827098/real 1787827098]  req@ffff9ee0056ea940 x1874670272817920/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827123 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827098.772397:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ea940 x1874670272817920/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827123 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827098.772404:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827098.772407:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827098.772410:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272817920:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787827098.772415:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272818048:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827098.772434:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827098.772445:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827098/real 1787827098]  req@ffff9ee0056eb0c0 x1874670272818048/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827123 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827098.772455:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb0c0 x1874670272818048/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827123 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827098.772463:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827098.772466:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827098.772469:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272818048:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827098.772474:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272818176:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827098.772491:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827098.772501:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827098/real 1787827098]  req@ffff9ee0056e9a40 x1874670272818176/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827123 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827098.772526:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9a40 x1874670272818176/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827123 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827098.772534:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827098.772537:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827098.772540:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272818176:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827099.603484:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827099.795428:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827100.627552:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827100.819435:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827101.651527:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827101.843546:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787827102.675515:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827102.867443:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827103.699597:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787827103.891520:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:0.0:1787827103.891526:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827103.891537:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1787827103.891542:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827103.891555:0:8:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2267
00000100:00080000:0.0:1787827103.891566:0:8:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827103.891575:0:8:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787827103.891609:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ead00 x1874670272818304/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827103.891632:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827103.891635:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787827103.891637:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827103.891641:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2267
00000100:00080000:0.0:1787827103.891645:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827103.891651:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827103.891661:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787827103.891673:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272818304:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787827103.891677:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ea580 x1874670272818432/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827103.891696:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827103.891700:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787827103.891702:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827103.891706:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2267
00000100:00080000:0.0:1787827103.891711:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827103.891716:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827103.891722:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787827103.891735:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9a40 x1874670272818560/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827103.891746:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827103.891750:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787827103.891753:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827103.891760:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2267
00000100:00080000:0.0:1787827103.891767:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000800:00000100:1.0:1787827103.891767:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:0.0:1787827103.891778:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827103.891784:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787827103.891802:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb0c0 x1874670272818688/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827103.891813:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827103.891816:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787827103.891818:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827103.891826:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2267
00000100:00080000:0.0:1787827103.891834:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827103.891838:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787827103.891844:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827103/real 1787827103]  req@ffff9ee0056ead00 x1874670272818304/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827128 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:0.0:1787827103.891846:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787827103.891871:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ea940 x1874670272818816/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787827103.891876:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ead00 x1874670272818304/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827128 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827103.891888:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827103.891900:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787827103.891906:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827103.891914:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2267
00000100:00080000:1.0:1787827103.891916:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827103.891920:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827103.891926:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:0.0:1787827103.891928:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827103.891936:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787827103.891936:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272818304:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787827103.891959:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9e00 x1874670272818944/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827103.891968:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827103.891971:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787827103.891973:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1787827103.891980:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272818432:192.168.203.121@tcp:38:kworker.0
00000100:00080000:0.0:1787827103.891981:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2267
00000100:00080000:0.0:1787827103.891988:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827103.891997:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827103.892002:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787827103.892022:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb480 x1874670272819072/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1787827103.892027:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827103.892047:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827103/real 1787827103]  req@ffff9ee0056ea580 x1874670272818432/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827128 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827103.892066:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ea580 x1874670272818432/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827128 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827103.892074:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827103.892078:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827103.892081:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272818432:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787827103.892088:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272818560:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827103.892107:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827103.892118:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827103/real 1787827103]  req@ffff9ee0056e9a40 x1874670272818560/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827128 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827103.892129:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9a40 x1874670272818560/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827128 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827103.892137:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827103.892141:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827103.892144:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272818560:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827103.892149:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272818688:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827103.892165:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827103.892176:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827103/real 1787827103]  req@ffff9ee0056eb0c0 x1874670272818688/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827128 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827103.892193:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb0c0 x1874670272818688/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827128 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827103.892200:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827103.892204:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827103.892207:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272818688:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827103.892213:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272818816:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787827103.892230:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827103.892240:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827103/real 1787827103]  req@ffff9ee0056ea940 x1874670272818816/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827128 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827103.892251:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ea940 x1874670272818816/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827128 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827103.892258:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827103.892262:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827103.892265:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272818816:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787827103.892281:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272818944:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827103.892297:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827103.892307:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827103/real 1787827103]  req@ffff9ee0056e9e00 x1874670272818944/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827128 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827103.892351:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9e00 x1874670272818944/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827128 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827103.892369:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827103.892373:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827103.892376:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272818944:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827103.892394:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272819072:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827103.892412:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827103.892422:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827103/real 1787827103]  req@ffff9ee0056eb480 x1874670272819072/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827128 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827103.892432:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb480 x1874670272819072/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827128 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827103.892439:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827103.892443:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827103.892446:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272819072:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827104.723513:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787827104.915429:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827105.747497:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787827105.939526:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827106.771516:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787827106.963428:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787827107.797193:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787827107.987455:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827108.819515:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787827109.011449:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:2.0:1787827109.011489:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827109.011495:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787827109.011499:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827109.011508:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2272
00000100:00080000:2.0:1787827109.011517:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827109.011525:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787827109.011561:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b0c0 x1874670272819200/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827109.011584:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827109.011587:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787827109.011589:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827109.011592:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2272
00000100:00080000:2.0:1787827109.011596:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827109.011600:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827109.011609:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787827109.011619:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272819200:192.168.203.121@tcp:250:kworker.0
00000100:00100000:2.0:1787827109.011624:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b480 x1874670272819328/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827109.011636:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827109.011639:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787827109.011640:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827109.011644:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2272
00000100:00080000:2.0:1787827109.011648:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827109.011652:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827109.011657:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787827109.011667:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572ad00 x1874670272819456/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827109.011673:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827109.011675:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787827109.011676:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827109.011679:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2272
00000100:00080000:2.0:1787827109.011681:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827109.011684:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827109.011687:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1787827109.011694:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827109.011696:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729a40 x1874670272819584/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827109.011703:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827109.011706:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787827109.011708:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827109.011712:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2272
00000100:00080000:2.0:1787827109.011716:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827109.011719:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827109.011723:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787827109.011734:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728b40 x1874670272819712/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827109.011743:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1787827109.011746:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827109/real 1787827109]  req@ffff9ee00572b0c0 x1874670272819200/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827134 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827109.011748:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787827109.011751:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827109.011758:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2272
00000100:00080000:2.0:1787827109.011764:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827109.011768:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787827109.011772:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b0c0 x1874670272819200/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827134 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:2.0:1787827109.011775:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787827109.011787:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a580 x1874670272819840/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827109.011817:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827109.011818:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827109.011823:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787827109.011828:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:2.0:1787827109.011828:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827109.011834:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2272
00000100:00080000:2.0:1787827109.011837:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1787827109.011845:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272819200:192.168.203.121@tcp:250:kworker.0
00000100:00080000:2.0:1787827109.011846:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827109.011855:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787827109.011867:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728000 x1874670272819968/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787827109.011889:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272819328:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787827109.011912:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827109.011924:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827109/real 1787827109]  req@ffff9ee00572b480 x1874670272819328/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827134 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827109.011936:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b480 x1874670272819328/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827134 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827109.011945:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827109.011948:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827109.011951:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272819328:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787827109.012302:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272819456:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827109.012342:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827109.012354:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827109/real 1787827109]  req@ffff9ee00572ad00 x1874670272819456/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827134 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827109.012366:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572ad00 x1874670272819456/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827134 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827109.012373:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827109.012376:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827109.012379:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272819456:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827109.012385:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272819584:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827109.012403:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827109.012412:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827109/real 1787827109]  req@ffff9ee005729a40 x1874670272819584/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827134 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827109.012422:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729a40 x1874670272819584/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827134 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827109.012435:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827109.012448:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827109.012451:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272819584:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827109.012457:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272819712:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787827109.012475:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827109.012486:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827109/real 1787827109]  req@ffff9ee005728b40 x1874670272819712/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827134 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827109.012497:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728b40 x1874670272819712/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827134 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827109.012504:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827109.012507:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827109.012509:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272819712:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787827109.012515:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272819840:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827109.012532:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827109.012542:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827109/real 1787827109]  req@ffff9ee00572a580 x1874670272819840/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827134 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827109.012553:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a580 x1874670272819840/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827134 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827109.012560:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827109.012562:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827109.012565:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272819840:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827109.012571:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272819968:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827109.012587:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827109.012597:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827109/real 1787827109]  req@ffff9ee005728000 x1874670272819968/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827134 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827109.012608:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728000 x1874670272819968/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827134 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827109.012615:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827109.012618:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827109.012621:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272819968:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827109.843683:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827110.035471:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827110.867724:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827111.059492:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827111.891567:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827112.083437:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787827112.915547:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827113.107527:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827113.939595:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827114.131458:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:0.0:1787827114.131830:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827114.131836:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1787827114.131840:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827114.131848:0:8:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2277
00000100:00080000:0.0:1787827114.131857:0:8:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827114.131863:0:8:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787827114.131897:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8780 x1874670272820096/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827114.131935:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827114.131939:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787827114.131940:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827114.131944:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2277
00000100:00080000:0.0:1787827114.131947:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827114.131950:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827114.131959:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787827114.131970:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8b40 x1874670272820224/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827114.131978:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827114.131981:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787827114.131983:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827114.131985:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2277
00000100:00080000:0.0:1787827114.131988:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827114.131992:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827114.131996:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787827114.132005:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8000 x1874670272820352/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827114.132014:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827114.132017:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787827114.132018:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827114.132021:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2277
00000100:00080000:0.0:1787827114.132025:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827114.132028:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827114.132031:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787827114.132039:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e83c0 x1874670272820480/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827114.132047:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827114.132050:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787827114.132051:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827114.132055:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2277
00000100:00080000:0.0:1787827114.132058:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827114.132062:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827114.132066:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787827114.132074:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e92c0 x1874670272820608/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827114.132082:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827114.132085:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787827114.132087:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827114.132090:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2277
00000100:00080000:0.0:1787827114.132092:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827114.132095:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827114.132099:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787827114.132107:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9680 x1874670272820736/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827114.132119:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827114.132122:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787827114.132124:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827114.132127:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2277
00000100:00080000:0.0:1787827114.132130:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827114.132132:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827114.132136:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787827114.132145:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb840 x1874670272820864/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787827114.132230:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272820096:192.168.203.121@tcp:250:kworker.0
00000800:00000100:1.0:1787827114.132283:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827114.132346:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827114/real 1787827114]  req@ffff9ee0056e8780 x1874670272820096/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827139 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827114.132362:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8780 x1874670272820096/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827139 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827114.132376:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827114.132380:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827114.132383:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272820096:192.168.203.121@tcp:250:kworker.0
00000100:00100000:1.0:1787827114.132389:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272820224:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787827114.132422:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827114.132434:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827114/real 1787827114]  req@ffff9ee0056e8b40 x1874670272820224/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827139 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827114.132446:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8b40 x1874670272820224/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827139 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827114.132453:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827114.132456:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827114.132459:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272820224:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787827114.132465:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272820352:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827114.132482:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827114.132499:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827114/real 1787827114]  req@ffff9ee0056e8000 x1874670272820352/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827139 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827114.132509:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8000 x1874670272820352/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827139 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827114.132516:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827114.132519:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827114.132522:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272820352:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827114.132528:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272820480:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827114.132544:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827114.132553:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827114/real 1787827114]  req@ffff9ee0056e83c0 x1874670272820480/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827139 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827114.132562:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e83c0 x1874670272820480/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827139 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827114.132569:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827114.132572:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827114.132575:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272820480:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827114.132580:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272820608:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787827114.132594:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827114.132603:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827114/real 1787827114]  req@ffff9ee0056e92c0 x1874670272820608/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827139 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827114.132614:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e92c0 x1874670272820608/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827139 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827114.132621:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827114.132624:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827114.132627:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272820608:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787827114.132632:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272820736:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827114.132647:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827114.132656:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827114/real 1787827114]  req@ffff9ee0056e9680 x1874670272820736/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827139 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827114.132666:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9680 x1874670272820736/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827139 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827114.132672:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827114.132674:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827114.132677:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272820736:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827114.132681:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272820864:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827114.132694:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827114.132702:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827114/real 1787827114]  req@ffff9ee0056eb840 x1874670272820864/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827139 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827114.132711:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb840 x1874670272820864/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827139 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827114.132717:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827114.132720:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827114.132722:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272820864:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827114.963509:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827115.155445:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827115.988042:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827116.179662:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827117.011561:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827117.203449:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787827118.035705:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827118.227456:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827119.059505:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827119.251460:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:2.0:1787827119.251578:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827119.251587:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787827119.251593:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827119.251604:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2282
00000100:00080000:2.0:1787827119.251619:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827119.251628:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787827119.251678:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572bc00 x1874670272820992/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827119.251705:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827119.251708:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787827119.251710:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827119.251714:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2282
00000100:00080000:2.0:1787827119.251718:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827119.251723:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827119.251735:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787827119.251750:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272820992:192.168.203.121@tcp:250:kworker.0
00000100:00100000:2.0:1787827119.251751:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728f00 x1874670272821120/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827119.251778:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827119.251781:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787827119.251784:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827119.251788:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2282
00000100:00080000:2.0:1787827119.251793:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827119.251798:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827119.251816:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787827119.251827:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a1c0 x1874670272821248/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827119.251835:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827119.251838:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787827119.251839:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827119.251843:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2282
00000100:00080000:2.0:1787827119.251846:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827119.251849:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827119.251854:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787827119.251863:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a940 x1874670272821376/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827119.251869:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827119.251873:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787827119.251875:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827119.251881:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2282
00000100:00100000:1.0:1787827119.251882:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272821120:192.168.203.121@tcp:38:kworker.0
00000100:00080000:2.0:1787827119.251886:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827119.251895:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827119.251899:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787827119.251907:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b840 x1874670272821504/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827119.251919:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827119.251923:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787827119.251925:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1787827119.251934:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272821248:192.168.203.121@tcp:8:kworker.0
00000100:00080000:2.0:1787827119.251934:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2282
00000100:00080000:2.0:1787827119.251940:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827119.251958:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787827119.251963:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272821376:192.168.203.121@tcp:8:kworker.0
00000008:00100000:2.0:1787827119.251964:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787827119.251988:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272821504:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787827119.251989:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057283c0 x1874670272821632/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827119.252012:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827119.252017:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787827119.252020:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1787827119.252022:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272821632:192.168.203.121@tcp:8:kworker.0
00000100:00080000:2.0:1787827119.252033:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2282
00000100:00080000:2.0:1787827119.252041:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827119.252046:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827119.252053:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787827119.252065:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729e00 x1874670272821760/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787827119.252097:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272821760:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827120.083521:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827120.275595:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827121.107761:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827121.301060:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827122.131664:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827122.323630:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000400:00000100:1.0:1787827122.323782:0:2354:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.203.121:988
00000400:00000100:1.0:1787827122.323821:0:2354:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.203.121@tcp at host 192.168.203.121 was unreachable: the network or that node may be down, or Lustre may be misconfigured.
00000800:00000100:1.0:1787827122.323837:0:2354:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:1.0:1787827122.323880:0:2354:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:1.0:1787827122.323889:0:2354:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:1.0:1787827122.323897:0:2354:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:1.0:1787827122.323904:0:2354:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:1.0:1787827122.323911:0:2354:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:1.0:1787827122.323919:0:2354:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000100:00100000:0.0:1787827122.323996:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827119/real 1787827122]  req@ffff9ee005729e00 x1874670272821760/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827144 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827122.324018:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729e00 x1874670272821760/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827144 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827122.324029:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827122.324034:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827122.324038:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272821760:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787827122.324045:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827119/real 1787827122]  req@ffff9ee0057283c0 x1874670272821632/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827144 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827122.324057:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057283c0 x1874670272821632/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827144 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827122.324070:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827122.324073:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827122.324076:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272821632:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787827122.324083:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827119/real 1787827122]  req@ffff9ee00572b840 x1874670272821504/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827144 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827122.324095:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b840 x1874670272821504/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827144 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827122.324103:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827122.324106:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827122.324109:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272821504:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787827122.324115:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827119/real 1787827122]  req@ffff9ee005728f00 x1874670272821120/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827144 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827122.324126:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728f00 x1874670272821120/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827144 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827122.324134:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827122.324137:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827122.324141:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272821120:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787827122.324147:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827119/real 1787827122]  req@ffff9ee00572a1c0 x1874670272821248/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827144 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827122.324158:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a1c0 x1874670272821248/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827144 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827122.324166:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827122.324169:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827122.324172:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272821248:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787827122.325114:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827119/real 1787827122]  req@ffff9ee00572a940 x1874670272821376/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827144 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827122.325137:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a940 x1874670272821376/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827144 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827122.325156:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827122.325160:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827122.325164:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272821376:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787827122.325171:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827119/real 1787827122]  req@ffff9ee00572bc00 x1874670272820992/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827144 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827122.325188:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572bc00 x1874670272820992/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827144 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827122.325195:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827122.325200:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827122.325203:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272820992:192.168.203.121@tcp:250:kworker.0
00010000:00010000:0.0:1787827123.156058:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827123.347488:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827124.179507:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1787827124.371428:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827124.371438:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787827124.371442:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827124.371452:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2288
00000100:00080000:2.0:1787827124.371461:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827124.371469:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787827124.371478:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00100000:2.0:1787827124.371503:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728780 x1874670272821888/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827124.371528:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827124.371531:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787827124.371532:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827124.371536:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2288
00000100:00080000:2.0:1787827124.371539:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827124.371543:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827124.371564:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787827124.371575:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272821888:192.168.203.121@tcp:250:kworker.0
00000100:00100000:2.0:1787827124.371579:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057292c0 x1874670272822016/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827124.371591:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827124.371595:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787827124.371597:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827124.371600:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2288
00000100:00080000:2.0:1787827124.371604:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827124.371609:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827124.371614:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787827124.371625:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729680 x1874670272822144/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1787827124.371633:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:2.0:1787827124.371636:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827124.371640:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787827124.371642:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827124.371647:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2288
00000100:00080000:2.0:1787827124.371651:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827124.371654:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827124.371659:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787827124.371672:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827124/real 1787827124]  req@ffff9ee005728780 x1874670272821888/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827149 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827124.371673:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572bc00 x1874670272822272/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827124.371692:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827124.371701:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00100000:0.0:1787827124.371703:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728780 x1874670272821888/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827149 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827124.371704:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827124.371714:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2288
00000100:00080000:0.0:1787827124.371720:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827124.371724:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827124.371729:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827124.371734:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00080000:0.0:1787827124.371739:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827124.371745:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272821888:192.168.203.121@tcp:250:kworker.0
00000100:00100000:2.0:1787827124.371750:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a940 x1874670272822400/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827124.371761:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827124.371764:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787827124.371766:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827124.371770:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2288
00000100:00080000:2.0:1787827124.371773:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1787827124.371779:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057292c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272822016:192.168.203.121@tcp:38:kworker.0
00000100:00080000:2.0:1787827124.371780:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827124.371789:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787827124.371802:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a1c0 x1874670272822528/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827124.371808:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827124.371811:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787827124.371812:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827124.371814:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2288
00000100:00080000:2.0:1787827124.371816:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827124.371821:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000800:00000100:0.0:1787827124.371822:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000008:00100000:2.0:1787827124.371825:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787827124.371834:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728f00 x1874670272822656/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787827124.371842:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827124/real 1787827124]  req@ffff9ee0057292c0 x1874670272822016/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827149 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827124.371855:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057292c0 x1874670272822016/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827149 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827124.371862:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827124.371865:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827124.371868:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057292c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272822016:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787827124.371873:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272822144:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787827124.371894:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827124.371903:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827124/real 1787827124]  req@ffff9ee005729680 x1874670272822144/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827149 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827124.371914:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729680 x1874670272822144/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827149 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827124.371927:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827124.371930:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827124.371933:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272822144:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787827124.371939:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272822272:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787827124.371956:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827124.371967:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827124/real 1787827124]  req@ffff9ee00572bc00 x1874670272822272/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827149 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827124.371977:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572bc00 x1874670272822272/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827149 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827124.371984:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827124.371987:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827124.371990:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272822272:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787827124.371995:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272822400:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787827124.372011:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827124.372021:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827124/real 1787827124]  req@ffff9ee00572a940 x1874670272822400/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827149 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827124.372031:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a940 x1874670272822400/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827149 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827124.372038:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827124.372041:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827124.372045:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272822400:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787827124.372063:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272822528:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787827124.372081:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827124.372092:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827124/real 1787827124]  req@ffff9ee00572a1c0 x1874670272822528/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827149 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827124.372101:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a1c0 x1874670272822528/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827149 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827124.372107:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827124.372110:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827124.372112:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272822528:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787827124.372118:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272822656:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787827124.372134:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827124.372143:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827124/real 1787827124]  req@ffff9ee005728f00 x1874670272822656/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827149 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827124.372154:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728f00 x1874670272822656/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827149 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827124.372161:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827124.372164:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827124.372166:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272822656:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827125.203535:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827125.395513:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827126.227503:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827126.419440:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827127.251509:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827127.443407:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787827128.275655:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827128.467420:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827129.299510:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1787827129.491429:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1787827129.491444:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787827129.491452:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787827129.491457:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827129.491466:0:8:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2293
00000100:00080000:3.0:1787827129.491477:0:8:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827129.491484:0:8:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787827129.491519:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057052c0 x1874670272822784/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827129.491543:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827129.491547:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787827129.491549:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827129.491552:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2293
00000100:00080000:3.0:1787827129.491556:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827129.491560:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827129.491569:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787827129.491581:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057043c0 x1874670272822912/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827129.491591:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827129.491594:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787827129.491596:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827129.491601:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2293
00000100:00100000:0.0:1787827129.491603:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272822784:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787827129.491605:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827129.491613:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827129.491618:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827129.491631:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706580 x1874670272823040/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827129.491640:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827129.491643:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787827129.491645:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827129.491648:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2293
00000100:00080000:3.0:1787827129.491653:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827129.491657:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827129.491662:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:0.0:1787827129.491674:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827129.491675:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705680 x1874670272823168/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827129.491687:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827129.491690:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787827129.491692:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827129.491696:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2293
00000100:00080000:3.0:1787827129.491700:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827129.491704:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827129.491709:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787827129.491715:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827129/real 1787827129]  req@ffff9ee0057052c0 x1874670272822784/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827154 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827129.491723:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706940 x1874670272823296/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827129.491735:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1787827129.491738:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057052c0 x1874670272822784/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827154 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827129.491740:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787827129.491743:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827129.491752:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827129.491756:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2293
00000100:00080000:0.0:1787827129.491761:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:3.0:1787827129.491764:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1787827129.491769:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272822784:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787827129.491772:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827129.491780:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787827129.491784:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272822912:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787827129.491794:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707c00 x1874670272823424/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827129.491805:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827129.491807:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787827129.491809:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:0.0:1787827129.491812:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787827129.491815:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2293
00000100:00080000:3.0:1787827129.491820:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827129.491823:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827129.491828:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787827129.491831:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827129/real 1787827129]  req@ffff9ee0057043c0 x1874670272822912/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827154 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827129.491839:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704000 x1874670272823552/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787827129.491854:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057043c0 x1874670272822912/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827154 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827129.491863:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827129.491876:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827129.491883:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272822912:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787827129.491904:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272823040:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787827129.491923:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827129.491934:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827129/real 1787827129]  req@ffff9ee005706580 x1874670272823040/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827154 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827129.491950:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706580 x1874670272823040/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827154 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827129.491957:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827129.491959:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827129.491962:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272823040:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787827129.491968:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272823168:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787827129.491985:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827129.491994:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827129/real 1787827129]  req@ffff9ee005705680 x1874670272823168/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827154 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827129.492005:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705680 x1874670272823168/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827154 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827129.492012:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827129.492015:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827129.492018:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272823168:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787827129.492023:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272823296:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787827129.492039:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827129.492048:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827129/real 1787827129]  req@ffff9ee005706940 x1874670272823296/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827154 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827129.492064:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706940 x1874670272823296/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827154 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827129.492076:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827129.492079:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827129.492082:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272823296:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787827129.492087:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272823424:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787827129.492105:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827129.492115:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827129/real 1787827129]  req@ffff9ee005707c00 x1874670272823424/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827154 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827129.492126:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707c00 x1874670272823424/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827154 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827129.492133:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827129.492136:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827129.492139:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272823424:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787827129.492145:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272823552:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787827129.492166:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827129.492176:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827129/real 1787827129]  req@ffff9ee005704000 x1874670272823552/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827154 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827129.492186:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704000 x1874670272823552/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827154 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827129.492194:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827129.492197:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827129.492200:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272823552:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827130.323539:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827130.515461:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827131.347526:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827131.539412:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827132.371490:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827132.563411:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787827133.395500:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827133.587444:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827134.419502:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827134.611393:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787827134.611396:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827134.611405:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787827134.611409:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827134.611419:0:8:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2298
00000100:00080000:3.0:1787827134.611429:0:8:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827134.611436:0:8:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787827134.611472:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706d00 x1874670272823680/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827134.611509:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827134.611513:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787827134.611517:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827134.611523:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2298
00000100:00080000:3.0:1787827134.611527:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827134.611531:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827134.611540:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787827134.611553:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057070c0 x1874670272823808/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827134.611562:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827134.611565:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787827134.611567:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827134.611570:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2298
00000100:00080000:3.0:1787827134.611573:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827134.611576:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827134.611581:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827134.611591:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704000 x1874670272823936/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827134.611599:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827134.611601:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787827134.611602:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827134.611605:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2298
00000100:00080000:3.0:1787827134.611608:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827134.611611:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827134.611614:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827134.611622:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707c00 x1874670272824064/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827134.611629:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827134.611632:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787827134.611633:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827134.611636:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2298
00000100:00080000:3.0:1787827134.611639:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827134.611642:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827134.611645:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787827134.611653:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706940 x1874670272824192/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827134.611660:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827134.611663:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787827134.611665:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827134.611668:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2298
00000100:00080000:3.0:1787827134.611670:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827134.611673:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827134.611676:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827134.611684:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705680 x1874670272824320/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827134.611691:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827134.611694:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787827134.611695:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827134.611698:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2298
00000100:00080000:3.0:1787827134.611700:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827134.611703:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827134.611706:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827134.611713:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706580 x1874670272824448/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787827134.611789:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272823680:192.168.203.121@tcp:250:kworker.0
00000800:00000100:0.0:1787827134.611840:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827134.611874:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827134/real 1787827134]  req@ffff9ee005706d00 x1874670272823680/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827159 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827134.611889:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706d00 x1874670272823680/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827159 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827134.611897:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827134.611900:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827134.611903:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272823680:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787827134.611910:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272823808:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787827134.611929:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827134.611940:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827134/real 1787827134]  req@ffff9ee0057070c0 x1874670272823808/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827159 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827134.611951:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057070c0 x1874670272823808/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827159 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827134.611959:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827134.611961:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827134.611965:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272823808:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787827134.611970:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272823936:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787827134.611989:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827134.611997:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827134/real 1787827134]  req@ffff9ee005704000 x1874670272823936/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827159 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827134.612004:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704000 x1874670272823936/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827159 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827134.612009:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827134.612010:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827134.612012:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272823936:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787827134.612015:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272824064:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787827134.612025:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827134.612030:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827134/real 1787827134]  req@ffff9ee005707c00 x1874670272824064/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827159 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827134.612036:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707c00 x1874670272824064/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827159 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827134.612041:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827134.612042:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827134.612044:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272824064:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787827134.612047:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272824192:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787827134.612055:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827134.612060:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827134/real 1787827134]  req@ffff9ee005706940 x1874670272824192/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827159 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827134.612071:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706940 x1874670272824192/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827159 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827134.612078:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827134.612080:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827134.612083:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272824192:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787827134.612088:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272824320:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787827134.612106:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827134.612116:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827134/real 1787827134]  req@ffff9ee005705680 x1874670272824320/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827159 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827134.612127:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705680 x1874670272824320/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827159 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827134.612133:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827134.612136:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827134.612139:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272824320:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787827134.612145:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272824448:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787827134.612163:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827134.612173:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827134/real 1787827134]  req@ffff9ee005706580 x1874670272824448/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827159 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827134.612192:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706580 x1874670272824448/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827159 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827134.612201:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827134.612203:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827134.612205:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272824448:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827135.443497:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827135.635430:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827136.467478:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827136.659433:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827137.491653:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827137.683428:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787827138.515517:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827138.707451:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827139.540085:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1787827139.731423:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1787827139.731425:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787827139.731437:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787827139.731442:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827139.731451:0:8:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2303
00000100:00080000:3.0:1787827139.731466:0:8:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827139.731476:0:8:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787827139.731511:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057043c0 x1874670272824576/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827139.731537:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827139.731541:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787827139.731543:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827139.731547:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2303
00000100:00080000:3.0:1787827139.731551:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827139.731556:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827139.731575:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787827139.731583:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272824576:192.168.203.121@tcp:250:kworker.0
00000100:00100000:3.0:1787827139.731590:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057052c0 x1874670272824704/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827139.731600:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827139.731602:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787827139.731604:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827139.731606:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2303
00000100:00080000:3.0:1787827139.731610:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827139.731613:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827139.731617:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827139.731629:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704b40 x1874670272824832/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827139.731643:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827139.731646:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000800:00000100:1.0:1787827139.731650:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787827139.731650:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827139.731658:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2303
00000100:00080000:3.0:1787827139.731662:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827139.731665:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827139.731670:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827139.731682:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707480 x1874670272824960/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827139.731691:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1787827139.731696:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827139/real 1787827139]  req@ffff9ee0057043c0 x1874670272824576/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827164 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827139.731700:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787827139.731705:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827139.731714:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2303
00000100:00080000:3.0:1787827139.731717:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1787827139.731721:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057043c0 x1874670272824576/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827164 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827139.731725:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827139.731732:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00080000:1.0:1787827139.731738:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:3.0:1787827139.731745:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057061c0 x1874670272825088/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827139.731746:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827139.731754:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272824576:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787827139.731761:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827139.731765:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787827139.731766:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827139.731770:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2303
00000100:00080000:3.0:1787827139.731774:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827139.731778:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787827139.731782:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272824704:192.168.203.121@tcp:38:kworker.0
00000008:00100000:3.0:1787827139.731783:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1787827139.731809:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827139.731818:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827139/real 1787827139]  req@ffff9ee0057052c0 x1874670272824704/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827164 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827139.731826:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057052c0 x1874670272824704/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827164 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827139.731840:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827139.731843:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827139.731846:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272824704:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787827139.731851:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705a40 x1874670272825216/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787827139.731854:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272824832:192.168.203.121@tcp:8:kworker.0
00000100:00080000:3.0:1787827139.731870:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:1.0:1787827139.731875:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787827139.731875:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787827139.731879:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827139.731885:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2303
00000100:00100000:1.0:1787827139.731888:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827139/real 1787827139]  req@ffff9ee005704b40 x1874670272824832/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827164 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827139.731896:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704b40 x1874670272824832/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827164 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827139.731901:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827139.731903:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827139.731905:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272824832:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827139.731911:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272824960:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827139.731929:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827139.731939:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827139/real 1787827139]  req@ffff9ee005707480 x1874670272824960/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827164 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827139.731961:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707480 x1874670272824960/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827164 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827139.731969:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827139.731972:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827139.731975:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272824960:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827139.731983:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272825088:192.168.203.121@tcp:38:kworker.0
00000100:00080000:3.0:1787827139.731983:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827139.731991:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827139.731997:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1787827139.732011:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827139.732022:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704780 x1874670272825344/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787827139.732025:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827139/real 1787827139]  req@ffff9ee0057061c0 x1874670272825088/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827164 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827139.732040:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057061c0 x1874670272825088/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827164 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827139.732047:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827139.732050:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827139.732053:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272825088:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787827139.732069:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272825216:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827139.732089:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827139.732104:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827139/real 1787827139]  req@ffff9ee005705a40 x1874670272825216/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827164 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827139.732112:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705a40 x1874670272825216/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827164 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827139.732117:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827139.732119:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827139.732122:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272825216:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827139.732129:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272825344:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827139.732152:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827139.732163:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827139/real 1787827139]  req@ffff9ee005704780 x1874670272825344/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827164 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827139.732174:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704780 x1874670272825344/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827164 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827139.732181:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827139.732183:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827139.732187:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272825344:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827140.563642:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827140.755438:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827141.587508:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827141.779456:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827142.611498:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827142.803429:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787827143.635520:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827143.827463:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827144.659508:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1787827144.851433:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827144.851443:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787827144.851448:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827144.851458:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2308
00000100:00100000:3.0:1787827144.851464:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:2.0:1787827144.851470:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827144.851478:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787827144.851515:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b840 x1874670272825472/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827144.851538:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827144.851542:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787827144.851544:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827144.851548:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2308
00000100:00080000:2.0:1787827144.851552:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827144.851557:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827144.851567:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787827144.851580:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057283c0 x1874670272825600/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787827144.851582:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272825472:192.168.203.121@tcp:250:kworker.0
00000100:00080000:2.0:1787827144.851597:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827144.851600:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787827144.851602:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827144.851606:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2308
00000100:00080000:2.0:1787827144.851609:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827144.851613:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827144.851618:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787827144.851628:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729e00 x1874670272825728/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827144.851637:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827144.851640:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787827144.851641:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827144.851645:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2308
00000800:00000100:1.0:1787827144.851650:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:2.0:1787827144.851652:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827144.851659:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827144.851664:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787827144.851675:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728000 x1874670272825856/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827144.851683:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827144.851685:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787827144.851687:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827144.851691:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2308
00000100:00080000:2.0:1787827144.851694:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827144.851697:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827144.851700:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787827144.851715:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827144/real 1787827144]  req@ffff9ee00572b840 x1874670272825472/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827169 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827144.851715:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a580 x1874670272825984/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827144.851741:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827144.851745:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787827144.851747:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1787827144.851751:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b840 x1874670272825472/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827169 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827144.851753:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2308
00000100:00080000:2.0:1787827144.851759:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827144.851766:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00080000:1.0:1787827144.851768:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000008:00100000:2.0:1787827144.851772:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:1.0:1787827144.851776:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827144.851782:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272825472:192.168.203.121@tcp:250:kworker.0
00000100:00100000:2.0:1787827144.851785:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728b40 x1874670272826112/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827144.851800:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827144.851803:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787827144.851805:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1787827144.851809:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272825600:192.168.203.121@tcp:38:kworker.0
00000100:00080000:2.0:1787827144.851811:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2308
00000100:00080000:2.0:1787827144.851817:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827144.851822:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827144.851826:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787827144.851837:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729a40 x1874670272826240/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1787827144.851843:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827144.851862:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827144/real 1787827144]  req@ffff9ee0057283c0 x1874670272825600/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827169 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827144.851875:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057283c0 x1874670272825600/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827169 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827144.851883:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827144.851886:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827144.851889:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272825600:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787827144.851894:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272825728:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827144.851913:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827144.851924:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827144/real 1787827144]  req@ffff9ee005729e00 x1874670272825728/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827169 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827144.851935:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729e00 x1874670272825728/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827169 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827144.851942:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827144.851945:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827144.851948:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272825728:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827144.851954:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272825856:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827144.851972:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827144.851981:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827144/real 1787827144]  req@ffff9ee005728000 x1874670272825856/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827169 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827144.851992:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728000 x1874670272825856/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827169 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827144.851999:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827144.852002:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827144.852004:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272825856:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827144.852010:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272825984:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787827144.852026:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827144.852048:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827144/real 1787827144]  req@ffff9ee00572a580 x1874670272825984/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827169 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827144.852060:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a580 x1874670272825984/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827169 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827144.852066:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827144.852068:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827144.852071:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272825984:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787827144.852076:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272826112:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827144.852095:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827144.852105:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827144/real 1787827144]  req@ffff9ee005728b40 x1874670272826112/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827169 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827144.852116:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728b40 x1874670272826112/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827169 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827144.852121:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827144.852122:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827144.852125:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272826112:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827144.852140:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272826240:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827144.852155:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827144.852165:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827144/real 1787827144]  req@ffff9ee005729a40 x1874670272826240/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827169 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827144.852175:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729a40 x1874670272826240/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827169 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827144.852183:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827144.852185:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827144.852199:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272826240:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827145.683495:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827145.875438:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827146.707517:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827146.899439:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827147.731468:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827147.923441:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787827148.755496:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827148.947411:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827149.779563:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1787827149.971429:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1787827149.971440:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787827149.971440:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787827149.971445:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827149.971456:0:8:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2313
00000100:00080000:3.0:1787827149.971466:0:8:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827149.971474:0:8:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787827149.971522:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705e00 x1874670272826368/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827149.971556:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827149.971564:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787827149.971566:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827149.971570:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2313
00000100:00080000:3.0:1787827149.971574:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827149.971579:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827149.971588:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787827149.971600:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707840 x1874670272826496/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827149.971610:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827149.971613:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787827149.971614:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827149.971618:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2313
00000100:00080000:3.0:1787827149.971621:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827149.971626:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827149.971630:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827149.971642:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704780 x1874670272826624/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827149.971652:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827149.971655:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787827149.971657:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827149.971660:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2313
00000100:00080000:3.0:1787827149.971664:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827149.971668:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827149.971672:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827149.971683:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705a40 x1874670272826752/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827149.971695:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1787827149.971697:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272826368:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787827149.971699:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787827149.971703:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827149.971709:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2313
00000100:00080000:3.0:1787827149.971712:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827149.971717:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827149.971721:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787827149.971734:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057061c0 x1874670272826880/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827149.971743:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827149.971746:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787827149.971749:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827149.971752:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2313
00000100:00080000:3.0:1787827149.971757:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000800:00000100:1.0:1787827149.971762:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787827149.971766:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827149.971772:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827149.971785:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707480 x1874670272827008/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827149.971794:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827149.971796:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787827149.971798:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827149.971802:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2313
00000100:00080000:3.0:1787827149.971805:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827149.971809:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827149.971813:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787827149.971822:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827149/real 1787827149]  req@ffff9ee005705e00 x1874670272826368/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827174 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827149.971827:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704b40 x1874670272827136/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787827149.971849:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705e00 x1874670272826368/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827174 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827149.971860:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827149.971864:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827149.971868:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272826368:192.168.203.121@tcp:250:kworker.0
00000100:00100000:1.0:1787827149.971875:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272826496:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787827149.971896:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827149.971909:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827149/real 1787827149]  req@ffff9ee005707840 x1874670272826496/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827174 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827149.971920:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707840 x1874670272826496/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827174 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827149.971929:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827149.971932:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827149.971935:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272826496:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787827149.971941:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272826624:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827149.972074:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827149.972086:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827149/real 1787827149]  req@ffff9ee005704780 x1874670272826624/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827174 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827149.972097:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704780 x1874670272826624/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827174 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827149.972105:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827149.972107:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827149.972111:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272826624:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827149.972133:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272826752:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827149.972163:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827149.972176:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827149/real 1787827149]  req@ffff9ee005705a40 x1874670272826752/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827174 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827149.972186:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705a40 x1874670272826752/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827174 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827149.972194:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827149.972197:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827149.972200:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272826752:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827149.972206:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272826880:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787827149.972223:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827149.972233:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827149/real 1787827149]  req@ffff9ee0057061c0 x1874670272826880/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827174 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827149.972243:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057061c0 x1874670272826880/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827174 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827149.972260:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827149.972267:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827149.972270:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272826880:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787827149.972276:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272827008:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827149.972293:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827149.972304:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827149/real 1787827149]  req@ffff9ee005707480 x1874670272827008/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827174 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827149.972338:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707480 x1874670272827008/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827174 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827149.972345:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827149.972349:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827149.972353:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272827008:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827149.972358:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272827136:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827149.972376:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827149.972387:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827149/real 1787827149]  req@ffff9ee005704b40 x1874670272827136/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827174 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827149.972398:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704b40 x1874670272827136/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827174 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827149.972404:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827149.972407:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827149.972411:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272827136:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827150.803494:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827150.995435:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827151.827518:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787827152.020581:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827152.851521:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787827153.043571:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787827153.875508:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787827154.067664:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827154.899516:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787827155.092165:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:2.0:1787827155.092634:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827155.092640:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787827155.092644:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827155.092653:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2318
00000100:00080000:2.0:1787827155.092664:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827155.092671:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787827155.092702:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572ad00 x1874670272827264/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787827155.092766:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272827264:192.168.203.121@tcp:250:kworker.0
00000800:00000100:1.0:1787827155.092823:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:2.0:1787827155.092854:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827155.092858:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787827155.092860:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827155.092865:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2318
00000100:00080000:2.0:1787827155.092868:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827155.092872:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827155.092880:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787827155.092893:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b480 x1874670272827392/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787827155.093214:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827155/real 1787827155]  req@ffff9ee00572ad00 x1874670272827264/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827180 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827155.093231:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572ad00 x1874670272827264/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827180 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827155.093243:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827155.093248:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827155.093251:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272827264:192.168.203.121@tcp:250:kworker.0
00000100:00100000:1.0:1787827155.093275:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272827392:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787827155.093299:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827155.093312:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827155/real 1787827155]  req@ffff9ee00572b480 x1874670272827392/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827180 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827155.093360:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b480 x1874670272827392/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827180 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827155.093368:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827155.093371:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827155.093374:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272827392:192.168.203.121@tcp:38:kworker.0
00000100:00080000:2.0:1787827155.093449:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827155.093453:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787827155.093455:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827155.093459:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2318
00000100:00080000:2.0:1787827155.093463:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827155.093467:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827155.093472:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787827155.093484:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b0c0 x1874670272827520/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827155.093493:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827155.093496:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787827155.093498:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827155.093501:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2318
00000100:00080000:2.0:1787827155.093504:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827155.093506:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827155.093510:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787827155.093520:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b480 x1874670272827648/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827155.093528:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827155.093531:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787827155.093532:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827155.093536:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2318
00000100:00080000:2.0:1787827155.093539:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827155.093543:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827155.093548:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787827155.093567:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572ad00 x1874670272827776/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827155.093579:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827155.093582:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787827155.093584:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827155.093587:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2318
00000100:00080000:2.0:1787827155.093591:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827155.093594:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827155.093598:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787827155.093608:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729a40 x1874670272827904/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827155.093616:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827155.093618:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787827155.093620:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827155.093623:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2318
00000100:00080000:2.0:1787827155.093626:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827155.093630:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827155.093634:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787827155.093643:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728b40 x1874670272828032/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787827155.093811:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272827520:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827155.093836:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827155.093921:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827155/real 1787827155]  req@ffff9ee00572b0c0 x1874670272827520/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827180 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827155.093933:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b0c0 x1874670272827520/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827180 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827155.093942:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827155.093945:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827155.093948:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272827520:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827155.093954:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272827648:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827155.093973:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827155.093983:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827155/real 1787827155]  req@ffff9ee00572b480 x1874670272827648/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827180 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827155.093995:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b480 x1874670272827648/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827180 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827155.094003:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827155.094006:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827155.094009:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272827648:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827155.094014:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272827776:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787827155.094032:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827155.094041:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827155/real 1787827155]  req@ffff9ee00572ad00 x1874670272827776/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827180 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827155.094049:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572ad00 x1874670272827776/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827180 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827155.094053:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827155.094055:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827155.094057:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272827776:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787827155.094060:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272827904:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827155.094070:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827155.094075:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827155/real 1787827155]  req@ffff9ee005729a40 x1874670272827904/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827180 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827155.094081:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729a40 x1874670272827904/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827180 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827155.094089:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827155.094091:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827155.094092:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272827904:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827155.094095:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272828032:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827155.094103:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827155.094108:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827155/real 1787827155]  req@ffff9ee005728b40 x1874670272828032/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827180 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827155.094113:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728b40 x1874670272828032/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827180 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827155.094130:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827155.094133:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827155.094136:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272828032:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827155.923487:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787827156.115762:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827156.947528:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787827157.139941:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827157.971556:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787827158.163447:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787827158.995908:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787827159.187440:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827160.020504:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787827160.211567:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787827160.211574:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827160.211582:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787827160.211588:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827160.211600:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2323
00000100:00080000:3.0:1787827160.211615:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827160.211626:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787827160.211686:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057052c0 x1874670272828160/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827160.211722:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827160.211726:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787827160.211728:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827160.211732:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2323
00000100:00080000:3.0:1787827160.211736:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827160.211740:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827160.211752:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787827160.211765:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057043c0 x1874670272828288/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827160.211775:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827160.211779:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787827160.211781:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827160.211785:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2323
00000100:00080000:3.0:1787827160.211788:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827160.211792:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827160.211797:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827160.211807:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706580 x1874670272828416/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827160.211817:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827160.211833:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787827160.211835:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827160.211839:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2323
00000100:00080000:3.0:1787827160.211843:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827160.211847:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827160.211852:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827160.211863:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705680 x1874670272828544/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827160.211881:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827160.211884:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787827160.211886:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827160.211890:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2323
00000100:00080000:3.0:1787827160.211894:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827160.211898:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827160.211903:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787827160.211914:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706940 x1874670272828672/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827160.211922:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827160.211926:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787827160.211928:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827160.211931:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2323
00000100:00080000:3.0:1787827160.211934:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827160.211938:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827160.211942:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827160.211962:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707c00 x1874670272828800/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827160.211970:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827160.211973:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787827160.211974:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827160.211978:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2323
00000100:00080000:3.0:1787827160.211981:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827160.211984:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827160.211989:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827160.211998:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704000 x1874670272828928/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787827160.212252:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272828160:192.168.203.121@tcp:250:kworker.0
00000800:00000100:0.0:1787827160.212368:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827160.212412:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827160/real 1787827160]  req@ffff9ee0057052c0 x1874670272828160/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827185 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827160.212430:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057052c0 x1874670272828160/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827185 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827160.212442:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827160.212446:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827160.212450:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272828160:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787827160.212458:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272828288:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787827160.212482:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827160.212494:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827160/real 1787827160]  req@ffff9ee0057043c0 x1874670272828288/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827185 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827160.212505:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057043c0 x1874670272828288/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827185 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827160.212514:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827160.212517:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827160.212520:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272828288:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787827160.212526:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272828416:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787827160.212547:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827160.212558:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827160/real 1787827160]  req@ffff9ee005706580 x1874670272828416/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827185 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827160.212569:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706580 x1874670272828416/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827185 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827160.212577:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827160.212580:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827160.212583:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272828416:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787827160.212590:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272828544:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787827160.212606:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827160.212614:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827160/real 1787827160]  req@ffff9ee005705680 x1874670272828544/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827185 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827160.212625:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705680 x1874670272828544/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827185 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827160.212632:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827160.212635:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827160.212638:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272828544:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787827160.212644:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272828672:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787827160.212661:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827160.212671:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827160/real 1787827160]  req@ffff9ee005706940 x1874670272828672/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827185 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827160.212681:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706940 x1874670272828672/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827185 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827160.212688:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827160.212691:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827160.212693:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272828672:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787827160.212699:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272828800:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787827160.212715:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827160.212725:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827160/real 1787827160]  req@ffff9ee005707c00 x1874670272828800/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827185 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827160.212736:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707c00 x1874670272828800/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827185 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827160.212742:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827160.212744:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827160.212746:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272828800:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787827160.212750:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272828928:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787827160.212763:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827160.212770:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827160/real 1787827160]  req@ffff9ee005704000 x1874670272828928/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827185 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827160.212777:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704000 x1874670272828928/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827185 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827160.212781:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827160.212783:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827160.212784:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272828928:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827161.043632:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827161.236340:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827162.067525:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827162.259453:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827163.092863:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827163.283499:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787827164.115523:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827164.307429:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827165.139479:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1787827165.331417:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1787827165.331418:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:2.0:1787827165.331423:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787827165.331427:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827165.331436:0:8:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2329
00000100:00080000:2.0:1787827165.331445:0:8:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827165.331452:0:8:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787827165.331484:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a580 x1874670272829056/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827165.331508:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827165.331511:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787827165.331513:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827165.331517:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2329
00000100:00080000:2.0:1787827165.331520:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827165.331525:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827165.331534:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787827165.331547:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728000 x1874670272829184/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787827165.331557:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272829056:192.168.203.121@tcp:250:kworker.0
00000100:00080000:2.0:1787827165.331560:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827165.331566:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787827165.331568:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827165.331572:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2329
00000100:00080000:2.0:1787827165.331576:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827165.331580:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827165.331585:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787827165.331597:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729e00 x1874670272829312/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827165.331605:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827165.331608:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787827165.331610:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:0.0:1787827165.331615:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:2.0:1787827165.331616:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2329
00000100:00080000:2.0:1787827165.331623:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827165.331628:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827165.331632:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787827165.331643:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057283c0 x1874670272829440/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827165.331653:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1787827165.331655:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827165/real 1787827165]  req@ffff9ee00572a580 x1874670272829056/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827190 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827165.331658:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787827165.331662:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827165.331671:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2329
00000100:00080000:2.0:1787827165.331677:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1787827165.331683:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a580 x1874670272829056/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827190 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827165.331684:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827165.331692:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00080000:0.0:1787827165.331699:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827165.331704:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827165.331709:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b840 x1874670272829568/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787827165.331712:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272829056:192.168.203.121@tcp:250:kworker.0
00000100:00080000:2.0:1787827165.331726:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827165.331729:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787827165.331731:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827165.331736:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2329
00000100:00100000:0.0:1787827165.331740:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272829184:192.168.203.121@tcp:38:kworker.0
00000100:00080000:2.0:1787827165.331742:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827165.331750:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827165.331755:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:0.0:1787827165.331766:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827165.331770:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728f00 x1874670272829696/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787827165.331781:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827165/real 1787827165]  req@ffff9ee005728000 x1874670272829184/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827190 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827165.331782:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827165.331790:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787827165.331792:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827165.331797:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2329
00000100:00080000:2.0:1787827165.331804:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1787827165.331811:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728000 x1874670272829184/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827190 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827165.331818:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00080000:0.0:1787827165.331820:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000008:00100000:2.0:1787827165.331825:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:0.0:1787827165.331827:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827165.331832:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272829184:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787827165.331837:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a1c0 x1874670272829824/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787827165.331841:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272829312:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787827165.331864:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827165.331875:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827165/real 1787827165]  req@ffff9ee005729e00 x1874670272829312/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827190 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827165.331886:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729e00 x1874670272829312/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827190 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827165.331893:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827165.331896:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827165.331899:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272829312:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787827165.331904:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272829440:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787827165.331916:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827165.331923:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827165/real 1787827165]  req@ffff9ee0057283c0 x1874670272829440/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827190 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827165.331933:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057283c0 x1874670272829440/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827190 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827165.331940:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827165.331942:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827165.331946:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272829440:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787827165.331951:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272829568:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787827165.331963:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827165.331970:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827165/real 1787827165]  req@ffff9ee00572b840 x1874670272829568/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827190 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827165.331980:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b840 x1874670272829568/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827190 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827165.331987:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827165.331990:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827165.331992:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272829568:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787827165.332008:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272829696:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787827165.332020:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827165.332027:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827165/real 1787827165]  req@ffff9ee005728f00 x1874670272829696/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827190 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827165.332038:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728f00 x1874670272829696/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827190 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827165.332058:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827165.332061:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827165.332064:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272829696:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787827165.332070:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272829824:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787827165.332085:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827165.332094:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827165/real 1787827165]  req@ffff9ee00572a1c0 x1874670272829824/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827190 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827165.332104:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a1c0 x1874670272829824/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827190 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827165.332111:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827165.332114:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827165.332117:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272829824:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827166.163564:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827166.355460:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827167.187497:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827167.379789:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827168.211504:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827168.403413:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787827169.235490:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827169.427425:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827170.260213:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1787827170.451422:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827170.451432:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00100000:2.0:1787827170.451442:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787827170.451444:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827170.451456:0:8:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2334
00000100:00080000:3.0:1787827170.451466:0:8:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827170.451474:0:8:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787827170.451513:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057070c0 x1874670272829952/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827170.451539:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827170.451543:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787827170.451545:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827170.451548:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2334
00000100:00080000:3.0:1787827170.451552:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827170.451556:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827170.451566:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787827170.451578:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706d00 x1874670272830080/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787827170.451585:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272829952:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787827170.451593:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827170.451597:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787827170.451599:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827170.451602:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2334
00000100:00080000:3.0:1787827170.451606:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827170.451610:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827170.451616:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827170.451629:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704000 x1874670272830208/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827170.451638:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827170.451641:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787827170.451644:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:0.0:1787827170.451646:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787827170.451651:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2334
00000100:00080000:3.0:1787827170.451656:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827170.451669:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827170.451675:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787827170.451685:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827170/real 1787827170]  req@ffff9ee0057070c0 x1874670272829952/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827195 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827170.451688:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707c00 x1874670272830336/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827170.451711:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827170.451714:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787827170.451715:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1787827170.451720:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057070c0 x1874670272829952/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827195 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827170.451721:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2334
00000100:00080000:0.0:1787827170.451735:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827170.451736:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827170.451741:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:3.0:1787827170.451744:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787827170.451749:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272829952:192.168.203.121@tcp:250:kworker.0
00000008:00100000:3.0:1787827170.451752:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787827170.451766:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706940 x1874670272830464/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827170.451776:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1787827170.451779:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272830080:192.168.203.121@tcp:38:kworker.0
00000100:00080000:3.0:1787827170.451781:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787827170.451785:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827170.451790:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2334
00000100:00080000:3.0:1787827170.451794:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827170.451798:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827170.451803:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827170.451815:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705680 x1874670272830592/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1787827170.451820:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787827170.451828:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1787827170.451838:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827170/real 1787827170]  req@ffff9ee005706d00 x1874670272830080/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827195 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827170.451842:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787827170.451847:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827170.451854:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2334
00000100:00080000:3.0:1787827170.451858:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1787827170.451859:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706d00 x1874670272830080/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827195 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827170.451866:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827170.451874:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:0.0:1787827170.451886:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:3.0:1787827170.451886:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706580 x1874670272830720/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827170.451898:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827170.451906:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272830080:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787827170.451914:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272830208:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787827170.451935:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827170.451946:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827170/real 1787827170]  req@ffff9ee005704000 x1874670272830208/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827195 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827170.451957:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704000 x1874670272830208/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827195 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827170.451965:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827170.451968:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827170.451971:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272830208:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787827170.451977:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272830336:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787827170.451995:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827170.452020:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827170/real 1787827170]  req@ffff9ee005707c00 x1874670272830336/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827195 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827170.452032:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707c00 x1874670272830336/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827195 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827170.452039:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827170.452042:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827170.452046:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272830336:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787827170.452060:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272830464:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787827170.452079:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827170.452089:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827170/real 1787827170]  req@ffff9ee005706940 x1874670272830464/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827195 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827170.452100:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706940 x1874670272830464/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827195 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827170.452108:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827170.452111:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827170.452114:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272830464:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787827170.452119:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272830592:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787827170.452137:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827170.452148:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827170/real 1787827170]  req@ffff9ee005705680 x1874670272830592/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827195 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827170.452159:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705680 x1874670272830592/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827195 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827170.452166:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827170.452169:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827170.452172:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272830592:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787827170.452178:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272830720:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787827170.452196:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827170.452207:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827170/real 1787827170]  req@ffff9ee005706580 x1874670272830720/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827195 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827170.452231:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706580 x1874670272830720/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827195 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827170.452239:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827170.452242:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827170.452245:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272830720:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827171.283502:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827171.475409:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827172.307538:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827172.499542:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827173.331568:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827173.523497:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787827174.355544:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827174.547427:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827175.379459:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827175.571475:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787827175.571475:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827175.571485:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787827175.571489:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827175.571501:0:8:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2339
00000100:00080000:3.0:1787827175.571511:0:8:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827175.571517:0:8:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787827175.571549:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057043c0 x1874670272830848/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827175.571570:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827175.571574:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787827175.571577:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827175.571581:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2339
00000100:00080000:3.0:1787827175.571584:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827175.571588:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827175.571596:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787827175.571609:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057052c0 x1874670272830976/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827175.571620:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827175.571623:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787827175.571626:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1787827175.571628:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272830848:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787827175.571632:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2339
00000100:00080000:3.0:1787827175.571638:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827175.571642:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827175.571647:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827175.571659:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704b40 x1874670272831104/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827175.571666:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827175.571668:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787827175.571669:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827175.571672:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2339
00000100:00080000:3.0:1787827175.571675:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827175.571677:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827175.571680:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:0.0:1787827175.571681:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827175.571691:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707480 x1874670272831232/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827175.571698:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827175.571700:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787827175.571701:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827175.571704:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2339
00000100:00080000:3.0:1787827175.571706:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827175.571709:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827175.571711:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787827175.571715:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827175/real 1787827175]  req@ffff9ee0057043c0 x1874670272830848/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827200 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827175.571720:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057061c0 x1874670272831360/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827175.571734:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827175.571736:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787827175.571737:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827175.571741:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2339
00000100:00100000:0.0:1787827175.571743:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057043c0 x1874670272830848/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827200 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827175.571743:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827175.571747:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827175.571752:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827175.571760:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705a40 x1874670272831488/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827175.571763:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827175.571766:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827175.571769:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787827175.571771:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:3.0:1787827175.571771:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1787827175.571776:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272830848:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787827175.571777:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2339
00000100:00080000:3.0:1787827175.571783:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827175.571786:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827175.571788:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827175.571793:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704780 x1874670272831616/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787827175.571801:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272830976:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787827175.571822:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827175.571832:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827175/real 1787827175]  req@ffff9ee0057052c0 x1874670272830976/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827200 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827175.571841:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057052c0 x1874670272830976/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827200 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827175.571848:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827175.571850:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827175.571853:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272830976:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787827175.571858:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272831104:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787827175.571873:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827175.571881:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827175/real 1787827175]  req@ffff9ee005704b40 x1874670272831104/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827200 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827175.571888:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704b40 x1874670272831104/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827200 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827175.571893:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827175.571895:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827175.571898:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272831104:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787827175.571905:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272831232:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787827175.571924:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827175.571940:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827175/real 1787827175]  req@ffff9ee005707480 x1874670272831232/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827200 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827175.571952:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707480 x1874670272831232/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827200 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827175.571960:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827175.571964:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827175.571968:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272831232:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787827175.571989:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272831360:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787827175.572020:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827175.572034:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827175/real 1787827175]  req@ffff9ee0057061c0 x1874670272831360/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827200 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827175.572042:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057061c0 x1874670272831360/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827200 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827175.572048:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827175.572050:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827175.572052:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272831360:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787827175.572057:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272831488:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787827175.572070:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827175.572079:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827175/real 1787827175]  req@ffff9ee005705a40 x1874670272831488/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827200 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827175.572086:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705a40 x1874670272831488/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827200 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827175.572090:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827175.572091:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827175.572093:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272831488:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787827175.572104:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272831616:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787827175.572113:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827175.572119:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827175/real 1787827175]  req@ffff9ee005704780 x1874670272831616/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827200 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827175.572125:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704780 x1874670272831616/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827200 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827175.572129:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827175.572131:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827175.572132:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272831616:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827176.403497:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827176.595425:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827177.427428:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827177.619417:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827178.451475:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827178.643456:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787827179.475456:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827179.667402:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827180.499491:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827180.691425:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787827180.691444:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827180.691454:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787827180.691460:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827180.691472:0:8:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2344
00000100:00080000:3.0:1787827180.691486:0:8:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827180.691495:0:8:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787827180.691540:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707840 x1874670272831744/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827180.691571:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827180.691575:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787827180.691577:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827180.691581:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2344
00000100:00080000:3.0:1787827180.691584:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827180.691590:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827180.691602:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787827180.691616:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272831744:192.168.203.121@tcp:250:kworker.0
00000100:00100000:3.0:1787827180.691619:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705e00 x1874670272831872/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827180.691633:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827180.691637:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787827180.691639:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827180.691644:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2344
00000100:00080000:3.0:1787827180.691648:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827180.691653:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827180.691659:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827180.691674:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704780 x1874670272832000/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1787827180.691678:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787827180.691692:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827180.691696:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787827180.691698:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827180.691703:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2344
00000100:00080000:3.0:1787827180.691708:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827180.691716:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787827180.691717:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827180/real 1787827180]  req@ffff9ee005707840 x1874670272831744/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827205 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:3.0:1787827180.691729:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787827180.691737:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707840 x1874670272831744/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827205 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827180.691748:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:3.0:1787827180.691749:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705a40 x1874670272832128/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827180.691758:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827180.691770:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272831744:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787827180.691790:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827180.691794:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787827180.691797:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1787827180.691801:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272831872:192.168.203.121@tcp:38:kworker.0
00000100:00080000:3.0:1787827180.691806:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2344
00000100:00080000:3.0:1787827180.691816:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827180.691823:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000800:00000100:0.0:1787827180.691832:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000008:00100000:3.0:1787827180.691837:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787827180.691844:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827180/real 1787827180]  req@ffff9ee005705e00 x1874670272831872/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827205 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827180.691857:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057061c0 x1874670272832256/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787827180.691863:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705e00 x1874670272831872/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827205 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827180.691887:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827180.691887:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827180.691897:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00080000:3.0:1787827180.691904:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00100000:0.0:1787827180.691905:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272831872:192.168.203.121@tcp:38:kworker.0
00000100:00080000:3.0:1787827180.691911:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1787827180.691915:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272832000:192.168.203.121@tcp:8:kworker.0
00000100:00080000:3.0:1787827180.691921:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2344
00000100:00080000:3.0:1787827180.691929:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000800:00000100:0.0:1787827180.691936:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787827180.691937:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827180.691958:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787827180.691963:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827180/real 1787827180]  req@ffff9ee005704780 x1874670272832000/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827205 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827180.691973:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704780 x1874670272832000/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827205 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827180.691980:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707480 x1874670272832384/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827180.691985:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827180.691993:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827180.692004:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272832000:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787827180.692018:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272832128:192.168.203.121@tcp:8:kworker.0
00000100:00080000:3.0:1787827180.692019:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827180.692028:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787827180.692031:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827180.692037:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2344
00000800:00000100:0.0:1787827180.692042:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787827180.692047:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1787827180.692054:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827180/real 1787827180]  req@ffff9ee005705a40 x1874670272832128/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827205 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827180.692058:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827180.692075:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787827180.692078:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705a40 x1874670272832128/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827205 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827180.692087:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827180.692089:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827180.692093:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272832128:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787827180.692099:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704b40 x1874670272832512/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787827180.692111:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272832256:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787827180.692128:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827180.692135:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827180/real 1787827180]  req@ffff9ee0057061c0 x1874670272832256/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827205 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827180.692142:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057061c0 x1874670272832256/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827205 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827180.692147:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827180.692149:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827180.692151:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272832256:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787827180.692155:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272832384:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787827180.692163:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827180.692169:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827180/real 1787827180]  req@ffff9ee005707480 x1874670272832384/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827205 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827180.692175:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707480 x1874670272832384/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827205 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827180.692179:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827180.692180:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827180.692182:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272832384:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787827180.692188:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272832512:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787827180.692197:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827180.692203:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827180/real 1787827180]  req@ffff9ee005704b40 x1874670272832512/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827205 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827180.692209:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704b40 x1874670272832512/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827205 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827180.692213:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827180.692214:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827180.692216:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272832512:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827181.523433:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827181.715419:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827182.547454:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827182.739405:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827183.571448:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827183.763430:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787827184.595495:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827184.787439:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827185.619493:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1787827185.811425:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1787827185.811426:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:0.0:1787827185.811435:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1787827185.811440:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827185.811450:0:8:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2349
00000100:00080000:0.0:1787827185.811460:0:8:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827185.811467:0:8:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787827185.811497:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ebc00 x1874670272832640/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827185.811518:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827185.811520:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787827185.811521:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827185.811524:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2349
00000100:00080000:0.0:1787827185.811527:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827185.811529:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827185.811536:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787827185.811544:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8f00 x1874670272832768/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827185.811551:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827185.811552:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787827185.811553:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827185.811556:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2349
00000100:00080000:0.0:1787827185.811557:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827185.811559:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827185.811562:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787827185.811570:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272832640:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787827185.811573:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb840 x1874670272832896/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827185.811586:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827185.811590:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787827185.811591:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827185.811595:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2349
00000100:00080000:0.0:1787827185.811599:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827185.811603:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827185.811608:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787827185.811618:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9680 x1874670272833024/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827185.811624:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827185.811626:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787827185.811628:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827185.811631:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2349
00000100:00080000:0.0:1787827185.811634:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827185.811636:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827185.811639:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787827185.811647:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e92c0 x1874670272833152/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827185.811653:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827185.811655:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787827185.811657:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827185.811662:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2349
00000100:00100000:1.0:1787827185.811663:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272832768:192.168.203.121@tcp:38:kworker.0
00000100:00080000:0.0:1787827185.811664:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827185.811669:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827185.811675:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787827185.811684:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e83c0 x1874670272833280/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827185.811700:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827185.811703:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787827185.811705:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1787827185.811709:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272832896:192.168.203.121@tcp:8:kworker.0
00000100:00080000:0.0:1787827185.811710:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2349
00000100:00080000:0.0:1787827185.811718:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827185.811724:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827185.811730:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787827185.811744:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8000 x1874670272833408/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787827185.811753:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272833024:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827185.811779:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272833152:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787827185.811800:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272833280:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827185.811826:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272833408:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827186.643505:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827186.835491:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827187.667485:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827187.859473:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827188.691475:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827188.883531:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000400:00000100:1.0:1787827188.883630:0:2352:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.203.121:988
00000400:00000100:1.0:1787827188.883667:0:2352:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.203.121@tcp at host 192.168.203.121 was unreachable: the network or that node may be down, or Lustre may be misconfigured.
00000800:00000100:1.0:1787827188.883684:0:2352:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:1.0:1787827188.883731:0:2352:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:1.0:1787827188.883742:0:2352:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:1.0:1787827188.883749:0:2352:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:1.0:1787827188.883759:0:2352:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:1.0:1787827188.883768:0:2352:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:1.0:1787827188.883779:0:2352:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000100:00100000:0.0:1787827188.883787:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827185/real 1787827188]  req@ffff9ee0056eb840 x1874670272832896/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827210 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827188.883815:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb840 x1874670272832896/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827210 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827188.883841:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827188.883847:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827188.883851:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272832896:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787827188.883859:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827185/real 1787827188]  req@ffff9ee0056e9680 x1874670272833024/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827210 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827188.883879:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9680 x1874670272833024/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827210 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827188.883903:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827188.883908:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827188.883913:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272833024:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787827188.883920:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827185/real 1787827188]  req@ffff9ee0056e92c0 x1874670272833152/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827210 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827188.883935:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e92c0 x1874670272833152/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827210 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827188.883943:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827188.883947:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827188.883951:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272833152:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787827188.883957:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827185/real 1787827188]  req@ffff9ee0056e83c0 x1874670272833280/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827210 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827188.883969:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e83c0 x1874670272833280/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827210 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827188.883977:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827188.883982:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827188.883985:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272833280:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787827188.883992:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827185/real 1787827188]  req@ffff9ee0056ebc00 x1874670272832640/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827210 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827188.884005:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ebc00 x1874670272832640/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827210 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827188.884013:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827188.884016:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827188.884018:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272832640:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787827188.884022:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827185/real 1787827188]  req@ffff9ee0056e8f00 x1874670272832768/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827210 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827188.884031:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8f00 x1874670272832768/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827210 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827188.884039:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827188.884044:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827188.884048:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272832768:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787827188.884084:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827185/real 1787827188]  req@ffff9ee0056e8000 x1874670272833408/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827210 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827188.884097:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8000 x1874670272833408/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827210 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827188.884105:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827188.884109:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827188.884114:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272833408:192.168.203.121@tcp:8:kworker.0
00010000:00010000:0.0:1787827189.715421:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787827189.907389:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827190.739434:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1787827190.931388:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827190.931398:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1787827190.931401:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827190.931409:0:8:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2354
00000100:00080000:1.0:1787827190.931419:0:8:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827190.931425:0:8:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787827190.931455:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a3480 x1874670272833536/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827190.931481:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827190.931484:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787827190.931486:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827190.931489:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2354
00000100:00080000:1.0:1787827190.931491:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827190.931495:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827190.931503:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787827190.931507:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00100000:1.0:1787827190.931513:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a12c0 x1874670272833664/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827190.931524:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827190.931526:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787827190.931528:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827190.931533:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2354
00000100:00080000:1.0:1787827190.931535:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827190.931538:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827190.931543:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787827190.931556:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1a40 x1874670272833792/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827190.931567:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827190.931573:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:3.0:1787827190.931573:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272833536:192.168.203.121@tcp:250:kworker.0
00000100:00080000:1.0:1787827190.931578:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827190.931584:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2354
00000100:00080000:1.0:1787827190.931588:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827190.931593:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827190.931598:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787827190.931611:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a3c00 x1874670272833920/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827190.931621:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827190.931625:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787827190.931627:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827190.931631:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2354
00000100:00080000:1.0:1787827190.931636:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000800:00000100:3.0:1787827190.931642:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:1.0:1787827190.931645:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827190.931652:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787827190.931665:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a2940 x1874670272834048/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827190.931675:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827190.931679:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787827190.931681:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827190.931686:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2354
00000100:00080000:1.0:1787827190.931691:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1787827190.931692:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827190/real 1787827190]  req@ffff9ee0056a3480 x1874670272833536/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827215 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827190.931697:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827190.931706:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787827190.931722:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1680 x1874670272834176/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787827190.931724:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a3480 x1874670272833536/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827215 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827190.931740:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827190.931745:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787827190.931746:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827190.931748:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827190.931752:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:1.0:1787827190.931756:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2354
00000100:00100000:3.0:1787827190.931758:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272833536:192.168.203.121@tcp:250:kworker.0
00000100:00080000:1.0:1787827190.931764:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1787827190.931769:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272833664:192.168.203.121@tcp:38:kworker.0
00000100:00080000:1.0:1787827190.931772:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827190.931780:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787827190.931795:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0f00 x1874670272834304/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1787827190.931805:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827190.931823:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827190/real 1787827190]  req@ffff9ee0056a12c0 x1874670272833664/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827215 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827190.931837:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a12c0 x1874670272833664/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827215 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827190.931844:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827190.931848:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827190.931852:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272833664:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787827190.931889:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272833792:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827190.931914:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827190.931924:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827190/real 1787827190]  req@ffff9ee0056a1a40 x1874670272833792/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827215 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827190.931935:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1a40 x1874670272833792/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827215 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827190.931944:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827190.931947:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827190.931951:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272833792:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787827190.931957:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272833920:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827190.931976:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827190.931988:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827190/real 1787827190]  req@ffff9ee0056a3c00 x1874670272833920/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827215 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827190.931999:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a3c00 x1874670272833920/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827215 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827190.932007:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827190.932011:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827190.932014:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272833920:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787827190.932020:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272834048:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787827190.932040:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827190.932052:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827190/real 1787827190]  req@ffff9ee0056a2940 x1874670272834048/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827215 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827190.932065:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a2940 x1874670272834048/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827215 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827190.932072:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827190.932076:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827190.932079:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272834048:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787827190.932084:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272834176:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827190.932104:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827190.932116:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827190/real 1787827190]  req@ffff9ee0056a1680 x1874670272834176/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827215 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827190.932128:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1680 x1874670272834176/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827215 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827190.932137:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827190.932140:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827190.932143:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272834176:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787827190.932150:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272834304:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827190.932184:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827190.932198:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827190/real 1787827190]  req@ffff9ee0056a0f00 x1874670272834304/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827215 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827190.932210:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0f00 x1874670272834304/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827215 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827190.932219:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827190.932223:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827190.932310:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272834304:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827191.763494:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827191.955508:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827192.787460:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827192.979391:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827193.811579:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827194.003436:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787827194.835481:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827195.027429:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827195.859492:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1787827196.051424:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827196.051433:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787827196.051438:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827196.051449:0:8:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2359
00000100:00080000:2.0:1787827196.051461:0:8:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1787827196.051465:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:2.0:1787827196.051471:0:8:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787827196.051511:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a940 x1874670272834432/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827196.051534:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827196.051537:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787827196.051538:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827196.051541:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2359
00000100:00080000:2.0:1787827196.051544:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827196.051547:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827196.051555:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787827196.051569:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572bc00 x1874670272834560/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787827196.051576:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272834432:192.168.203.121@tcp:250:kworker.0
00000100:00080000:2.0:1787827196.051587:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827196.051591:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787827196.051593:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827196.051599:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2359
00000100:00080000:2.0:1787827196.051604:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827196.051607:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827196.051613:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787827196.051631:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729680 x1874670272834688/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1787827196.051637:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:2.0:1787827196.051645:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827196.051648:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787827196.051650:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827196.051655:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2359
00000100:00080000:2.0:1787827196.051658:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827196.051660:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827196.051664:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787827196.051671:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057292c0 x1874670272834816/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827196.051681:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1787827196.051684:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827196/real 1787827196]  req@ffff9ee00572a940 x1874670272834432/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827221 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827196.051686:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787827196.051691:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827196.051702:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2359
00000100:00100000:3.0:1787827196.051707:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a940 x1874670272834432/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827221 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827196.051708:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827196.051718:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00080000:3.0:1787827196.051721:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000008:00100000:2.0:1787827196.051725:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00080000:3.0:1787827196.051726:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827196.051732:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272834432:192.168.203.121@tcp:250:kworker.0
00000100:00100000:2.0:1787827196.051741:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728780 x1874670272834944/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827196.051749:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827196.051751:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787827196.051753:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1787827196.051756:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272834560:192.168.203.121@tcp:38:kworker.0
00000100:00080000:2.0:1787827196.051759:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2359
00000100:00080000:2.0:1787827196.051766:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827196.051769:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827196.051773:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787827196.051785:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a940 x1874670272835072/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1787827196.051785:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:2.0:1787827196.051796:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827196.051799:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:3.0:1787827196.051800:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827196/real 1787827196]  req@ffff9ee00572bc00 x1874670272834560/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827221 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827196.051801:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827196.051808:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2359
00000100:00080000:2.0:1787827196.051813:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827196.051817:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827196.051819:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787827196.051827:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a1c0 x1874670272835200/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787827196.051842:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572bc00 x1874670272834560/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827221 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827196.051866:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827196.051869:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827196.051873:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272834560:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787827196.051878:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272834688:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827196.051893:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827196.051900:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827196/real 1787827196]  req@ffff9ee005729680 x1874670272834688/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827221 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827196.051908:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729680 x1874670272834688/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827221 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827196.051913:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827196.051915:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827196.051917:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272834688:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787827196.051921:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057292c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272834816:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827196.051930:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827196.051936:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827196/real 1787827196]  req@ffff9ee0057292c0 x1874670272834816/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827221 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827196.051943:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057292c0 x1874670272834816/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827221 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827196.051948:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827196.051950:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827196.051952:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057292c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272834816:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787827196.051956:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272834944:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787827196.051966:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827196.051971:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827196/real 1787827196]  req@ffff9ee005728780 x1874670272834944/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827221 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827196.051979:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728780 x1874670272834944/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827221 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827196.051984:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827196.051985:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827196.051987:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272834944:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787827196.052000:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272835072:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827196.052010:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827196.052017:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827196/real 1787827196]  req@ffff9ee00572a940 x1874670272835072/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827221 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827196.052024:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a940 x1874670272835072/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827221 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827196.052029:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827196.052030:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827196.052040:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272835072:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787827196.052044:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272835200:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827196.052055:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827196.052062:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827196/real 1787827196]  req@ffff9ee00572a1c0 x1874670272835200/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827221 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827196.052069:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a1c0 x1874670272835200/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827221 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827196.052074:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827196.052076:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827196.052077:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272835200:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827196.883436:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787827197.075425:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827197.907499:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787827198.099428:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827198.931475:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787827199.123453:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787827199.955479:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787827200.147423:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827200.979511:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827201.171434:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787827201.171434:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827201.171443:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787827201.171447:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827201.171456:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2364
00000100:00080000:3.0:1787827201.171465:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827201.171472:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787827201.171510:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057052c0 x1874670272835328/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827201.171545:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827201.171549:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787827201.171551:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827201.171556:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2364
00000100:00080000:3.0:1787827201.171560:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827201.171565:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827201.171577:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787827201.171591:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272835328:192.168.203.121@tcp:250:kworker.0
00000100:00100000:3.0:1787827201.171593:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057043c0 x1874670272835456/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827201.171607:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827201.171610:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787827201.171611:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827201.171614:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2364
00000100:00080000:3.0:1787827201.171618:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827201.171620:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827201.171625:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827201.171633:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706580 x1874670272835584/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827201.171640:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827201.171642:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787827201.171644:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827201.171646:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2364
00000100:00080000:3.0:1787827201.171649:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827201.171651:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827201.171653:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:0.0:1787827201.171663:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827201.171663:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705680 x1874670272835712/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827201.171673:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827201.171675:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787827201.171677:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827201.171680:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2364
00000100:00080000:3.0:1787827201.171683:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827201.171686:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827201.171689:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787827201.171695:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706940 x1874670272835840/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827201.171700:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827201.171702:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787827201.171703:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827201.171706:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2364
00000100:00080000:3.0:1787827201.171708:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827201.171710:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827201.171712:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827201.171717:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707c00 x1874670272835968/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827201.171722:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827201.171724:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787827201.171725:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827201.171727:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2364
00000100:00080000:3.0:1787827201.171729:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827201.171731:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827201.171734:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827201.171740:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704000 x1874670272836096/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787827201.171759:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827201/real 1787827201]  req@ffff9ee0057052c0 x1874670272835328/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827226 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827201.171778:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057052c0 x1874670272835328/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827226 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827201.171789:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827201.171793:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827201.171811:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272835328:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787827201.171835:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272835456:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787827201.171860:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827201.171874:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827201/real 1787827201]  req@ffff9ee0057043c0 x1874670272835456/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827226 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827201.171887:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057043c0 x1874670272835456/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827226 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827201.171896:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827201.171899:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827201.171903:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272835456:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787827201.171910:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272835584:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787827201.171931:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827201.171942:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827201/real 1787827201]  req@ffff9ee005706580 x1874670272835584/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827226 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827201.171954:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706580 x1874670272835584/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827226 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827201.171962:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827201.171966:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827201.171969:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272835584:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787827201.171975:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272835712:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787827201.171995:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827201.172006:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827201/real 1787827201]  req@ffff9ee005705680 x1874670272835712/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827226 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827201.172018:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705680 x1874670272835712/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827226 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827201.172026:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827201.172030:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827201.172033:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272835712:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787827201.172039:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272835840:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787827201.172059:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827201.172071:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827201/real 1787827201]  req@ffff9ee005706940 x1874670272835840/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827226 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827201.172083:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706940 x1874670272835840/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827226 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827201.172091:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827201.172095:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827201.172098:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272835840:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787827201.172104:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272835968:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787827201.172123:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827201.172134:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827201/real 1787827201]  req@ffff9ee005707c00 x1874670272835968/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827226 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827201.172146:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707c00 x1874670272835968/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827226 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827201.172155:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827201.172159:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827201.172162:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272835968:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787827201.172168:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272836096:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787827201.172188:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827201.172199:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827201/real 1787827201]  req@ffff9ee005704000 x1874670272836096/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827226 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827201.172212:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704000 x1874670272836096/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827226 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827201.172221:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827201.172224:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827201.172227:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272836096:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827202.003513:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827202.195404:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827203.027489:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827203.219372:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827204.051484:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787827204.243461:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787827205.075512:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787827205.267426:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827206.099539:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1787827206.291469:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827206.291485:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787827206.291491:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827206.291514:0:8:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2370
00000100:00100000:1.0:1787827206.291531:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:2.0:1787827206.291532:0:8:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827206.291556:0:8:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787827206.291610:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728f00 x1874670272836224/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827206.291642:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827206.291646:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787827206.291648:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827206.291653:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2370
00000100:00080000:2.0:1787827206.291657:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827206.291662:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827206.291675:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787827206.291690:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b840 x1874670272836352/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827206.291701:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1787827206.291708:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272836224:192.168.203.121@tcp:250:kworker.0
00000100:00080000:2.0:1787827206.291708:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787827206.291711:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827206.291722:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2370
00000100:00080000:2.0:1787827206.291727:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827206.291731:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827206.291738:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787827206.291751:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057283c0 x1874670272836480/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827206.291777:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827206.291782:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787827206.291784:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827206.291788:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2370
00000100:00080000:2.0:1787827206.291794:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827206.291799:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827206.291805:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:0.0:1787827206.291810:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827206.291823:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729e00 x1874670272836608/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827206.291835:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827206.291839:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787827206.291841:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827206.291846:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2370
00000100:00080000:2.0:1787827206.291851:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827206.291855:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827206.291861:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787827206.291868:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827206/real 1787827206]  req@ffff9ee005728f00 x1874670272836224/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827231 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827206.291878:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728000 x1874670272836736/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827206.291891:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1787827206.291895:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728f00 x1874670272836224/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827231 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827206.291897:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787827206.291901:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827206.291911:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2370
00000100:00080000:0.0:1787827206.291919:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827206.291919:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827206.291927:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00080000:0.0:1787827206.291928:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827206.291938:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272836224:192.168.203.121@tcp:250:kworker.0
00000008:00100000:2.0:1787827206.291938:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787827206.291961:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a580 x1874670272836864/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787827206.291975:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272836352:192.168.203.121@tcp:38:kworker.0
00000100:00080000:2.0:1787827206.291975:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827206.291984:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787827206.291988:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827206.291994:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2370
00000100:00080000:2.0:1787827206.291999:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827206.292004:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827206.292010:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:0.0:1787827206.292014:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827206.292029:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728b40 x1874670272836992/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787827206.292037:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827206/real 1787827206]  req@ffff9ee00572b840 x1874670272836352/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827231 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827206.292056:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b840 x1874670272836352/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827231 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827206.292066:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827206.292071:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827206.292075:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272836352:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787827206.292083:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272836480:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787827206.292106:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827206.292119:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827206/real 1787827206]  req@ffff9ee0057283c0 x1874670272836480/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827231 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827206.292133:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057283c0 x1874670272836480/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827231 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827206.292143:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827206.292147:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827206.292151:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272836480:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787827206.292158:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272836608:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787827206.292180:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827206.292193:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827206/real 1787827206]  req@ffff9ee005729e00 x1874670272836608/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827231 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827206.292208:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729e00 x1874670272836608/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827231 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827206.292217:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827206.292220:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827206.292224:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272836608:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787827206.292231:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272836736:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787827206.292253:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827206.292265:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827206/real 1787827206]  req@ffff9ee005728000 x1874670272836736/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827231 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827206.292279:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728000 x1874670272836736/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827231 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827206.292288:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827206.292292:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827206.292295:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272836736:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787827206.292354:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272836864:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787827206.292379:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827206.292393:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827206/real 1787827206]  req@ffff9ee00572a580 x1874670272836864/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827231 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827206.292408:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a580 x1874670272836864/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827231 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827206.292418:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827206.292422:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827206.292426:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272836864:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787827206.292432:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272836992:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787827206.292454:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827206.292466:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827206/real 1787827206]  req@ffff9ee005728b40 x1874670272836992/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827231 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827206.292479:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728b40 x1874670272836992/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827231 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827206.292487:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827206.292490:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827206.292494:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272836992:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827207.123532:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787827207.315450:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827208.147464:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787827208.339397:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827209.171489:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787827209.363440:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787827210.195500:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787827210.387412:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827211.219496:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1787827211.411477:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1787827211.411484:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:2.0:1787827211.411489:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787827211.411498:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827211.411512:0:8:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2375
00000100:00080000:2.0:1787827211.411523:0:8:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827211.411530:0:8:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787827211.411564:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729a40 x1874670272837120/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827211.411594:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827211.411597:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787827211.411599:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827211.411603:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2375
00000100:00080000:2.0:1787827211.411606:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827211.411609:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827211.411619:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787827211.411639:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272837120:192.168.203.121@tcp:250:kworker.0
00000100:00100000:2.0:1787827211.411639:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572ad00 x1874670272837248/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827211.411668:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827211.411672:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787827211.411675:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827211.411682:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2375
00000100:00080000:2.0:1787827211.411689:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827211.411697:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827211.411704:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787827211.411717:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b480 x1874670272837376/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827211.411745:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827211.411747:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787827211.411749:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827211.411753:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2375
00000100:00080000:2.0:1787827211.411762:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827211.411766:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827211.411772:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787827211.411787:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b0c0 x1874670272837504/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827211.411796:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827211.411799:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787827211.411800:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827211.411804:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2375
00000100:00080000:2.0:1787827211.411807:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827211.411809:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827211.411813:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787827211.411825:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728b40 x1874670272837632/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827211.411835:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827211.411839:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787827211.411842:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827211.411846:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2375
00000100:00080000:2.0:1787827211.411851:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827211.411858:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827211.411863:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787827211.411874:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a580 x1874670272837760/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827211.411880:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827211.411883:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787827211.411884:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827211.411886:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2375
00000100:00080000:2.0:1787827211.411889:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827211.411892:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827211.411895:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787827211.411901:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728000 x1874670272837888/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1787827211.412926:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827211.412967:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827211/real 1787827211]  req@ffff9ee005729a40 x1874670272837120/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827236 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827211.412981:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729a40 x1874670272837120/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827236 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827211.412990:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827211.412993:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827211.412996:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272837120:192.168.203.121@tcp:250:kworker.0
00000100:00100000:1.0:1787827211.413018:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272837248:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787827211.413055:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827211.413063:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827211/real 1787827211]  req@ffff9ee00572ad00 x1874670272837248/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827236 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827211.413071:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572ad00 x1874670272837248/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827236 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827211.413077:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827211.413079:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827211.413081:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272837248:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787827211.413085:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272837376:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827211.413096:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827211.413101:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827211/real 1787827211]  req@ffff9ee00572b480 x1874670272837376/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827236 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827211.413108:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b480 x1874670272837376/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827236 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827211.413113:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827211.413115:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827211.413117:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272837376:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827211.413120:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272837504:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827211.413129:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827211.413134:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827211/real 1787827211]  req@ffff9ee00572b0c0 x1874670272837504/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827236 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827211.413145:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b0c0 x1874670272837504/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827236 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827211.413150:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827211.413152:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827211.413162:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272837504:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827211.413168:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272837632:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787827211.413178:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827211.413185:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827211/real 1787827211]  req@ffff9ee005728b40 x1874670272837632/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827236 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827211.413192:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728b40 x1874670272837632/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827236 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827211.413196:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827211.413198:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827211.413200:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272837632:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787827211.413204:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272837760:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827211.413213:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827211.413218:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827211/real 1787827211]  req@ffff9ee00572a580 x1874670272837760/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827236 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827211.413228:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a580 x1874670272837760/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827236 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827211.413242:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827211.413245:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827211.413249:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272837760:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827211.413255:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272837888:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827211.413275:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827211.413286:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827211/real 1787827211]  req@ffff9ee005728000 x1874670272837888/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827236 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827211.413299:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728000 x1874670272837888/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827236 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827211.413304:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827211.413306:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827211.413308:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272837888:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827212.243498:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787827212.435393:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827213.267476:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787827213.459443:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827214.291446:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787827214.483423:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787827215.315505:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787827215.507433:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827216.339462:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827216.531459:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:1.0:1787827216.531460:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827216.531474:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1787827216.531478:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827216.531491:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2380
00000100:00080000:1.0:1787827216.531509:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827216.531520:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787827216.531569:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a21c0 x1874670272838016/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827216.531602:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827216.531606:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787827216.531607:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827216.531611:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2380
00000100:00080000:1.0:1787827216.531614:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827216.531617:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827216.531625:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787827216.531637:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0f00 x1874670272838144/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827216.531646:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827216.531649:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787827216.531651:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827216.531653:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2380
00000100:00080000:1.0:1787827216.531656:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827216.531658:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827216.531662:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787827216.531672:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1680 x1874670272838272/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827216.531680:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827216.531683:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787827216.531684:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827216.531687:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2380
00000100:00080000:1.0:1787827216.531705:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827216.531710:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827216.531714:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787827216.531743:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272838016:192.168.203.121@tcp:250:kworker.0
00000100:00100000:1.0:1787827216.531744:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a2940 x1874670272838400/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827216.531759:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827216.531762:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787827216.531763:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827216.531767:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2380
00000100:00080000:1.0:1787827216.531770:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827216.531772:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827216.531777:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787827216.531786:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a3c00 x1874670272838528/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827216.531800:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827216.531802:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787827216.531804:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:0.0:1787827216.531808:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:1.0:1787827216.531812:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2380
00000100:00080000:1.0:1787827216.531818:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827216.531820:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827216.531823:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787827216.531832:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1a40 x1874670272838656/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827216.531844:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827216.531847:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787827216.531848:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827216.531851:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2380
00000100:00080000:1.0:1787827216.531870:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827216.531872:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827216.531876:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787827216.531889:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827216/real 1787827216]  req@ffff9ee0056a21c0 x1874670272838016/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827241 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827216.531889:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a12c0 x1874670272838784/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787827216.531918:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a21c0 x1874670272838016/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827241 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827216.531927:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827216.531931:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827216.531934:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272838016:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787827216.531940:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272838144:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787827216.531956:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827216.531964:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827216/real 1787827216]  req@ffff9ee0056a0f00 x1874670272838144/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827241 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827216.531972:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0f00 x1874670272838144/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827241 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827216.531977:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827216.531980:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827216.531982:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272838144:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787827216.531985:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272838272:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787827216.531996:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827216.532002:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827216/real 1787827216]  req@ffff9ee0056a1680 x1874670272838272/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827241 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827216.532009:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1680 x1874670272838272/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827241 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827216.532014:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827216.532016:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827216.532018:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272838272:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787827216.532037:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272838400:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787827216.532048:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827216.532054:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827216/real 1787827216]  req@ffff9ee0056a2940 x1874670272838400/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827241 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827216.532078:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a2940 x1874670272838400/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827241 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827216.532084:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827216.532086:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827216.532088:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272838400:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787827216.532091:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272838528:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787827216.532103:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827216.532110:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827216/real 1787827216]  req@ffff9ee0056a3c00 x1874670272838528/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827241 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827216.532118:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a3c00 x1874670272838528/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827241 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827216.532123:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827216.532125:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827216.532127:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272838528:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787827216.532131:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272838656:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787827216.532141:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827216.532147:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827216/real 1787827216]  req@ffff9ee0056a1a40 x1874670272838656/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827241 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827216.532160:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1a40 x1874670272838656/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827241 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827216.532166:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827216.532167:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827216.532169:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272838656:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787827216.532173:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272838784:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787827216.532190:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827216.532196:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827216/real 1787827216]  req@ffff9ee0056a12c0 x1874670272838784/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827241 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827216.532204:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a12c0 x1874670272838784/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827241 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827216.532209:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827216.532211:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827216.532214:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272838784:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827217.363461:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827217.555396:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787827218.387487:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787827218.579462:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827219.411482:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787827219.603388:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787827220.435471:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787827220.627387:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827221.459504:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1787827221.651399:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1787827221.651407:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:1.0:1787827221.651409:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1787827221.651416:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827221.651424:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2385
00000100:00080000:1.0:1787827221.651434:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827221.651439:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787827221.651468:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a3480 x1874670272838912/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827221.651488:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827221.651490:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787827221.651492:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827221.651494:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2385
00000100:00080000:1.0:1787827221.651497:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827221.651500:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827221.651507:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787827221.651516:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0b40 x1874670272839040/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827221.651524:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827221.651527:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787827221.651528:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827221.651531:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2385
00000100:00080000:1.0:1787827221.651533:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827221.651535:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787827221.651541:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272838912:192.168.203.121@tcp:250:kworker.0
00000008:00100000:1.0:1787827221.651541:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787827221.651557:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a2580 x1874670272839168/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827221.651572:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827221.651575:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787827221.651576:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827221.651579:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2385
00000100:00080000:1.0:1787827221.651595:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827221.651597:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827221.651601:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:0.0:1787827221.651607:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827221.651611:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a03c0 x1874670272839296/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827221.651622:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827221.651624:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787827221.651625:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827221.651628:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2385
00000100:00080000:1.0:1787827221.651629:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827221.651631:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827221.651634:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787827221.651640:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1e00 x1874670272839424/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827221.651646:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827221.651648:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787827221.651650:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827221.651667:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2385
00000100:00080000:1.0:1787827221.651674:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827221.651678:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827221.651681:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787827221.651689:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0000 x1874670272839552/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827221.651696:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827221.651698:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787827221.651700:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827221.651702:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2385
00000100:00080000:1.0:1787827221.651705:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827221.651708:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787827221.651714:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827221/real 1787827221]  req@ffff9ee0056a3480 x1874670272838912/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827246 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:1.0:1787827221.651714:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787827221.651725:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0780 x1874670272839680/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787827221.651755:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a3480 x1874670272838912/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827246 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827221.651769:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827221.651774:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827221.651778:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272838912:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787827221.651786:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272839040:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787827221.651813:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827221.651828:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827221/real 1787827221]  req@ffff9ee0056a0b40 x1874670272839040/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827246 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827221.651842:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0b40 x1874670272839040/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827246 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827221.651861:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827221.651865:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827221.651869:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272839040:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787827221.651896:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272839168:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787827221.651919:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827221.651933:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827221/real 1787827221]  req@ffff9ee0056a2580 x1874670272839168/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827246 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827221.651947:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a2580 x1874670272839168/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827246 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827221.651956:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827221.651960:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827221.651964:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272839168:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787827221.651971:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272839296:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787827221.651992:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827221.652004:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827221/real 1787827221]  req@ffff9ee0056a03c0 x1874670272839296/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827246 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827221.652017:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a03c0 x1874670272839296/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827246 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827221.652026:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827221.652029:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827221.652032:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272839296:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787827221.652038:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272839424:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787827221.652057:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827221.652069:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827221/real 1787827221]  req@ffff9ee0056a1e00 x1874670272839424/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827246 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827221.652082:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1e00 x1874670272839424/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827246 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827221.652091:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827221.652095:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827221.652098:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272839424:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787827221.652105:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272839552:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787827221.652126:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827221.652138:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827221/real 1787827221]  req@ffff9ee0056a0000 x1874670272839552/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827246 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827221.652151:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0000 x1874670272839552/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827246 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827221.652160:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827221.652163:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827221.652167:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272839552:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787827221.652173:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272839680:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787827221.652195:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827221.652207:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827221/real 1787827221]  req@ffff9ee0056a0780 x1874670272839680/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827246 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827221.652220:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0780 x1874670272839680/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827246 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827221.652228:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827221.652232:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827221.652235:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272839680:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827222.483469:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827222.675404:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787827223.507452:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827223.699384:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827224.531460:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827224.723453:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787827225.555494:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827225.747430:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827226.579476:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827226.771435:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:2.0:1787827226.771468:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827226.771474:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787827226.771478:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827226.771487:0:8:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2390
00000100:00080000:2.0:1787827226.771498:0:8:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827226.771504:0:8:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787827226.771572:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729e00 x1874670272839808/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827226.771593:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827226.771596:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787827226.771598:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827226.771600:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2390
00000100:00080000:2.0:1787827226.771603:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827226.771606:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827226.771613:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787827226.771641:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057283c0 x1874670272839936/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827226.771650:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827226.771653:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787827226.771654:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827226.771657:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2390
00000100:00080000:2.0:1787827226.771661:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1787827226.771664:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272839808:192.168.203.121@tcp:250:kworker.0
00000100:00080000:2.0:1787827226.771666:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827226.771675:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787827226.771684:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b840 x1874670272840064/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827226.771692:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827226.771695:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787827226.771696:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827226.771698:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2390
00000100:00080000:2.0:1787827226.771701:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827226.771707:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827226.771711:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787827226.771718:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728f00 x1874670272840192/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827226.771724:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827226.771727:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787827226.771729:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:0.0:1787827226.771732:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:2.0:1787827226.771735:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2390
00000100:00080000:2.0:1787827226.771739:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827226.771742:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827226.771745:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787827226.771753:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a1c0 x1874670272840320/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827226.771759:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827226.771762:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787827226.771763:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827226.771765:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2390
00000100:00080000:2.0:1787827226.771768:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827226.771771:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827226.771774:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787827226.771780:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827226/real 1787827226]  req@ffff9ee005729e00 x1874670272839808/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827251 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827226.771785:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a940 x1874670272840448/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827226.771802:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827226.771804:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787827226.771805:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827226.771808:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2390
00000100:00080000:2.0:1787827226.771809:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827226.771815:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827226.771819:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787827226.771827:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728780 x1874670272840576/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787827226.771831:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729e00 x1874670272839808/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827251 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827226.771846:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827226.771851:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827226.771857:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272839808:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787827226.771865:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272839936:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787827226.771889:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827226.771902:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827226/real 1787827226]  req@ffff9ee0057283c0 x1874670272839936/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827251 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827226.771915:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057283c0 x1874670272839936/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827251 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827226.771923:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827226.771927:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827226.771930:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272839936:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787827226.771956:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272840064:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787827226.771979:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827226.771993:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827226/real 1787827226]  req@ffff9ee00572b840 x1874670272840064/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827251 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827226.772005:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b840 x1874670272840064/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827251 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827226.772013:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827226.772016:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827226.772020:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272840064:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787827226.772027:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272840192:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787827226.772048:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827226.772060:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827226/real 1787827226]  req@ffff9ee005728f00 x1874670272840192/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827251 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827226.772073:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728f00 x1874670272840192/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827251 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827226.772082:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827226.772085:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827226.772088:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272840192:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787827226.772095:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272840320:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787827226.772115:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827226.772126:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827226/real 1787827226]  req@ffff9ee00572a1c0 x1874670272840320/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827251 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827226.772138:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a1c0 x1874670272840320/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827251 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827226.772147:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827226.772151:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827226.772154:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272840320:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787827226.772161:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272840448:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787827226.772180:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827226.772191:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827226/real 1787827226]  req@ffff9ee00572a940 x1874670272840448/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827251 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827226.772204:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a940 x1874670272840448/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827251 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827226.772213:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827226.772216:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827226.772220:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272840448:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787827226.772226:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272840576:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787827226.772246:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827226.772258:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827226/real 1787827226]  req@ffff9ee005728780 x1874670272840576/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827251 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827226.772269:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728780 x1874670272840576/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827251 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827226.772277:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827226.772281:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827226.772284:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272840576:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827227.603493:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827227.795416:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787827228.627480:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827228.819441:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827229.651470:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827229.843462:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787827230.675462:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827230.867453:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827231.699494:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827231.891406:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787827231.891406:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827231.891414:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787827231.891418:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827231.891426:0:8:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2395
00000100:00080000:3.0:1787827231.891434:0:8:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827231.891448:0:8:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787827231.891484:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706d00 x1874670272840704/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827231.891511:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827231.891515:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787827231.891517:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827231.891524:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2395
00000100:00080000:3.0:1787827231.891528:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827231.891533:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827231.891543:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787827231.891555:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272840704:192.168.203.121@tcp:250:kworker.0
00000100:00100000:3.0:1787827231.891560:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057070c0 x1874670272840832/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827231.891573:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827231.891577:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787827231.891579:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827231.891598:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2395
00000100:00080000:3.0:1787827231.891603:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827231.891607:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827231.891612:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827231.891625:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704000 x1874670272840960/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1787827231.891629:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787827231.891640:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827231.891643:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787827231.891645:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827231.891650:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2395
00000100:00080000:3.0:1787827231.891654:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827231.891658:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827231.891663:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787827231.891669:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827231/real 1787827231]  req@ffff9ee005706d00 x1874670272840704/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827256 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827231.891677:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707c00 x1874670272841088/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787827231.891687:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706d00 x1874670272840704/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827256 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827231.891690:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827231.891699:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787827231.891703:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827231.891705:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827231.891712:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:3.0:1787827231.891712:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2395
00000100:00100000:0.0:1787827231.891720:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272840704:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787827231.891720:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827231.891725:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827231.891729:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787827231.891741:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706940 x1874670272841216/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787827231.891749:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272840832:192.168.203.121@tcp:38:kworker.0
00000100:00080000:3.0:1787827231.891749:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827231.891758:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787827231.891759:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827231.891763:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2395
00000100:00080000:3.0:1787827231.891766:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827231.891769:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827231.891773:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:0.0:1787827231.891777:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827231.891786:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705680 x1874670272841344/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787827231.891791:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827231/real 1787827231]  req@ffff9ee0057070c0 x1874670272840832/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827256 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827231.891800:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827231.891808:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787827231.891810:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1787827231.891814:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057070c0 x1874670272840832/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827256 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827231.891814:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2395
00000100:00080000:3.0:1787827231.891820:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827231.891825:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00080000:0.0:1787827231.891831:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000008:00100000:3.0:1787827231.891832:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:0.0:1787827231.891837:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827231.891843:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706580 x1874670272841472/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787827231.891844:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272840832:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787827231.891855:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272840960:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787827231.891874:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827231.891882:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827231/real 1787827231]  req@ffff9ee005704000 x1874670272840960/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827256 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827231.891890:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704000 x1874670272840960/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827256 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827231.891896:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827231.891898:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827231.891900:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272840960:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787827231.891903:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272841088:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787827231.891913:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827231.891918:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827231/real 1787827231]  req@ffff9ee005707c00 x1874670272841088/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827256 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827231.891925:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707c00 x1874670272841088/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827256 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827231.891931:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827231.891932:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827231.891934:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272841088:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787827231.891942:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272841216:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787827231.891952:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827231.891957:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827231/real 1787827231]  req@ffff9ee005706940 x1874670272841216/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827256 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827231.891964:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706940 x1874670272841216/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827256 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827231.891969:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827231.891971:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827231.891973:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272841216:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787827231.891977:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272841344:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787827231.891986:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827231.891991:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827231/real 1787827231]  req@ffff9ee005705680 x1874670272841344/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827256 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827231.891999:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705680 x1874670272841344/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827256 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827231.892004:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827231.892005:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827231.892007:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272841344:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787827231.892010:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272841472:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787827231.892019:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827231.892024:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827231/real 1787827231]  req@ffff9ee005706580 x1874670272841472/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827256 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827231.892030:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706580 x1874670272841472/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827256 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827231.892035:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827231.892036:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827231.892038:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272841472:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827232.723462:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827232.915439:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787827233.747520:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827233.939435:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827234.771463:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827234.963423:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787827235.795475:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827235.987440:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827236.819505:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827237.011421:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:0.0:1787827237.011429:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827237.011434:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1787827237.011438:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827237.011446:0:8:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2400
00000100:00080000:0.0:1787827237.011456:0:8:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827237.011462:0:8:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787827237.011498:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8f00 x1874670272841600/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827237.011533:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827237.011537:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787827237.011557:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827237.011563:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2400
00000100:00080000:0.0:1787827237.011568:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827237.011573:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827237.011584:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787827237.011590:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272841600:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787827237.011603:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ebc00 x1874670272841728/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827237.011614:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827237.011617:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787827237.011618:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827237.011622:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2400
00000100:00080000:0.0:1787827237.011638:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827237.011641:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827237.011646:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1787827237.011646:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827237.011659:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e83c0 x1874670272841856/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827237.011666:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827237.011668:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787827237.011670:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827237.011672:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2400
00000100:00080000:0.0:1787827237.011674:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827237.011676:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827237.011679:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787827237.011684:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e92c0 x1874670272841984/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827237.011690:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827237.011692:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787827237.011693:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827237.011696:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2400
00000100:00080000:0.0:1787827237.011698:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827237.011701:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827237.011703:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787827237.011710:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9680 x1874670272842112/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827237.011716:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827237.011718:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787827237.011720:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827237.011722:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2400
00000100:00080000:0.0:1787827237.011725:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827237.011728:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827237.011731:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787827237.011738:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827237/real 1787827237]  req@ffff9ee0056e8f00 x1874670272841600/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827262 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827237.011740:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb840 x1874670272842240/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827237.011759:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827237.011764:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:1.0:1787827237.011765:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8f00 x1874670272841600/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827262 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827237.011766:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827237.011775:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2400
00000100:00080000:0.0:1787827237.011780:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827237.011785:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00080000:1.0:1787827237.011787:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000008:00100000:0.0:1787827237.011788:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:1.0:1787827237.011798:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827237.011802:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8b40 x1874670272842368/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787827237.011808:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272841600:192.168.203.121@tcp:250:kworker.0
00000100:00100000:1.0:1787827237.011836:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272841728:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787827237.011856:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827237.011866:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827237/real 1787827237]  req@ffff9ee0056ebc00 x1874670272841728/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827262 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827237.011874:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ebc00 x1874670272841728/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827262 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827237.011880:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827237.011882:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827237.011885:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272841728:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787827237.011889:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272841856:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827237.011900:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827237.011906:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827237/real 1787827237]  req@ffff9ee0056e83c0 x1874670272841856/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827262 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827237.011914:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e83c0 x1874670272841856/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827262 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827237.011918:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827237.011920:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827237.011922:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272841856:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827237.011925:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272841984:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827237.011934:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827237.011939:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827237/real 1787827237]  req@ffff9ee0056e92c0 x1874670272841984/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827262 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827237.011946:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e92c0 x1874670272841984/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827262 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827237.011951:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827237.011953:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827237.011954:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272841984:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827237.011958:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272842112:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787827237.011967:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827237.011972:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827237/real 1787827237]  req@ffff9ee0056e9680 x1874670272842112/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827262 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827237.011979:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9680 x1874670272842112/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827262 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827237.011984:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827237.011986:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827237.011988:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272842112:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787827237.011991:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272842240:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827237.011999:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827237.012005:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827237/real 1787827237]  req@ffff9ee0056eb840 x1874670272842240/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827262 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827237.012011:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb840 x1874670272842240/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827262 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827237.012016:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827237.012018:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827237.012019:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272842240:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827237.012023:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272842368:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827237.012032:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827237.012037:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827237/real 1787827237]  req@ffff9ee0056e8b40 x1874670272842368/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827262 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827237.012044:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8b40 x1874670272842368/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827262 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827237.012049:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827237.012051:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827237.012053:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272842368:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827237.843454:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827238.035427:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787827238.867456:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827239.059426:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827239.891476:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787827240.083465:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827240.915478:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787827241.107432:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827241.939484:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1787827242.131432:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1787827242.131443:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:1.0:1787827242.131443:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1787827242.131449:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827242.131460:0:8:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2405
00000100:00080000:1.0:1787827242.131472:0:8:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827242.131480:0:8:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787827242.131529:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a30c0 x1874670272842496/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827242.131551:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827242.131554:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787827242.131555:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827242.131558:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2405
00000100:00080000:1.0:1787827242.131561:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827242.131564:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827242.131572:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787827242.131584:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272842496:192.168.203.121@tcp:250:kworker.0
00000100:00100000:1.0:1787827242.131586:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0780 x1874670272842624/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827242.131597:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827242.131600:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787827242.131601:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827242.131604:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2405
00000100:00080000:1.0:1787827242.131606:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827242.131608:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827242.131612:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787827242.131620:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0000 x1874670272842752/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827242.131626:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827242.131628:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787827242.131630:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827242.131633:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2405
00000100:00080000:1.0:1787827242.131635:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827242.131637:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827242.131641:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:0.0:1787827242.131645:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827242.131652:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1e00 x1874670272842880/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827242.131660:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827242.131662:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787827242.131664:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827242.131666:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2405
00000100:00080000:1.0:1787827242.131668:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827242.131671:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827242.131674:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787827242.131690:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827242/real 1787827242]  req@ffff9ee0056a30c0 x1874670272842496/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827267 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827242.131691:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a03c0 x1874670272843008/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827242.131717:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1787827242.131719:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a30c0 x1874670272842496/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827267 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827242.131720:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787827242.131723:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827242.131731:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2405
00000100:00080000:1.0:1787827242.131736:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827242.131742:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827242.131747:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:0.0:1787827242.131748:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:1.0:1787827242.131754:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a2580 x1874670272843136/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827242.131756:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827242.131767:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272842496:192.168.203.121@tcp:250:kworker.0
00000100:00080000:1.0:1787827242.131768:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827242.131777:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787827242.131779:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827242.131782:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2405
00000100:00080000:1.0:1787827242.131784:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827242.131787:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827242.131790:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787827242.131799:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272842624:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787827242.131800:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0b40 x1874670272843264/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1787827242.131830:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827242.131847:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827242/real 1787827242]  req@ffff9ee0056a0780 x1874670272842624/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827267 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827242.131861:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0780 x1874670272842624/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827267 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827242.131871:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827242.131874:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827242.131878:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272842624:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787827242.131883:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272842752:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787827242.131899:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827242.131907:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827242/real 1787827242]  req@ffff9ee0056a0000 x1874670272842752/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827267 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827242.131915:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0000 x1874670272842752/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827267 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827242.131920:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827242.131922:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827242.131924:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272842752:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787827242.131928:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272842880:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787827242.131937:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827242.131943:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827242/real 1787827242]  req@ffff9ee0056a1e00 x1874670272842880/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827267 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827242.131950:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1e00 x1874670272842880/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827267 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827242.131955:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827242.131957:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827242.131960:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272842880:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787827242.131963:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272843008:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787827242.131972:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827242.131977:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827242/real 1787827242]  req@ffff9ee0056a03c0 x1874670272843008/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827267 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827242.131984:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a03c0 x1874670272843008/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827267 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827242.131988:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827242.131991:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827242.131992:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272843008:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787827242.131996:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272843136:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787827242.132004:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827242.132010:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827242/real 1787827242]  req@ffff9ee0056a2580 x1874670272843136/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827267 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827242.132018:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a2580 x1874670272843136/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827267 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827242.132025:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827242.132028:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827242.132032:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272843136:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787827242.132052:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272843264:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787827242.132073:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827242.132082:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827242/real 1787827242]  req@ffff9ee0056a0b40 x1874670272843264/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827267 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827242.132090:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0b40 x1874670272843264/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827267 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827242.132095:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827242.132097:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827242.132099:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272843264:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827242.963452:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827243.155447:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787827243.987458:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827244.179425:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827245.012435:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827245.203404:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827246.035422:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827246.227474:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827247.060466:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1787827247.251409:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1787827247.251409:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:1.0:1787827247.251420:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1787827247.251426:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827247.251437:0:8:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2410
00000100:00080000:1.0:1787827247.251449:0:8:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827247.251457:0:8:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787827247.251519:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a3480 x1874670272843392/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827247.251546:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827247.251549:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787827247.251550:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827247.251554:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2410
00000100:00080000:1.0:1787827247.251556:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827247.251559:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827247.251570:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787827247.251579:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a12c0 x1874670272843520/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827247.251589:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1787827247.251593:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272843392:192.168.203.121@tcp:250:kworker.0
00000100:00080000:1.0:1787827247.251594:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787827247.251598:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827247.251606:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2410
00000100:00080000:1.0:1787827247.251609:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827247.251611:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827247.251614:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787827247.251622:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1a40 x1874670272843648/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827247.251633:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827247.251636:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787827247.251638:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827247.251640:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2410
00000100:00080000:1.0:1787827247.251642:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827247.251645:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827247.251647:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787827247.251654:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a3c00 x1874670272843776/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827247.251667:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827247.251670:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787827247.251671:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827247.251674:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2410
00000100:00080000:1.0:1787827247.251678:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000800:00000100:0.0:1787827247.251679:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:1.0:1787827247.251685:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827247.251690:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787827247.251704:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a2940 x1874670272843904/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827247.251714:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827247.251718:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787827247.251721:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1787827247.251726:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827247/real 1787827247]  req@ffff9ee0056a3480 x1874670272843392/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827272 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827247.251727:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2410
00000100:00080000:1.0:1787827247.251736:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827247.251744:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787827247.251749:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a3480 x1874670272843392/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827272 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:1.0:1787827247.251752:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:0.0:1787827247.251764:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:1.0:1787827247.251769:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1680 x1874670272844032/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827247.251771:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827247.251779:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272843392:192.168.203.121@tcp:250:kworker.0
00000100:00080000:1.0:1787827247.251786:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827247.251790:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787827247.251792:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827247.251796:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2410
00000100:00080000:1.0:1787827247.251799:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827247.251802:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827247.251804:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787827247.251809:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272843520:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787827247.251815:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0f00 x1874670272844160/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1787827247.251835:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827247.251847:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827247/real 1787827247]  req@ffff9ee0056a12c0 x1874670272843520/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827272 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827247.251863:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a12c0 x1874670272843520/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827272 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827247.251872:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827247.251876:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827247.251878:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272843520:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787827247.251883:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272843648:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787827247.251900:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827247.251906:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827247/real 1787827247]  req@ffff9ee0056a1a40 x1874670272843648/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827272 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827247.251914:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1a40 x1874670272843648/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827272 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827247.251921:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827247.251923:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827247.251925:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272843648:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787827247.251929:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272843776:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787827247.251943:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827247.251951:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827247/real 1787827247]  req@ffff9ee0056a3c00 x1874670272843776/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827272 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827247.251965:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a3c00 x1874670272843776/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827272 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827247.251970:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827247.251972:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827247.251973:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272843776:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787827247.251978:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272843904:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787827247.251993:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827247.252001:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827247/real 1787827247]  req@ffff9ee0056a2940 x1874670272843904/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827272 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827247.252012:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a2940 x1874670272843904/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827272 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827247.252018:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827247.252021:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827247.252024:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272843904:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787827247.252031:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272844032:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787827247.252045:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827247.252052:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827247/real 1787827247]  req@ffff9ee0056a1680 x1874670272844032/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827272 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827247.252061:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1680 x1874670272844032/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827272 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827247.252071:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827247.252074:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827247.252076:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272844032:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787827247.252097:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272844160:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787827247.252118:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827247.252136:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827247/real 1787827247]  req@ffff9ee0056a0f00 x1874670272844160/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827272 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827247.252149:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0f00 x1874670272844160/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827272 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827247.252155:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827247.252158:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827247.252161:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272844160:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827248.083452:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827248.275460:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787827249.107443:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827249.299400:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827250.131519:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827250.323416:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827251.155415:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827251.347404:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827252.179463:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1787827252.371430:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1787827252.371430:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:0.0:1787827252.371448:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1787827252.371452:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827252.371461:0:8:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2416
00000100:00080000:0.0:1787827252.371470:0:8:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827252.371476:0:8:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787827252.371507:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8780 x1874670272844288/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827252.371529:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827252.371532:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787827252.371533:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827252.371536:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2416
00000100:00080000:0.0:1787827252.371538:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827252.371541:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827252.371548:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787827252.371556:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb480 x1874670272844416/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827252.371564:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827252.371567:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787827252.371568:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827252.371571:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2416
00000100:00080000:0.0:1787827252.371573:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827252.371575:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827252.371578:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787827252.371584:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9e00 x1874670272844544/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827252.371592:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827252.371595:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:1.0:1787827252.371596:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272844288:192.168.203.121@tcp:250:kworker.0
00000100:00080000:0.0:1787827252.371597:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827252.371602:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2416
00000100:00080000:0.0:1787827252.371606:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827252.371610:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827252.371614:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787827252.371620:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ea940 x1874670272844672/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827252.371626:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827252.371628:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787827252.371629:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827252.371632:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2416
00000100:00080000:0.0:1787827252.371635:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827252.371637:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827252.371640:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787827252.371646:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb0c0 x1874670272844800/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827252.371652:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827252.371655:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787827252.371656:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827252.371659:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2416
00000100:00080000:0.0:1787827252.371670:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827252.371672:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827252.371675:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787827252.371682:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9a40 x1874670272844928/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827252.371688:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827252.371690:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787827252.371691:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827252.371694:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2416
00000100:00080000:0.0:1787827252.371697:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827252.371699:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827252.371702:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787827252.371710:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ea580 x1874670272845056/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787827252.371738:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272844416:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787827252.371808:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272844544:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827252.371849:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272844672:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827252.371881:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272844800:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787827252.371908:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272844928:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827252.371937:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272845056:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827253.203459:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827253.395470:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787827254.227437:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827254.419531:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827255.251454:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827255.443611:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000400:00000100:1.0:1787827255.443717:0:2355:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.203.121:988
00000400:00000100:1.0:1787827255.443756:0:2355:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.203.121@tcp at host 192.168.203.121 was unreachable: the network or that node may be down, or Lustre may be misconfigured.
00000800:00000100:1.0:1787827255.443773:0:2355:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:1.0:1787827255.443812:0:2355:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:1.0:1787827255.443823:0:2355:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:1.0:1787827255.443831:0:2355:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:1.0:1787827255.443842:0:2355:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:1.0:1787827255.443853:0:2355:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:1.0:1787827255.443863:0:2355:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000100:00100000:0.0:1787827255.443869:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827252/real 1787827255]  req@ffff9ee0056e9e00 x1874670272844544/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827277 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827255.443895:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9e00 x1874670272844544/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827277 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827255.443908:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827255.443912:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827255.443917:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272844544:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787827255.443925:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827252/real 1787827255]  req@ffff9ee0056ea940 x1874670272844672/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827277 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827255.443940:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ea940 x1874670272844672/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827277 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827255.443949:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827255.443953:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827255.443957:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272844672:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787827255.443966:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827252/real 1787827255]  req@ffff9ee0056eb0c0 x1874670272844800/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827277 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827255.443980:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb0c0 x1874670272844800/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827277 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827255.443990:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827255.443994:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827255.443997:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272844800:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787827255.444004:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827252/real 1787827255]  req@ffff9ee0056e9a40 x1874670272844928/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827277 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827255.444013:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9a40 x1874670272844928/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827277 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827255.444018:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827255.444022:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827255.444025:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272844928:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787827255.444032:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827252/real 1787827255]  req@ffff9ee0056ea580 x1874670272845056/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827277 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827255.444044:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ea580 x1874670272845056/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827277 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827255.444051:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827255.444054:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827255.444058:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272845056:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787827255.444065:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827252/real 1787827255]  req@ffff9ee0056e8780 x1874670272844288/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827277 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827255.444077:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8780 x1874670272844288/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827277 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827255.444084:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827255.444087:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827255.444091:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272844288:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787827255.444096:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827252/real 1787827255]  req@ffff9ee0056eb480 x1874670272844416/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827277 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827255.444108:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb480 x1874670272844416/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827277 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827255.444115:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827255.444118:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827255.444121:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272844416:192.168.203.121@tcp:38:kworker.0
00010000:00010000:3.0:1787827256.275496:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827256.467536:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827257.299468:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1787827257.491439:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827257.491450:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1787827257.491454:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827257.491466:0:8:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2421
00000100:00080000:0.0:1787827257.491479:0:8:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827257.491487:0:8:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787827257.491487:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00100000:0.0:1787827257.491533:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb480 x1874670272845184/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827257.491575:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827257.491579:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787827257.491580:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827257.491583:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2421
00000100:00080000:0.0:1787827257.491586:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827257.491589:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827257.491598:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787827257.491613:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8780 x1874670272845312/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827257.491625:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827257.491629:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787827257.491632:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827257.491636:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2421
00000100:00080000:0.0:1787827257.491641:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1787827257.491647:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272845184:192.168.203.121@tcp:250:kworker.0
00000100:00080000:0.0:1787827257.491654:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827257.491665:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787827257.491701:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ea580 x1874670272845440/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827257.491713:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827257.491726:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000800:00000100:1.0:1787827257.491733:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:0.0:1787827257.491739:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827257.491748:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2421
00000100:00080000:0.0:1787827257.491756:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827257.491761:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827257.491768:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787827257.491787:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9a40 x1874670272845568/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787827257.491792:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827257/real 1787827257]  req@ffff9ee0056eb480 x1874670272845184/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827282 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827257.491821:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827257.491827:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787827257.491829:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1787827257.491836:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb480 x1874670272845184/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827282 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827257.491842:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2421
00000100:00080000:0.0:1787827257.491855:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827257.491872:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00080000:1.0:1787827257.491875:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000008:00100000:0.0:1787827257.491883:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00080000:1.0:1787827257.491887:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827257.491899:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272845184:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787827257.491909:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb0c0 x1874670272845696/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787827257.491921:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272845312:192.168.203.121@tcp:38:kworker.0
00000100:00080000:0.0:1787827257.491931:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827257.491937:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787827257.491940:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827257.491947:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2421
00000100:00080000:0.0:1787827257.491961:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000800:00000100:1.0:1787827257.491965:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:0.0:1787827257.491972:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827257.491981:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787827257.491997:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827257/real 1787827257]  req@ffff9ee0056e8780 x1874670272845312/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827282 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827257.491999:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ea940 x1874670272845824/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827257.492132:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827257.492138:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787827257.492141:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1787827257.492147:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8780 x1874670272845312/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827282 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827257.492153:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2421
00000100:00080000:0.0:1787827257.492159:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827257.492163:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827257.492169:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:1.0:1787827257.492192:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:0.0:1787827257.492195:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9e00 x1874670272845952/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827257.492201:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827257.492217:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272845312:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787827257.492256:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272845440:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827257.492286:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827257.492300:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827257/real 1787827257]  req@ffff9ee0056ea580 x1874670272845440/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827282 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827257.492312:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ea580 x1874670272845440/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827282 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827257.492358:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827257.492362:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827257.492366:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272845440:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827257.492372:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272845568:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827257.492395:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827257.492421:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827257/real 1787827257]  req@ffff9ee0056e9a40 x1874670272845568/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827282 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827257.492433:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9a40 x1874670272845568/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827282 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827257.492446:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827257.492450:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827257.492453:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272845568:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827257.492460:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272845696:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787827257.492483:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827257.492494:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827257/real 1787827257]  req@ffff9ee0056eb0c0 x1874670272845696/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827282 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827257.492506:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb0c0 x1874670272845696/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827282 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827257.492514:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827257.492518:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827257.492521:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272845696:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787827257.492528:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272845824:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827257.492551:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827257.492563:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827257/real 1787827257]  req@ffff9ee0056ea940 x1874670272845824/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827282 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827257.492575:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ea940 x1874670272845824/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827282 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827257.492583:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827257.492593:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827257.492598:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272845824:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827257.492606:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272845952:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827257.492630:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827257.492643:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827257/real 1787827257]  req@ffff9ee0056e9e00 x1874670272845952/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827282 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827257.492655:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9e00 x1874670272845952/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827282 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827257.492663:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827257.492667:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827257.492670:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272845952:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827258.323481:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827258.515539:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787827259.347472:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827259.539415:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827260.371492:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827260.563444:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827261.395467:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827261.587435:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827262.419453:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827262.611412:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:0.0:1787827262.611445:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827262.611451:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1787827262.611454:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827262.611463:0:8:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2426
00000100:00080000:0.0:1787827262.611472:0:8:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827262.611479:0:8:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787827262.611509:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ead00 x1874670272846080/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827262.611529:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827262.611532:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787827262.611534:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827262.611536:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2426
00000100:00080000:0.0:1787827262.611539:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827262.611542:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827262.611550:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787827262.611561:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272846080:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787827262.611562:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9e00 x1874670272846208/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827262.611576:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827262.611578:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787827262.611579:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827262.611582:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2426
00000100:00080000:0.0:1787827262.611585:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827262.611587:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827262.611591:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787827262.611598:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ea940 x1874670272846336/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827262.611604:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827262.611606:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787827262.611608:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827262.611611:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2426
00000100:00080000:0.0:1787827262.611613:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827262.611615:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827262.611618:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1787827262.611622:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827262.611628:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb0c0 x1874670272846464/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827262.611635:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827262.611638:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787827262.611640:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827262.611642:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2426
00000100:00080000:0.0:1787827262.611645:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827262.611647:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827262.611650:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787827262.611659:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827262/real 1787827262]  req@ffff9ee0056ead00 x1874670272846080/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827287 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827262.611660:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9a40 x1874670272846592/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827262.611688:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827262.611691:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787827262.611693:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827262.611696:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2426
00000100:00100000:1.0:1787827262.611700:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ead00 x1874670272846080/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827287 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827262.611701:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827262.611707:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827262.611712:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:1.0:1787827262.611718:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:0.0:1787827262.611723:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ea580 x1874670272846720/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827262.611726:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827262.611733:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272846080:192.168.203.121@tcp:250:kworker.0
00000100:00080000:0.0:1787827262.611736:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827262.611740:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787827262.611741:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827262.611745:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2426
00000100:00080000:0.0:1787827262.611747:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827262.611750:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827262.611753:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787827262.611755:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272846208:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787827262.611763:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8780 x1874670272846848/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1787827262.611776:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827262.611788:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827262/real 1787827262]  req@ffff9ee0056e9e00 x1874670272846208/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827287 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827262.611796:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9e00 x1874670272846208/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827287 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827262.611802:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827262.611804:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827262.611806:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272846208:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787827262.611810:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272846336:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827262.611824:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827262.611844:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827262/real 1787827262]  req@ffff9ee0056ea940 x1874670272846336/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827287 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827262.611858:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ea940 x1874670272846336/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827287 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827262.611866:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827262.611869:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827262.611873:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272846336:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827262.611880:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272846464:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827262.611896:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827262.611903:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827262/real 1787827262]  req@ffff9ee0056eb0c0 x1874670272846464/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827287 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827262.611910:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb0c0 x1874670272846464/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827287 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827262.611916:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827262.611918:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827262.611920:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272846464:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827262.611924:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272846592:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787827262.611933:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827262.611938:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827262/real 1787827262]  req@ffff9ee0056e9a40 x1874670272846592/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827287 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827262.611945:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9a40 x1874670272846592/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827287 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827262.611950:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827262.611952:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827262.611954:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272846592:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787827262.611957:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272846720:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827262.611966:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827262.611971:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827262/real 1787827262]  req@ffff9ee0056ea580 x1874670272846720/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827287 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827262.611984:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ea580 x1874670272846720/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827287 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827262.611989:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827262.611991:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827262.611994:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272846720:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827262.612006:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272846848:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827262.612017:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827262.612023:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827262/real 1787827262]  req@ffff9ee0056e8780 x1874670272846848/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827287 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827262.612030:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8780 x1874670272846848/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827287 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827262.612035:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827262.612037:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827262.612039:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272846848:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827263.443477:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827263.635433:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787827264.467472:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827264.659419:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827265.491474:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827265.683447:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827266.515432:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827266.707436:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827267.539456:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827267.731445:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:0.0:1787827267.731455:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827267.731460:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1787827267.731464:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827267.731473:0:8:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2431
00000100:00080000:0.0:1787827267.731483:0:8:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827267.731490:0:8:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787827267.731521:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb480 x1874670272846976/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827267.731542:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827267.731545:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787827267.731546:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827267.731549:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2431
00000100:00080000:0.0:1787827267.731551:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827267.731553:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827267.731560:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787827267.731570:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8b40 x1874670272847104/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827267.731578:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827267.731581:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787827267.731585:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1787827267.731585:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272846976:192.168.203.121@tcp:250:kworker.0
00000100:00080000:0.0:1787827267.731591:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2431
00000100:00080000:0.0:1787827267.731595:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827267.731598:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827267.731601:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787827267.731612:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb840 x1874670272847232/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827267.731619:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827267.731621:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787827267.731623:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827267.731631:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2431
00000100:00080000:0.0:1787827267.731636:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827267.731639:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827267.731642:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1787827267.731647:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827267.731654:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9680 x1874670272847360/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827267.731662:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827267.731664:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787827267.731665:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827267.731668:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2431
00000100:00080000:0.0:1787827267.731671:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827267.731674:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827267.731677:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787827267.731691:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e92c0 x1874670272847488/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787827267.731691:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827267/real 1787827267]  req@ffff9ee0056eb480 x1874670272846976/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827292 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827267.731722:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827267.731725:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787827267.731727:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827267.731730:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2431
00000100:00100000:1.0:1787827267.731733:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb480 x1874670272846976/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827292 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827267.731735:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827267.731742:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827267.731749:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:1.0:1787827267.731752:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827267.731758:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827267.731759:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e83c0 x1874670272847616/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787827267.731764:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272846976:192.168.203.121@tcp:250:kworker.0
00000100:00080000:0.0:1787827267.731776:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827267.731778:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787827267.731780:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827267.731783:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2431
00000100:00080000:0.0:1787827267.731785:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827267.731788:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827267.731791:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787827267.731792:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272847104:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787827267.731801:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ebc00 x1874670272847744/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1787827267.731817:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827267.731830:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827267/real 1787827267]  req@ffff9ee0056e8b40 x1874670272847104/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827292 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827267.731839:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8b40 x1874670272847104/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827292 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827267.731853:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827267.731855:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827267.731858:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272847104:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787827267.731862:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272847232:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827267.731875:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827267.731882:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827267/real 1787827267]  req@ffff9ee0056eb840 x1874670272847232/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827292 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827267.731890:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb840 x1874670272847232/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827292 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827267.731894:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827267.731896:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827267.731898:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272847232:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827267.731902:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272847360:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827267.731911:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827267.731917:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827267/real 1787827267]  req@ffff9ee0056e9680 x1874670272847360/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827292 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827267.731924:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9680 x1874670272847360/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827292 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827267.731929:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827267.731931:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827267.731933:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272847360:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827267.731937:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272847488:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787827267.731946:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827267.731951:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827267/real 1787827267]  req@ffff9ee0056e92c0 x1874670272847488/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827292 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827267.731958:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e92c0 x1874670272847488/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827292 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827267.731963:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827267.731964:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827267.731966:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272847488:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787827267.731970:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272847616:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827267.731979:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827267.731984:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827267/real 1787827267]  req@ffff9ee0056e83c0 x1874670272847616/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827292 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827267.731990:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e83c0 x1874670272847616/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827292 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827267.731995:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827267.731997:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827267.731999:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272847616:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827267.732011:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272847744:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827267.732021:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827267.732027:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827267/real 1787827267]  req@ffff9ee0056ebc00 x1874670272847744/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827292 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827267.732034:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ebc00 x1874670272847744/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827292 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827267.732039:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827267.732041:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827267.732043:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272847744:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827268.563462:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827268.755379:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787827269.587453:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827269.779394:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827270.611450:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827270.803366:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827271.635459:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827271.827361:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827272.659438:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827272.851397:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:0.0:1787827272.851411:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827272.851418:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1787827272.851422:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827272.851433:0:8:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2436
00000100:00080000:0.0:1787827272.851444:0:8:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827272.851452:0:8:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787827272.851487:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8f00 x1874670272847872/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827272.851508:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827272.851510:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787827272.851512:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827272.851515:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2436
00000100:00080000:0.0:1787827272.851517:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827272.851520:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827272.851528:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787827272.851537:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8000 x1874670272848000/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827272.851546:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827272.851549:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00100000:1.0:1787827272.851549:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272847872:192.168.203.121@tcp:250:kworker.0
00000100:00080000:0.0:1787827272.851553:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827272.851560:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2436
00000100:00080000:0.0:1787827272.851562:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827272.851564:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827272.851567:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787827272.851578:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ebc00 x1874670272848128/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827272.851584:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827272.851587:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787827272.851595:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827272.851597:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2436
00000100:00080000:0.0:1787827272.851601:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827272.851604:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827272.851607:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1787827272.851612:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827272.851619:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e83c0 x1874670272848256/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827272.851628:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827272.851631:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787827272.851632:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827272.851634:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2436
00000100:00080000:0.0:1787827272.851637:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827272.851640:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827272.851643:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787827272.851648:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827272/real 1787827272]  req@ffff9ee0056e8f00 x1874670272847872/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827297 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827272.851654:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e92c0 x1874670272848384/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827272.851673:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827272.851678:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00100000:1.0:1787827272.851679:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8f00 x1874670272847872/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827297 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827272.851681:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827272.851689:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2436
00000100:00080000:0.0:1787827272.851693:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827272.851699:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00080000:1.0:1787827272.851699:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000008:00100000:0.0:1787827272.851704:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:1.0:1787827272.851707:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827272.851712:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272847872:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787827272.851715:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9680 x1874670272848512/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827272.851722:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827272.851725:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787827272.851726:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827272.851728:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2436
00000100:00080000:0.0:1787827272.851731:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827272.851737:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787827272.851738:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272848000:192.168.203.121@tcp:38:kworker.0
00000008:00100000:0.0:1787827272.851740:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787827272.851750:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb840 x1874670272848640/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1787827272.851761:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827272.851773:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827272/real 1787827272]  req@ffff9ee0056e8000 x1874670272848000/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827297 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827272.851782:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8000 x1874670272848000/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827297 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827272.851788:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827272.851790:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827272.851793:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272848000:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787827272.851797:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272848128:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827272.851808:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827272.851814:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827272/real 1787827272]  req@ffff9ee0056ebc00 x1874670272848128/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827297 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827272.851821:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ebc00 x1874670272848128/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827297 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827272.851826:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827272.851828:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827272.851830:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272848128:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827272.851833:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272848256:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827272.851843:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827272.851848:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827272/real 1787827272]  req@ffff9ee0056e83c0 x1874670272848256/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827297 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827272.851855:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e83c0 x1874670272848256/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827297 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827272.851860:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827272.851862:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827272.851864:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272848256:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827272.851868:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272848384:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787827272.851877:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827272.851882:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827272/real 1787827272]  req@ffff9ee0056e92c0 x1874670272848384/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827297 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827272.851889:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e92c0 x1874670272848384/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827297 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827272.851893:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827272.851895:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827272.851897:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272848384:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787827272.851900:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272848512:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827272.851919:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827272.851926:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827272/real 1787827272]  req@ffff9ee0056e9680 x1874670272848512/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827297 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827272.851932:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9680 x1874670272848512/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827297 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827272.851937:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827272.851939:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827272.851941:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272848512:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827272.851953:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272848640:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827272.851963:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827272.851975:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827272/real 1787827272]  req@ffff9ee0056eb840 x1874670272848640/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827297 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827272.851983:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb840 x1874670272848640/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827297 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827272.851989:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827272.851990:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827272.851992:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272848640:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827273.683446:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827273.875390:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787827274.707463:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827274.899464:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827275.731482:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827275.923439:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827276.755442:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827276.947413:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827277.779455:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827277.971448:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787827277.971453:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827277.971461:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787827277.971466:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827277.971476:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2441
00000100:00080000:3.0:1787827277.971488:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827277.971496:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787827277.971541:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057043c0 x1874670272848768/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827277.971568:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827277.971571:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787827277.971573:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827277.971580:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2441
00000100:00080000:3.0:1787827277.971583:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827277.971585:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827277.971595:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787827277.971605:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057052c0 x1874670272848896/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827277.971615:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827277.971619:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787827277.971622:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827277.971626:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2441
00000100:00080000:3.0:1787827277.971630:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1787827277.971634:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272848768:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787827277.971637:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827277.971650:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827277.971666:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704b40 x1874670272849024/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827277.971675:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827277.971678:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787827277.971680:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827277.971683:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2441
00000100:00080000:3.0:1787827277.971688:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827277.971691:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827277.971694:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827277.971704:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707480 x1874670272849152/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827277.971714:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827277.971718:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787827277.971720:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827277.971724:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2441
00000800:00000100:1.0:1787827277.971730:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787827277.971730:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827277.971740:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827277.971747:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787827277.971760:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057061c0 x1874670272849280/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827277.971768:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827277.971770:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787827277.971772:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827277.971775:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2441
00000100:00080000:3.0:1787827277.971779:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827277.971782:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827277.971786:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787827277.971792:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827277/real 1787827277]  req@ffff9ee0057043c0 x1874670272848768/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827302 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827277.971798:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705a40 x1874670272849408/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827277.971824:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827277.971827:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787827277.971828:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827277.971831:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2441
00000100:00080000:3.0:1787827277.971835:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1787827277.971836:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057043c0 x1874670272848768/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827302 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827277.971840:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827277.971846:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827277.971856:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704780 x1874670272849536/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827277.971859:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827277.971870:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827277.971876:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272848768:192.168.203.121@tcp:250:kworker.0
00000100:00100000:1.0:1787827277.971887:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272848896:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787827277.971914:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827277.971928:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827277/real 1787827277]  req@ffff9ee0057052c0 x1874670272848896/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827302 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827277.971942:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057052c0 x1874670272848896/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827302 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827277.971952:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827277.971955:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827277.971959:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272848896:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787827277.971985:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272849024:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827277.972008:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827277.972021:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827277/real 1787827277]  req@ffff9ee005704b40 x1874670272849024/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827302 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827277.972034:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704b40 x1874670272849024/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827302 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827277.972043:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827277.972047:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827277.972051:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272849024:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827277.972058:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272849152:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827277.972078:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827277.972090:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827277/real 1787827277]  req@ffff9ee005707480 x1874670272849152/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827302 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827277.972103:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707480 x1874670272849152/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827302 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827277.972112:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827277.972116:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827277.972119:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272849152:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827277.972136:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272849280:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787827277.972155:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827277.972166:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827277/real 1787827277]  req@ffff9ee0057061c0 x1874670272849280/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827302 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827277.972180:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057061c0 x1874670272849280/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827302 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827277.972197:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827277.972200:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827277.972204:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272849280:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787827277.972211:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272849408:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827277.972232:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827277.972245:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827277/real 1787827277]  req@ffff9ee005705a40 x1874670272849408/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827302 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827277.972258:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705a40 x1874670272849408/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827302 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827277.972281:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827277.972285:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827277.972289:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272849408:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827277.972296:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272849536:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827277.972312:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827277.972347:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827277/real 1787827277]  req@ffff9ee005704780 x1874670272849536/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827302 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827277.972355:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704780 x1874670272849536/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827302 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827277.972360:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827277.972362:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827277.972364:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272849536:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827278.803435:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827278.995435:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787827279.827453:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827280.019423:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827280.851493:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827281.043412:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827281.875431:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827282.067414:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827282.899460:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1787827283.091433:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827283.091444:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787827283.091449:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1787827283.091452:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787827283.091461:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2446
00000100:00080000:3.0:1787827283.091473:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827283.091481:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787827283.091516:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705e00 x1874670272849664/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827283.091540:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827283.091544:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787827283.091546:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827283.091550:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2446
00000100:00080000:3.0:1787827283.091553:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827283.091557:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827283.091566:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787827283.091580:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272849664:192.168.203.121@tcp:250:kworker.0
00000100:00100000:3.0:1787827283.091580:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707840 x1874670272849792/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827283.091597:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827283.091600:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787827283.091602:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827283.091605:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2446
00000100:00080000:3.0:1787827283.091608:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827283.091610:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827283.091614:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827283.091623:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704780 x1874670272849920/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827283.091629:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827283.091632:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787827283.091633:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827283.091636:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2446
00000100:00080000:3.0:1787827283.091645:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827283.091648:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827283.091651:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:2.0:1787827283.091658:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827283.091661:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705a40 x1874670272850048/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827283.091669:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827283.091672:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787827283.091674:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827283.091678:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2446
00000100:00080000:3.0:1787827283.091682:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1787827283.091694:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827283/real 1787827283]  req@ffff9ee005705e00 x1874670272849664/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827308 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827283.091708:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705e00 x1874670272849664/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827308 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827283.091716:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827283.091720:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827283.091723:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272849664:192.168.203.121@tcp:250:kworker.0
00000100:00100000:2.0:1787827283.091740:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272849792:192.168.203.121@tcp:38:kworker.0
00000100:00080000:3.0:1787827283.091759:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827283.091766:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000800:00000100:2.0:1787827283.091767:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827283.091780:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827283/real 1787827283]  req@ffff9ee005707840 x1874670272849792/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827308 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827283.091787:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057061c0 x1874670272850176/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787827283.091793:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707840 x1874670272849792/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827308 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827283.091800:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827283.091802:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827283.091805:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272849792:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787827283.091810:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272849920:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787827283.091822:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827283.091832:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827283/real 1787827283]  req@ffff9ee005704780 x1874670272849920/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827308 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827283.091845:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704780 x1874670272849920/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827308 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827283.091854:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827283.091858:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827283.091862:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272849920:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787827283.091870:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272850048:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787827283.091903:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787827283.091904:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827283.091908:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787827283.091910:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827283.091915:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2446
00000100:00080000:3.0:1787827283.091919:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1787827283.091922:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827283/real 1787827283]  req@ffff9ee005705a40 x1874670272850048/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827308 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827283.091932:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705a40 x1874670272850048/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827308 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827283.091939:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827283.091942:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827283.091952:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272850048:192.168.203.121@tcp:8:kworker.0
00000100:00080000:3.0:1787827283.091959:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827283.091965:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827283.091978:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707480 x1874670272850304/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787827283.091990:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272850176:192.168.203.121@tcp:38:kworker.0
00000100:00080000:3.0:1787827283.091990:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827283.091998:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787827283.092001:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827283.092005:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2446
00000100:00080000:3.0:1787827283.092008:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827283.092010:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827283.092014:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827283.092024:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704b40 x1874670272850432/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1787827283.092025:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827283.092048:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827283/real 1787827283]  req@ffff9ee0057061c0 x1874670272850176/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827308 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827283.092063:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057061c0 x1874670272850176/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827308 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827283.092072:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827283.092075:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827283.092079:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272850176:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787827283.092090:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272850304:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787827283.092107:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827283.092114:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827283/real 1787827283]  req@ffff9ee005707480 x1874670272850304/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827308 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827283.092122:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707480 x1874670272850304/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827308 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827283.092128:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827283.092130:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827283.092132:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272850304:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787827283.092135:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272850432:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787827283.092144:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827283.092150:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827283/real 1787827283]  req@ffff9ee005704b40 x1874670272850432/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827308 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827283.092157:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704b40 x1874670272850432/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827308 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827283.092162:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827283.092164:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827283.092166:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272850432:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827283.923438:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827284.115470:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787827284.947521:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827285.139368:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827285.971449:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827286.163370:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827286.995472:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827287.187396:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827288.019459:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1787827288.211484:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827288.211496:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787827288.211501:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827288.211511:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2451
00000100:00080000:2.0:1787827288.211525:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827288.211534:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787827288.211553:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00100000:2.0:1787827288.211577:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057292c0 x1874670272850560/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827288.211617:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827288.211623:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787827288.211625:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827288.211630:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2451
00000100:00080000:2.0:1787827288.211634:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827288.211638:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827288.211649:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787827288.211677:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057292c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272850560:192.168.203.121@tcp:250:kworker.0
00000100:00100000:2.0:1787827288.211678:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729680 x1874670272850688/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827288.211727:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827288.211733:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787827288.211737:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827288.211745:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2451
00000100:00080000:2.0:1787827288.211751:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827288.211757:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827288.211767:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1787827288.211777:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827288.211794:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572bc00 x1874670272850816/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827288.211814:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827288.211820:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787827288.211823:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827288.211829:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2451
00000100:00080000:2.0:1787827288.211837:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1787827288.211844:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827288/real 1787827288]  req@ffff9ee0057292c0 x1874670272850560/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827313 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827288.211869:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787827288.211878:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057292c0 x1874670272850560/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827313 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:2.0:1787827288.211883:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:1.0:1787827288.211892:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827288.211897:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827288.211902:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057292c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272850560:192.168.203.121@tcp:250:kworker.0
00000100:00100000:2.0:1787827288.211916:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728780 x1874670272850944/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827288.211931:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827288.211934:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787827288.211938:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1787827288.211944:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272850688:192.168.203.121@tcp:38:kworker.0
00000100:00080000:2.0:1787827288.211949:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2451
00000100:00080000:2.0:1787827288.211961:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827288.211970:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827288.211977:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787827288.211993:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a940 x1874670272851072/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1787827288.211996:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:2.0:1787827288.212016:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1787827288.212023:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827288/real 1787827288]  req@ffff9ee005729680 x1874670272850688/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827313 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827288.212028:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787827288.212036:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827288.212056:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2451
00000100:00080000:2.0:1787827288.212063:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1787827288.212070:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729680 x1874670272850688/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827313 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827288.212074:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827288.212094:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:1.0:1787827288.212096:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827288.212104:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827288.212111:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a1c0 x1874670272851200/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787827288.212120:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272850688:192.168.203.121@tcp:38:kworker.0
00000100:00080000:2.0:1787827288.212134:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827288.212143:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787827288.212145:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1787827288.212152:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272850816:192.168.203.121@tcp:8:kworker.0
00000100:00080000:2.0:1787827288.212152:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2451
00000100:00080000:2.0:1787827288.212156:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827288.212160:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827288.212170:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787827288.212184:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728f00 x1874670272851328/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1787827288.212222:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827288.212247:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827288/real 1787827288]  req@ffff9ee00572bc00 x1874670272850816/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827313 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827288.212263:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572bc00 x1874670272850816/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827313 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827288.212271:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827288.212274:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827288.212277:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272850816:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827288.212283:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272850944:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827288.212298:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827288.212305:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827288/real 1787827288]  req@ffff9ee005728780 x1874670272850944/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827313 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827288.212312:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728780 x1874670272850944/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827313 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827288.212339:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827288.212343:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827288.212345:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272850944:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827288.212363:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272851072:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787827288.212377:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827288.212385:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827288/real 1787827288]  req@ffff9ee00572a940 x1874670272851072/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827313 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827288.212393:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a940 x1874670272851072/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827313 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827288.212399:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827288.212401:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827288.212403:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272851072:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787827288.212407:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272851200:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827288.212419:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827288.212425:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827288/real 1787827288]  req@ffff9ee00572a1c0 x1874670272851200/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827313 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827288.212432:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a1c0 x1874670272851200/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827313 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827288.212437:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827288.212439:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827288.212442:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272851200:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827288.212456:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272851328:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827288.212468:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827288.212475:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827288/real 1787827288]  req@ffff9ee005728f00 x1874670272851328/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827313 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827288.212482:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728f00 x1874670272851328/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827313 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827288.212487:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827288.212489:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827288.212491:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272851328:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827289.043457:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787827289.235398:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787827290.067445:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827290.259461:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827291.091446:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827291.283407:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827292.115445:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827292.307397:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827293.139451:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827293.331420:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787827293.331420:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827293.331430:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787827293.331434:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827293.331443:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2457
00000100:00080000:3.0:1787827293.331452:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827293.331459:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787827293.331496:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057052c0 x1874670272851456/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827293.331526:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827293.331531:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787827293.331532:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827293.331536:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2457
00000100:00080000:3.0:1787827293.331539:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827293.331543:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827293.331552:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787827293.331564:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057043c0 x1874670272851584/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787827293.331571:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272851456:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787827293.331578:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827293.331582:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787827293.331584:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827293.331588:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2457
00000100:00080000:3.0:1787827293.331591:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827293.331594:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827293.331597:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827293.331609:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706580 x1874670272851712/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827293.331634:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827293.331637:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787827293.331639:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827293.331643:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2457
00000100:00080000:3.0:1787827293.331646:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827293.331649:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000800:00000100:1.0:1787827293.331657:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000008:00100000:3.0:1787827293.331658:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827293.331680:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705680 x1874670272851840/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827293.331711:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827293.331715:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00100000:1.0:1787827293.331718:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827293/real 1787827293]  req@ffff9ee0057052c0 x1874670272851456/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827318 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827293.331720:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827293.331733:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2457
00000100:00080000:3.0:1787827293.331740:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1787827293.331746:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057052c0 x1874670272851456/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827318 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827293.331747:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827293.331757:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00080000:1.0:1787827293.331762:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827293.331768:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827293.331772:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272851456:192.168.203.121@tcp:250:kworker.0
00000100:00100000:3.0:1787827293.331798:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706940 x1874670272851968/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787827293.331811:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272851584:192.168.203.121@tcp:38:kworker.0
00000100:00080000:3.0:1787827293.331811:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827293.331822:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787827293.331825:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827293.331832:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2457
00000100:00080000:3.0:1787827293.331837:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000800:00000100:1.0:1787827293.331858:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787827293.331859:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827293.331868:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787827293.331879:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827293/real 1787827293]  req@ffff9ee0057043c0 x1874670272851584/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827318 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827293.331882:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707c00 x1874670272852096/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787827293.331907:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057043c0 x1874670272851584/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827318 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827293.331907:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827293.331915:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787827293.331919:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827293.331928:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827293.331928:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2457
00000100:00080000:3.0:1787827293.331935:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827293.331936:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00080000:3.0:1787827293.331941:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787827293.331942:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272851584:192.168.203.121@tcp:38:kworker.0
00000008:00100000:3.0:1787827293.331947:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787827293.331951:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272851712:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787827293.331959:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704000 x1874670272852224/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1787827293.331990:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827293.332005:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827293/real 1787827293]  req@ffff9ee005706580 x1874670272851712/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827318 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827293.332014:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706580 x1874670272851712/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827318 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827293.332020:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827293.332023:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827293.332025:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272851712:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827293.332029:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272851840:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827293.332041:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827293.332047:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827293/real 1787827293]  req@ffff9ee005705680 x1874670272851840/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827318 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827293.332055:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705680 x1874670272851840/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827318 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827293.332061:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827293.332063:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827293.332065:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272851840:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827293.332077:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272851968:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787827293.332088:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827293.332095:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827293/real 1787827293]  req@ffff9ee005706940 x1874670272851968/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827318 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827293.332102:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706940 x1874670272851968/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827318 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827293.332108:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827293.332110:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827293.332113:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272851968:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787827293.332117:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272852096:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827293.332127:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827293.332133:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827293/real 1787827293]  req@ffff9ee005707c00 x1874670272852096/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827318 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827293.332141:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707c00 x1874670272852096/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827318 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827293.332146:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827293.332148:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827293.332151:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272852096:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827293.332170:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272852224:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827293.332202:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827293.332209:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827293/real 1787827293]  req@ffff9ee005704000 x1874670272852224/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827318 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827293.332217:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704000 x1874670272852224/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827318 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827293.332222:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827293.332224:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827293.332226:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272852224:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827294.163453:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827294.355396:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787827295.187496:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827295.379399:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827296.211459:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827296.403452:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827297.235469:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827297.427424:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827298.259475:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1787827298.451470:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1787827298.451475:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:2.0:1787827298.451484:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787827298.451489:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827298.451497:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2462
00000100:00080000:2.0:1787827298.451507:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827298.451514:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787827298.451545:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b840 x1874670272852352/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827298.451568:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827298.451571:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787827298.451572:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827298.451575:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2462
00000100:00080000:2.0:1787827298.451577:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827298.451580:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827298.451587:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787827298.451597:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057283c0 x1874670272852480/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827298.451604:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827298.451606:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787827298.451607:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827298.451609:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2462
00000100:00080000:2.0:1787827298.451611:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827298.451613:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827298.451616:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787827298.451623:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729e00 x1874670272852608/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827298.451630:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827298.451633:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787827298.451634:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827298.451637:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2462
00000100:00080000:2.0:1787827298.451639:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827298.451641:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827298.451644:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787827298.451652:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728000 x1874670272852736/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787827298.451664:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272852352:192.168.203.121@tcp:250:kworker.0
00000100:00080000:2.0:1787827298.451666:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827298.451673:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787827298.451677:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827298.451683:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2462
00000100:00080000:2.0:1787827298.451685:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827298.451688:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827298.451691:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787827298.451700:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a580 x1874670272852864/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827298.451707:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827298.451709:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787827298.451711:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827298.451714:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2462
00000100:00080000:2.0:1787827298.451717:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827298.451719:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827298.451722:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787827298.451739:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728b40 x1874670272852992/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827298.451748:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827298.451751:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787827298.451752:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827298.451755:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2462
00000100:00080000:2.0:1787827298.451758:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827298.451761:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827298.451766:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1787827298.451767:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827298.451784:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b0c0 x1874670272853120/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787827298.451840:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827298/real 1787827298]  req@ffff9ee00572b840 x1874670272852352/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827323 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827298.451862:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b840 x1874670272852352/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827323 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827298.451873:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827298.451877:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827298.451880:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272852352:192.168.203.121@tcp:250:kworker.0
00000100:00100000:1.0:1787827298.451887:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272852480:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787827298.451910:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827298.451920:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827298/real 1787827298]  req@ffff9ee0057283c0 x1874670272852480/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827323 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827298.451929:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057283c0 x1874670272852480/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827323 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827298.451935:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827298.451937:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827298.451939:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272852480:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787827298.451943:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272852608:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827298.451956:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827298.451962:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827298/real 1787827298]  req@ffff9ee005729e00 x1874670272852608/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827323 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827298.451980:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729e00 x1874670272852608/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827323 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827298.451985:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827298.451987:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827298.451989:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272852608:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827298.452017:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272852736:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827298.452028:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827298.452033:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827298/real 1787827298]  req@ffff9ee005728000 x1874670272852736/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827323 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827298.452041:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728000 x1874670272852736/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827323 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827298.452047:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827298.452049:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827298.452051:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272852736:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827298.452055:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272852864:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787827298.452064:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827298.452070:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827298/real 1787827298]  req@ffff9ee00572a580 x1874670272852864/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827323 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827298.452076:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a580 x1874670272852864/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827323 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827298.452082:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827298.452084:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827298.452085:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272852864:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787827298.452089:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272852992:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827298.452098:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827298.452104:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827298/real 1787827298]  req@ffff9ee005728b40 x1874670272852992/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827323 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827298.452110:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728b40 x1874670272852992/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827323 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827298.452137:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827298.452139:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827298.452142:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272852992:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827298.452146:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272853120:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827298.452162:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827298.452179:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827298/real 1787827298]  req@ffff9ee00572b0c0 x1874670272853120/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827323 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827298.452186:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b0c0 x1874670272853120/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827323 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827298.452192:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827298.452194:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827298.452196:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272853120:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827299.283478:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787827299.475419:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787827300.307425:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787827300.499420:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827301.331475:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787827301.523420:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827302.355442:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787827302.547448:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827303.379437:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1787827303.571429:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1787827303.571435:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:2.0:1787827303.571444:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787827303.571451:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827303.571463:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2467
00000100:00080000:2.0:1787827303.571479:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827303.571488:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787827303.571532:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b480 x1874670272853248/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827303.571560:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827303.571563:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787827303.571564:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827303.571567:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2467
00000100:00080000:2.0:1787827303.571570:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827303.571573:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827303.571584:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787827303.571600:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572ad00 x1874670272853376/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827303.571612:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827303.571616:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787827303.571618:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827303.571623:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2467
00000100:00100000:1.0:1787827303.571636:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272853248:192.168.203.121@tcp:250:kworker.0
00000100:00080000:2.0:1787827303.571636:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827303.571649:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827303.571655:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787827303.571671:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729a40 x1874670272853504/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827303.571681:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827303.571685:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787827303.571687:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827303.571691:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2467
00000100:00080000:2.0:1787827303.571694:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827303.571697:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827303.571700:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787827303.571710:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b0c0 x1874670272853632/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1787827303.571717:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:2.0:1787827303.571731:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827303.571734:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787827303.571736:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827303.571742:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2467
00000100:00080000:2.0:1787827303.571745:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827303.571749:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827303.571752:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787827303.571760:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728b40 x1874670272853760/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827303.571768:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827303.571773:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00100000:1.0:1787827303.571774:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827303/real 1787827303]  req@ffff9ee00572b480 x1874670272853248/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827328 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827303.571776:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827303.571782:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2467
00000100:00080000:2.0:1787827303.571790:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827303.571802:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827303.571809:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787827303.571832:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a580 x1874670272853888/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787827303.571840:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b480 x1874670272853248/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827328 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827303.571867:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827303.571882:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787827303.571885:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827303.571890:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2467
00000100:00080000:2.0:1787827303.571894:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827303.571897:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827303.571897:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827303.571902:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:1.0:1787827303.571908:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827303.571915:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728000 x1874670272854016/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787827303.571920:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272853248:192.168.203.121@tcp:250:kworker.0
00000100:00100000:1.0:1787827303.571939:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272853376:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787827303.571966:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827303.571977:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827303/real 1787827303]  req@ffff9ee00572ad00 x1874670272853376/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827328 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827303.571986:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572ad00 x1874670272853376/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827328 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827303.571992:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827303.571995:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827303.571997:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272853376:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787827303.572019:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272853504:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827303.572032:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827303.572039:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827303/real 1787827303]  req@ffff9ee005729a40 x1874670272853504/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827328 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827303.572048:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729a40 x1874670272853504/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827328 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827303.572056:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827303.572060:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827303.572064:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272853504:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827303.572071:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272853632:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827303.572110:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827303.572121:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827303/real 1787827303]  req@ffff9ee00572b0c0 x1874670272853632/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827328 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827303.572129:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b0c0 x1874670272853632/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827328 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827303.572135:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827303.572137:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827303.572139:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272853632:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827303.572143:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272853760:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787827303.572156:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827303.572162:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827303/real 1787827303]  req@ffff9ee005728b40 x1874670272853760/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827328 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827303.572169:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728b40 x1874670272853760/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827328 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827303.572174:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827303.572176:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827303.572178:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272853760:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787827303.572181:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272853888:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827303.572191:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827303.572197:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827303/real 1787827303]  req@ffff9ee00572a580 x1874670272853888/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827328 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827303.572204:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a580 x1874670272853888/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827328 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827303.572209:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827303.572210:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827303.572213:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272853888:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827303.572216:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272854016:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827303.572225:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827303.572230:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827303/real 1787827303]  req@ffff9ee005728000 x1874670272854016/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827328 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827303.572237:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728000 x1874670272854016/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827328 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827303.572241:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827303.572243:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827303.572245:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272854016:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827304.403471:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827304.595458:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787827305.427489:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827305.619458:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827306.451481:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827306.643450:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827307.475449:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827307.667445:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827308.499464:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1787827308.691454:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827308.691468:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00100000:0.0:1787827308.691476:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:2.0:1787827308.691482:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827308.691499:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2472
00000100:00080000:2.0:1787827308.691514:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827308.691523:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787827308.691577:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729e00 x1874670272854144/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827308.691609:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827308.691613:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787827308.691615:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827308.691618:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2472
00000100:00080000:2.0:1787827308.691622:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827308.691625:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827308.691638:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787827308.691651:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057283c0 x1874670272854272/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787827308.691661:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272854144:192.168.203.121@tcp:250:kworker.0
00000100:00080000:2.0:1787827308.691663:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827308.691678:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787827308.691681:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827308.691687:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2472
00000100:00080000:2.0:1787827308.691694:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827308.691701:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827308.691709:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787827308.691726:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b840 x1874670272854400/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1787827308.691753:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:2.0:1787827308.691753:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827308.691759:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787827308.691769:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827308.691777:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2472
00000100:00080000:2.0:1787827308.691783:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827308.691788:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787827308.691804:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827308/real 1787827308]  req@ffff9ee005729e00 x1874670272854144/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827333 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:2.0:1787827308.691805:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787827308.691830:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729e00 x1874670272854144/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827333 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827308.691842:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:2.0:1787827308.691846:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728f00 x1874670272854528/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827308.691847:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827308.691875:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272854144:192.168.203.121@tcp:250:kworker.0
00000100:00080000:2.0:1787827308.691890:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827308.691895:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787827308.691897:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827308.691902:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2472
00000100:00080000:2.0:1787827308.691907:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827308.691911:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827308.691929:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787827308.691933:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272854272:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787827308.691946:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a1c0 x1874670272854656/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827308.691959:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:1.0:1787827308.691967:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:2.0:1787827308.691969:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787827308.691972:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827308.691979:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2472
00000100:00100000:1.0:1787827308.691984:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827308/real 1787827308]  req@ffff9ee0057283c0 x1874670272854272/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827333 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827308.691984:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827308.691995:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827308.692010:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787827308.692016:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057283c0 x1874670272854272/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827333 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827308.692023:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a940 x1874670272854784/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827308.692035:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827308.692063:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827308.692066:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00080000:2.0:1787827308.692072:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:1.0:1787827308.692077:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272854272:192.168.203.121@tcp:38:kworker.0
00000100:00080000:2.0:1787827308.692077:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827308.692091:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2472
00000100:00100000:1.0:1787827308.692097:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272854400:192.168.203.121@tcp:8:kworker.0
00000100:00080000:2.0:1787827308.692098:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827308.692110:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827308.692116:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1787827308.692126:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827308.692131:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728780 x1874670272854912/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787827308.692143:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827308/real 1787827308]  req@ffff9ee00572b840 x1874670272854400/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827333 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827308.692157:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b840 x1874670272854400/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827333 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827308.692163:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827308.692167:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827308.692172:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272854400:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827308.692176:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272854528:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827308.692187:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827308.692192:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827308/real 1787827308]  req@ffff9ee005728f00 x1874670272854528/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827333 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827308.692199:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728f00 x1874670272854528/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827333 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827308.692204:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827308.692207:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827308.692209:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272854528:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827308.692221:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272854656:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787827308.692230:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827308.692236:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827308/real 1787827308]  req@ffff9ee00572a1c0 x1874670272854656/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827333 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827308.692243:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a1c0 x1874670272854656/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827333 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827308.692248:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827308.692250:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827308.692252:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272854656:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787827308.692256:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272854784:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827308.692265:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827308.692271:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827308/real 1787827308]  req@ffff9ee00572a940 x1874670272854784/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827333 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827308.692278:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a940 x1874670272854784/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827333 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827308.692283:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827308.692285:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827308.692287:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272854784:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827308.692291:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272854912:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827308.692300:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827308.692305:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827308/real 1787827308]  req@ffff9ee005728780 x1874670272854912/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827333 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827308.692312:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728780 x1874670272854912/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827333 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827308.692351:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827308.692353:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827308.692356:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272854912:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827309.523506:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787827309.715369:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787827310.547463:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787827310.739463:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827311.571455:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787827311.763392:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827312.595458:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787827312.787458:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827313.619487:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1787827313.811440:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827313.811448:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787827313.811452:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1787827313.811457:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:2.0:1787827313.811461:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2477
00000100:00080000:2.0:1787827313.811472:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827313.811479:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787827313.811509:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572bc00 x1874670272855040/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827313.811533:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827313.811537:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787827313.811538:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827313.811541:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2477
00000100:00080000:2.0:1787827313.811543:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827313.811545:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827313.811553:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787827313.811562:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729680 x1874670272855168/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827313.811569:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827313.811572:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787827313.811573:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827313.811575:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2477
00000100:00080000:2.0:1787827313.811577:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827313.811580:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827313.811582:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787827313.811589:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057292c0 x1874670272855296/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827313.811596:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827313.811598:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787827313.811600:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827313.811606:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2477
00000100:00100000:1.0:1787827313.811609:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272855040:192.168.203.121@tcp:250:kworker.0
00000100:00080000:2.0:1787827313.811610:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827313.811622:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827313.811629:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787827313.811644:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728780 x1874670272855424/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827313.811650:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827313.811653:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787827313.811654:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827313.811657:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2477
00000100:00080000:2.0:1787827313.811659:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827313.811662:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827313.811664:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787827313.811671:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a940 x1874670272855552/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827313.811677:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827313.811679:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787827313.811680:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827313.811682:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2477
00000100:00080000:2.0:1787827313.811685:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827313.811695:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827313.811698:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1787827313.811704:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827313.811708:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a1c0 x1874670272855680/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827313.811717:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827313.811719:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787827313.811722:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827313.811725:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2477
00000100:00080000:2.0:1787827313.811728:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827313.811730:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827313.811735:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787827313.811747:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728f00 x1874670272855808/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787827313.811760:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827313/real 1787827313]  req@ffff9ee00572bc00 x1874670272855040/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827338 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827313.811781:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572bc00 x1874670272855040/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827338 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827313.811806:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827313.811810:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827313.811813:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272855040:192.168.203.121@tcp:250:kworker.0
00000100:00100000:1.0:1787827313.811822:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272855168:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787827313.811850:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827313.811866:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827313/real 1787827313]  req@ffff9ee005729680 x1874670272855168/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827338 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827313.811880:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729680 x1874670272855168/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827338 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827313.811886:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827313.811888:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827313.811891:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272855168:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787827313.811917:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057292c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272855296:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827313.811934:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827313.811942:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827313/real 1787827313]  req@ffff9ee0057292c0 x1874670272855296/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827338 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827313.811950:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057292c0 x1874670272855296/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827338 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827313.811955:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827313.811958:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827313.811960:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057292c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272855296:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827313.811964:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272855424:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827313.811973:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827313.811979:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827313/real 1787827313]  req@ffff9ee005728780 x1874670272855424/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827338 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827313.811986:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728780 x1874670272855424/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827338 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827313.811992:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827313.811994:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827313.811996:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272855424:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827313.812000:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272855552:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787827313.812010:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827313.812032:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827313/real 1787827313]  req@ffff9ee00572a940 x1874670272855552/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827338 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827313.812040:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a940 x1874670272855552/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827338 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827313.812046:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827313.812048:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827313.812050:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272855552:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787827313.812054:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272855680:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827313.812068:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827313.812075:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827313/real 1787827313]  req@ffff9ee00572a1c0 x1874670272855680/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827338 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827313.812082:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a1c0 x1874670272855680/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827338 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827313.812087:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827313.812089:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827313.812091:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272855680:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827313.812102:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272855808:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827313.812117:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827313.812128:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827313/real 1787827313]  req@ffff9ee005728f00 x1874670272855808/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827338 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827313.812136:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728f00 x1874670272855808/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827338 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827313.812142:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827313.812145:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827313.812147:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272855808:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827314.643512:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827314.835490:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787827315.667471:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827315.859438:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827316.691454:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827316.883414:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827317.715460:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827317.907389:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827318.739509:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1787827318.931430:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827318.931442:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787827318.931447:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827318.931460:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2482
00000100:00100000:0.0:1787827318.931462:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787827318.931474:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827318.931485:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787827318.931531:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057070c0 x1874670272855936/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827318.931563:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827318.931566:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787827318.931568:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827318.931572:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2482
00000100:00080000:3.0:1787827318.931575:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827318.931579:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827318.931593:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787827318.931607:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706d00 x1874670272856064/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787827318.931614:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272855936:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787827318.931623:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827318.931627:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787827318.931629:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827318.931634:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2482
00000100:00080000:3.0:1787827318.931641:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827318.931645:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827318.931651:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827318.931667:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704000 x1874670272856192/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827318.931679:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827318.931683:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787827318.931686:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827318.931690:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2482
00000100:00080000:3.0:1787827318.931694:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827318.931704:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827318.931711:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827318.931727:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707c00 x1874670272856320/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827318.931736:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1787827318.931749:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272856064:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787827318.931776:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272856192:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787827318.931793:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272856320:192.168.203.121@tcp:8:kworker.0
00000100:00080000:3.0:1787827318.931824:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787827318.931827:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827318.931833:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2482
00000100:00080000:3.0:1787827318.931836:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827318.931840:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827318.931844:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787827318.931855:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706940 x1874670272856448/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827318.931967:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827318.931971:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787827318.931973:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827318.931990:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2482
00000100:00080000:3.0:1787827318.931999:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827318.932004:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827318.932022:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827318.932036:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705680 x1874670272856576/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787827318.932048:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272856448:192.168.203.121@tcp:38:kworker.0
00000100:00080000:3.0:1787827318.932052:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827318.932058:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787827318.932061:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827318.932068:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2482
00000100:00080000:3.0:1787827318.932074:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827318.932079:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827318.932086:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827318.932101:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706580 x1874670272856704/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787827318.932103:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272856576:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787827318.932142:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272856704:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827319.763490:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787827319.955406:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787827320.787459:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787827320.979428:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827321.811471:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787827322.003414:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000400:00000100:1.0:1787827322.003531:0:2353:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.203.121:988
00000400:00000100:1.0:1787827322.003562:0:2353:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.203.121@tcp at host 192.168.203.121 was unreachable: the network or that node may be down, or Lustre may be misconfigured.
00000800:00000100:1.0:1787827322.003577:0:2353:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:1.0:1787827322.003605:0:2353:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:1.0:1787827322.003611:0:2353:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:1.0:1787827322.003618:0:2353:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:1.0:1787827322.003625:0:2353:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:1.0:1787827322.003632:0:2353:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:1.0:1787827322.003639:0:2353:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000100:00100000:0.0:1787827322.003652:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827318/real 1787827322]  req@ffff9ee005705680 x1874670272856576/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827343 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827322.003679:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705680 x1874670272856576/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827343 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827322.003693:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827322.003704:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827322.003708:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272856576:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787827322.003717:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827318/real 1787827322]  req@ffff9ee005706940 x1874670272856448/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827343 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827322.003732:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706940 x1874670272856448/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827343 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827322.003742:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827322.003746:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827322.003750:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272856448:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787827322.003758:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827318/real 1787827322]  req@ffff9ee005706d00 x1874670272856064/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827343 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827322.003771:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706d00 x1874670272856064/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827343 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827322.003781:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827322.003785:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827322.003789:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272856064:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787827322.003796:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827318/real 1787827322]  req@ffff9ee005704000 x1874670272856192/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827343 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827322.003828:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704000 x1874670272856192/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827343 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827322.003838:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827322.003841:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827322.003845:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272856192:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787827322.003852:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827318/real 1787827322]  req@ffff9ee005707c00 x1874670272856320/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827343 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827322.003864:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707c00 x1874670272856320/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827343 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827322.003879:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827322.003883:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827322.003887:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272856320:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787827322.003893:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827318/real 1787827322]  req@ffff9ee0057070c0 x1874670272855936/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827343 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827322.003908:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057070c0 x1874670272855936/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827343 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827322.003916:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827322.003920:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827322.003923:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272855936:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787827322.003970:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827318/real 1787827322]  req@ffff9ee005706580 x1874670272856704/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827343 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827322.003987:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706580 x1874670272856704/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827343 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827322.003996:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827322.004000:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827322.004004:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272856704:192.168.203.121@tcp:8:kworker.0
00010000:00010000:3.0:1787827322.835480:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787827323.027421:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827323.859452:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1787827324.051430:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1787827324.051431:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787827324.051440:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787827324.051445:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827324.051455:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2487
00000100:00080000:3.0:1787827324.051465:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827324.051473:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787827324.051507:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057043c0 x1874670272856832/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827324.051534:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827324.051538:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787827324.051540:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827324.051547:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2487
00000100:00080000:3.0:1787827324.051552:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827324.051556:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787827324.051562:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272856832:192.168.203.121@tcp:250:kworker.0
00000008:00100000:3.0:1787827324.051566:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787827324.051590:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057052c0 x1874670272856960/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827324.051603:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827324.051607:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787827324.051609:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827324.051613:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2487
00000800:00000100:0.0:1787827324.051618:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787827324.051619:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827324.051627:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827324.051634:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827324.051651:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704b40 x1874670272857088/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787827324.051661:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827324/real 1787827324]  req@ffff9ee0057043c0 x1874670272856832/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827349 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827324.051664:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827324.051671:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787827324.051674:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827324.051684:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2487
00000100:00080000:3.0:1787827324.051688:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827324.051693:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787827324.051698:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057043c0 x1874670272856832/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827349 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:3.0:1787827324.051700:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:0.0:1787827324.051716:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:3.0:1787827324.051718:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707480 x1874670272857216/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827324.051724:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827324.051733:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272856832:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787827324.051739:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827324.051744:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787827324.051746:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827324.051752:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2487
00000100:00080000:3.0:1787827324.051756:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827324.051761:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787827324.051764:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272856960:192.168.203.121@tcp:38:kworker.0
00000008:00100000:3.0:1787827324.051768:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787827324.051795:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057061c0 x1874670272857344/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1787827324.051802:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787827324.051816:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827324.051820:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787827324.051825:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1787827324.051826:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827324/real 1787827324]  req@ffff9ee0057052c0 x1874670272856960/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827349 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827324.051834:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2487
00000100:00080000:3.0:1787827324.051841:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827324.051849:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827324.051854:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787827324.051855:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057052c0 x1874670272856960/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827349 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827324.051870:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:3.0:1787827324.051871:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705a40 x1874670272857472/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827324.051880:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827324.051888:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272856960:192.168.203.121@tcp:38:kworker.0
00000100:00080000:3.0:1787827324.051893:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827324.051899:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:0.0:1787827324.051900:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272857088:192.168.203.121@tcp:8:kworker.0
00000100:00080000:3.0:1787827324.051903:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827324.051910:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2487
00000100:00080000:3.0:1787827324.051915:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827324.051920:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827324.051926:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:0.0:1787827324.051932:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827324.051957:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704780 x1874670272857600/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787827324.051967:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827324/real 1787827324]  req@ffff9ee005704b40 x1874670272857088/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827349 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827324.051983:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704b40 x1874670272857088/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827349 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827324.051992:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827324.051996:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827324.051999:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272857088:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787827324.052005:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272857216:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787827324.052027:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827324.052038:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827324/real 1787827324]  req@ffff9ee005707480 x1874670272857216/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827349 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827324.052051:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707480 x1874670272857216/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827349 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827324.052059:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827324.052063:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827324.052066:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272857216:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787827324.052084:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272857344:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787827324.052108:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827324.052119:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827324/real 1787827324]  req@ffff9ee0057061c0 x1874670272857344/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827349 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827324.052132:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057061c0 x1874670272857344/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827349 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827324.052140:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827324.052144:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827324.052147:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272857344:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787827324.052154:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272857472:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787827324.052174:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827324.052186:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827324/real 1787827324]  req@ffff9ee005705a40 x1874670272857472/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827349 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827324.052199:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705a40 x1874670272857472/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827349 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827324.052206:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827324.052209:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827324.052213:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272857472:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787827324.052219:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272857600:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787827324.052239:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827324.052250:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827324/real 1787827324]  req@ffff9ee005704780 x1874670272857600/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827349 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827324.052263:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704780 x1874670272857600/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827349 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827324.052269:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827324.052272:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827324.052276:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272857600:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827324.883587:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827325.075411:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787827325.907483:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827326.099435:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827326.931536:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827327.123415:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827327.955498:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827328.147428:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827328.979527:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1787827329.171405:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1787827329.171415:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787827329.171416:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787827329.171422:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827329.171435:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2492
00000100:00080000:3.0:1787827329.171449:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827329.171458:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787827329.171500:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707840 x1874670272857728/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827329.171529:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827329.171532:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787827329.171533:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827329.171536:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2492
00000100:00080000:3.0:1787827329.171539:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827329.171541:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827329.171551:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787827329.171562:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705e00 x1874670272857856/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827329.171574:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827329.171578:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787827329.171581:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1787827329.171588:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272857728:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787827329.171588:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2492
00000100:00080000:3.0:1787827329.171597:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827329.171604:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827329.171611:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827329.171627:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704780 x1874670272857984/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827329.171640:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827329.171644:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787827329.171647:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827329.171651:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2492
00000100:00080000:3.0:1787827329.171656:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827329.171661:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000800:00000100:0.0:1787827329.171667:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000008:00100000:3.0:1787827329.171671:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827329.171687:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705a40 x1874670272858112/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827329.171699:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827329.171703:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787827329.171705:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827329.171711:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2492
00000100:00100000:0.0:1787827329.171715:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827329/real 1787827329]  req@ffff9ee005707840 x1874670272857728/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827354 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827329.171718:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827329.171729:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787827329.171736:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707840 x1874670272857728/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827354 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:3.0:1787827329.171737:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00080000:0.0:1787827329.171752:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827329.171755:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827329.171760:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057061c0 x1874670272858240/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787827329.171761:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272857728:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787827329.171773:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272857856:192.168.203.121@tcp:38:kworker.0
00000100:00080000:3.0:1787827329.171785:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827329.171790:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787827329.171793:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:0.0:1787827329.171798:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787827329.171802:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2492
00000100:00080000:3.0:1787827329.171809:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1787827329.171810:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827329/real 1787827329]  req@ffff9ee005705e00 x1874670272857856/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827354 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827329.171817:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787827329.171827:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705e00 x1874670272857856/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827354 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:3.0:1787827329.171828:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:0.0:1787827329.171844:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:3.0:1787827329.171845:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707480 x1874670272858368/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827329.171849:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827329.171856:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272857856:192.168.203.121@tcp:38:kworker.0
00000100:00080000:3.0:1787827329.171866:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827329.171870:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787827329.171871:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827329.171884:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2492
00000100:00100000:0.0:1787827329.171887:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272857984:192.168.203.121@tcp:8:kworker.0
00000100:00080000:3.0:1787827329.171895:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827329.171904:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000800:00000100:0.0:1787827329.171922:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000008:00100000:3.0:1787827329.171923:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787827329.171938:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827329/real 1787827329]  req@ffff9ee005704780 x1874670272857984/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827354 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827329.171943:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704b40 x1874670272858496/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787827329.171970:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704780 x1874670272857984/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827354 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827329.171982:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827329.171986:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827329.171991:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272857984:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787827329.171999:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272858112:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787827329.172020:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827329.172031:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827329/real 1787827329]  req@ffff9ee005705a40 x1874670272858112/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827354 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827329.172043:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705a40 x1874670272858112/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827354 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827329.172051:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827329.172055:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827329.172059:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272858112:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787827329.172065:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272858240:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787827329.172084:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827329.172102:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827329/real 1787827329]  req@ffff9ee0057061c0 x1874670272858240/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827354 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827329.172115:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057061c0 x1874670272858240/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827354 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827329.172124:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827329.172127:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827329.172131:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272858240:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787827329.172137:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272858368:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787827329.172156:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827329.172167:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827329/real 1787827329]  req@ffff9ee005707480 x1874670272858368/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827354 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827329.172180:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707480 x1874670272858368/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827354 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827329.172189:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827329.172192:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827329.172196:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272858368:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787827329.172215:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272858496:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787827329.172233:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827329.172244:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827329/real 1787827329]  req@ffff9ee005704b40 x1874670272858496/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827354 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827329.172257:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704b40 x1874670272858496/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827354 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827329.172266:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827329.172270:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827329.172274:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272858496:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827330.003500:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827330.195436:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787827331.027522:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827331.219397:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827332.051492:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827332.243443:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827333.075491:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827333.267375:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827334.099555:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1787827334.291375:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1787827334.291376:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787827334.291387:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787827334.291392:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827334.291402:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2498
00000100:00080000:3.0:1787827334.291413:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827334.291422:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787827334.291454:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057052c0 x1874670272858624/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827334.291476:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827334.291478:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787827334.291480:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827334.291482:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2498
00000100:00080000:3.0:1787827334.291485:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827334.291488:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827334.291495:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787827334.291503:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057043c0 x1874670272858752/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827334.291510:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827334.291513:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787827334.291514:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827334.291518:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2498
00000100:00080000:3.0:1787827334.291520:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827334.291523:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827334.291527:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787827334.291535:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272858624:192.168.203.121@tcp:250:kworker.0
00000100:00100000:3.0:1787827334.291536:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706580 x1874670272858880/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827334.291549:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827334.291553:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787827334.291554:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827334.291556:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2498
00000100:00080000:3.0:1787827334.291558:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827334.291560:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827334.291562:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827334.291570:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057070c0 x1874670272859008/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827334.291576:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827334.291579:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787827334.291580:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827334.291582:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2498
00000100:00080000:3.0:1787827334.291585:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827334.291588:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827334.291591:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787827334.291598:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707c00 x1874670272859136/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827334.291605:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827334.291607:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787827334.291608:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827334.291614:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2498
00000800:00000100:0.0:1787827334.291617:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787827334.291618:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827334.291623:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827334.291626:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827334.291634:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704000 x1874670272859264/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827334.291640:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827334.291643:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787827334.291644:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827334.291646:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2498
00000100:00080000:3.0:1787827334.291649:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827334.291651:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827334.291654:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827334.291662:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706d00 x1874670272859392/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787827334.291674:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827334/real 1787827334]  req@ffff9ee0057052c0 x1874670272858624/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827359 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827334.291692:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057052c0 x1874670272858624/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827359 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827334.291703:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827334.291707:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827334.291712:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272858624:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787827334.291719:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272858752:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787827334.291742:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827334.291755:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827334/real 1787827334]  req@ffff9ee0057043c0 x1874670272858752/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827359 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827334.291768:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057043c0 x1874670272858752/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827359 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827334.291779:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827334.291782:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827334.291786:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272858752:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787827334.291807:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272858880:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787827334.291826:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827334.291844:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827334/real 1787827334]  req@ffff9ee005706580 x1874670272858880/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827359 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827334.291861:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706580 x1874670272858880/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827359 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827334.291869:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827334.291883:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827334.291893:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272858880:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787827334.291900:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272859008:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787827334.291923:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827334.291931:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827334/real 1787827334]  req@ffff9ee0057070c0 x1874670272859008/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827359 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827334.291939:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057070c0 x1874670272859008/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827359 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827334.291945:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827334.291947:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827334.291950:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272859008:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787827334.291954:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272859136:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787827334.291964:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827334.291970:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827334/real 1787827334]  req@ffff9ee005707c00 x1874670272859136/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827359 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827334.291982:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707c00 x1874670272859136/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827359 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827334.291990:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827334.291995:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827334.291998:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272859136:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787827334.292003:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272859264:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787827334.292022:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827334.292034:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827334/real 1787827334]  req@ffff9ee005704000 x1874670272859264/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827359 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827334.292045:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704000 x1874670272859264/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827359 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827334.292053:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827334.292056:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827334.292058:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272859264:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787827334.292064:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272859392:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787827334.292083:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827334.292104:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827334/real 1787827334]  req@ffff9ee005706d00 x1874670272859392/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827359 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827334.292115:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706d00 x1874670272859392/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827359 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827334.292124:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827334.292127:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827334.292130:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272859392:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827335.123426:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827335.315397:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787827336.147503:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827336.339406:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827337.171437:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827337.363433:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827338.195483:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827338.387410:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827339.219486:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827339.411395:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787827339.411395:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827339.411404:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787827339.411409:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827339.411416:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2503
00000100:00080000:3.0:1787827339.411425:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827339.411432:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787827339.411463:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706940 x1874670272859520/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827339.411485:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827339.411487:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787827339.411489:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827339.411492:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2503
00000100:00080000:3.0:1787827339.411494:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827339.411496:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827339.411504:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787827339.411513:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705680 x1874670272859648/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827339.411521:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1787827339.411524:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272859520:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787827339.411529:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787827339.411532:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827339.411535:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2503
00000100:00080000:3.0:1787827339.411537:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827339.411540:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827339.411544:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827339.411554:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706d00 x1874670272859776/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827339.411564:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827339.411567:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787827339.411568:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827339.411571:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2503
00000100:00080000:3.0:1787827339.411573:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827339.411575:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827339.411578:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:0.0:1787827339.411583:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827339.411589:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704000 x1874670272859904/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827339.411607:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827339.411609:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787827339.411611:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827339.411613:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2503
00000100:00080000:3.0:1787827339.411616:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827339.411619:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827339.411622:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787827339.411628:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707c00 x1874670272860032/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787827339.411635:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827339/real 1787827339]  req@ffff9ee005706940 x1874670272859520/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827364 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827339.411636:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827339.411644:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787827339.411647:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827339.411654:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2503
00000100:00080000:3.0:1787827339.411658:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827339.411663:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787827339.411664:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706940 x1874670272859520/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827364 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:3.0:1787827339.411666:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827339.411677:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057070c0 x1874670272860160/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827339.411679:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827339.411689:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827339.411691:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:3.0:1787827339.411693:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787827339.411696:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827339.411701:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2503
00000100:00100000:0.0:1787827339.411702:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272859520:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787827339.411703:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827339.411709:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827339.411714:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827339.411721:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706580 x1874670272860288/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787827339.411733:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272859648:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787827339.411756:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827339.411765:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827339/real 1787827339]  req@ffff9ee005705680 x1874670272859648/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827364 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827339.411774:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705680 x1874670272859648/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827364 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827339.411780:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827339.411783:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827339.411785:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272859648:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787827339.411789:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272859776:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787827339.411802:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827339.411808:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827339/real 1787827339]  req@ffff9ee005706d00 x1874670272859776/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827364 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827339.411815:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706d00 x1874670272859776/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827364 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827339.411820:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827339.411822:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827339.411824:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272859776:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787827339.411828:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272859904:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787827339.411854:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827339.411862:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827339/real 1787827339]  req@ffff9ee005704000 x1874670272859904/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827364 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827339.411870:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704000 x1874670272859904/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827364 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827339.411875:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827339.411877:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827339.411880:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272859904:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787827339.411884:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272860032:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787827339.411896:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827339.411901:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827339/real 1787827339]  req@ffff9ee005707c00 x1874670272860032/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827364 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827339.411908:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707c00 x1874670272860032/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827364 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827339.411913:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827339.411915:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827339.411917:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272860032:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787827339.411920:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272860160:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787827339.411929:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827339.411935:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827339/real 1787827339]  req@ffff9ee0057070c0 x1874670272860160/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827364 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827339.411942:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057070c0 x1874670272860160/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827364 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827339.411947:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827339.411948:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827339.411950:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272860160:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787827339.411954:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272860288:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787827339.411963:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827339.411968:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827339/real 1787827339]  req@ffff9ee005706580 x1874670272860288/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827364 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827339.411975:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706580 x1874670272860288/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827364 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827339.411980:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827339.411982:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827339.411984:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272860288:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827340.243495:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827340.435403:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787827341.267511:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827341.459418:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827342.291519:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827342.483432:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827343.315511:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827343.507463:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827344.339544:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827344.531393:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:0.0:1787827344.531461:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827344.531470:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1787827344.531474:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827344.531483:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2508
00000100:00080000:0.0:1787827344.531492:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827344.531498:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787827344.531533:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8b40 x1874670272860416/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827344.531559:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827344.531562:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787827344.531563:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827344.531566:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2508
00000100:00080000:0.0:1787827344.531569:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827344.531571:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827344.531580:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787827344.531589:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb480 x1874670272860544/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827344.531597:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827344.531600:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787827344.531602:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827344.531605:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2508
00000100:00080000:0.0:1787827344.531607:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827344.531609:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827344.531614:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787827344.531623:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8780 x1874670272860672/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787827344.531633:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272860416:192.168.203.121@tcp:250:kworker.0
00000100:00080000:0.0:1787827344.531639:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827344.531651:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787827344.531653:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827344.531657:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2508
00000100:00080000:0.0:1787827344.531659:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827344.531661:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827344.531665:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787827344.531675:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ea580 x1874670272860800/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827344.531682:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827344.531684:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787827344.531686:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827344.531690:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2508
00000100:00080000:0.0:1787827344.531693:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827344.531696:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827344.531699:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787827344.531707:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9a40 x1874670272860928/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827344.531714:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827344.531717:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787827344.531719:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827344.531722:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2508
00000100:00080000:0.0:1787827344.531724:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827344.531727:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827344.531729:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1787827344.531736:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827344.531741:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb0c0 x1874670272861056/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827344.531750:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827344.531753:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787827344.531754:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827344.531758:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2508
00000100:00080000:0.0:1787827344.531763:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827344.531765:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827344.531769:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787827344.531777:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ea940 x1874670272861184/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787827344.531821:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827344/real 1787827344]  req@ffff9ee0056e8b40 x1874670272860416/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827369 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827344.531851:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8b40 x1874670272860416/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827369 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827344.531865:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827344.531870:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827344.531875:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272860416:192.168.203.121@tcp:250:kworker.0
00000100:00100000:1.0:1787827344.531884:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272860544:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787827344.531908:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827344.531920:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827344/real 1787827344]  req@ffff9ee0056eb480 x1874670272860544/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827369 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827344.531933:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb480 x1874670272860544/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827369 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827344.531943:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827344.531946:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827344.531950:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272860544:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787827344.531979:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272860672:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827344.532007:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827344.532018:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827344/real 1787827344]  req@ffff9ee0056e8780 x1874670272860672/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827369 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827344.532031:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8780 x1874670272860672/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827369 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827344.532047:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827344.532051:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827344.532054:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272860672:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827344.532061:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272860800:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827344.532076:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827344.532085:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827344/real 1787827344]  req@ffff9ee0056ea580 x1874670272860800/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827369 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827344.532097:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ea580 x1874670272860800/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827369 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827344.532106:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827344.532110:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827344.532113:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272860800:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827344.532119:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272860928:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787827344.532134:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827344.532143:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827344/real 1787827344]  req@ffff9ee0056e9a40 x1874670272860928/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827369 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827344.532154:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9a40 x1874670272860928/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827369 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827344.532163:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827344.532166:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827344.532170:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272860928:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787827344.532177:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272861056:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827344.532198:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827344.532209:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827344/real 1787827344]  req@ffff9ee0056eb0c0 x1874670272861056/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827369 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827344.532222:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb0c0 x1874670272861056/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827369 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827344.532231:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827344.532234:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827344.532238:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272861056:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827344.532243:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272861184:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827344.532259:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827344.532268:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827344/real 1787827344]  req@ffff9ee0056ea940 x1874670272861184/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827369 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827344.532281:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ea940 x1874670272861184/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827369 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827344.532289:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827344.532292:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827344.532296:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272861184:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827345.363537:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827345.555426:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787827346.387515:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827346.579390:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827347.411530:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787827347.603477:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827348.435555:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787827348.627506:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827349.459515:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1787827349.651493:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1787827349.651493:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:0.0:1787827349.651506:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1787827349.651511:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827349.651525:0:8:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2513
00000100:00080000:0.0:1787827349.651540:0:8:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827349.651550:0:8:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787827349.651600:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9e00 x1874670272861312/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827349.651625:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827349.651628:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787827349.651630:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827349.651633:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2513
00000100:00080000:0.0:1787827349.651635:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827349.651639:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827349.651649:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787827349.651659:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ead00 x1874670272861440/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827349.651673:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1787827349.651673:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272861312:192.168.203.121@tcp:250:kworker.0
00000100:00080000:0.0:1787827349.651687:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787827349.651693:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827349.651699:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2513
00000100:00080000:0.0:1787827349.651702:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827349.651707:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827349.651712:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787827349.651724:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ea940 x1874670272861568/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827349.651731:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827349.651733:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787827349.651736:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827349.651740:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2513
00000100:00080000:0.0:1787827349.651752:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827349.651755:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827349.651759:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787827349.651785:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb0c0 x1874670272861696/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1787827349.651785:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:0.0:1787827349.651802:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827349.651805:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787827349.651807:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827349.651813:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2513
00000100:00080000:0.0:1787827349.651819:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827349.651822:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827349.651828:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787827349.651841:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9a40 x1874670272861824/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787827349.651847:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827349/real 1787827349]  req@ffff9ee0056e9e00 x1874670272861312/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827374 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827349.651870:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827349.651889:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787827349.651893:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827349.651898:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2513
00000100:00080000:0.0:1787827349.651902:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1787827349.651909:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9e00 x1874670272861312/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827374 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827349.651914:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827349.651926:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:1.0:1787827349.651935:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:0.0:1787827349.651940:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ea580 x1874670272861952/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827349.651943:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827349.651957:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272861312:192.168.203.121@tcp:250:kworker.0
00000100:00080000:0.0:1787827349.651964:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827349.651970:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787827349.651972:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827349.651976:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2513
00000100:00080000:0.0:1787827349.651980:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827349.651982:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827349.651987:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787827349.651993:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272861440:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787827349.652001:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8780 x1874670272862080/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1787827349.652026:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827349.652049:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827349/real 1787827349]  req@ffff9ee0056ead00 x1874670272861440/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827374 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827349.652059:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ead00 x1874670272861440/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827374 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827349.652067:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827349.652070:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827349.652072:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272861440:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787827349.652078:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272861568:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827349.652092:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827349.652100:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827349/real 1787827349]  req@ffff9ee0056ea940 x1874670272861568/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827374 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827349.652109:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ea940 x1874670272861568/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827374 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827349.652120:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827349.652123:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827349.652125:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272861568:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827349.652129:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272861696:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827349.652141:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827349.652148:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827349/real 1787827349]  req@ffff9ee0056eb0c0 x1874670272861696/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827374 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827349.652156:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb0c0 x1874670272861696/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827374 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827349.652161:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827349.652164:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827349.652166:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272861696:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827349.652170:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272861824:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787827349.652187:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827349.652200:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827349/real 1787827349]  req@ffff9ee0056e9a40 x1874670272861824/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827374 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827349.652214:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9a40 x1874670272861824/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827374 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827349.652223:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827349.652226:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827349.652230:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272861824:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787827349.652237:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272861952:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827349.652259:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827349.652273:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827349/real 1787827349]  req@ffff9ee0056ea580 x1874670272861952/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827374 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827349.652286:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ea580 x1874670272861952/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827374 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827349.652294:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827349.652298:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827349.652302:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272861952:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827349.652375:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272862080:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827349.652402:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827349.652418:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827349/real 1787827349]  req@ffff9ee0056e8780 x1874670272862080/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827374 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827349.652433:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8780 x1874670272862080/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827374 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827349.652440:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827349.652443:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827349.652445:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272862080:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827350.483508:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827350.675360:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787827351.507486:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827351.699441:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827352.531473:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827352.723395:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827353.555487:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827353.747404:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827354.579516:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827354.771400:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:0.0:1787827354.771405:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827354.771411:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1787827354.771416:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827354.771425:0:8:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2518
00000100:00080000:0.0:1787827354.771435:0:8:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827354.771442:0:8:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787827354.771478:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb480 x1874670272862208/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827354.771497:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827354.771500:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787827354.771502:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827354.771505:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2518
00000100:00080000:0.0:1787827354.771508:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827354.771512:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827354.771521:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787827354.771532:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8b40 x1874670272862336/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787827354.771540:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272862208:192.168.203.121@tcp:250:kworker.0
00000100:00080000:0.0:1787827354.771543:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827354.771549:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787827354.771557:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827354.771562:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2518
00000100:00080000:0.0:1787827354.771566:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827354.771570:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827354.771576:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787827354.771590:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb840 x1874670272862464/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827354.771600:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827354.771604:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787827354.771607:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:1.0:1787827354.771612:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:0.0:1787827354.771613:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2518
00000100:00080000:0.0:1787827354.771621:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827354.771625:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827354.771630:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787827354.771642:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9680 x1874670272862592/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827354.771650:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1787827354.771651:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827354/real 1787827354]  req@ffff9ee0056eb480 x1874670272862208/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827379 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827354.771657:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787827354.771660:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827354.771668:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2518
00000100:00080000:0.0:1787827354.771672:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827354.771675:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787827354.771680:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb480 x1874670272862208/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827379 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:0.0:1787827354.771682:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787827354.771694:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e92c0 x1874670272862720/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827354.771714:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827354.771715:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827354.771722:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787827354.771725:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827354.771725:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827354.771743:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272862208:192.168.203.121@tcp:250:kworker.0
00000100:00080000:0.0:1787827354.771744:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2518
00000100:00080000:0.0:1787827354.771751:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827354.771755:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827354.771760:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787827354.771771:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272862336:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787827354.771777:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e83c0 x1874670272862848/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827354.771788:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827354.771790:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787827354.771792:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827354.771797:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2518
00000800:00000100:1.0:1787827354.771798:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:0.0:1787827354.771803:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827354.771807:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827354.771811:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787827354.771816:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827354/real 1787827354]  req@ffff9ee0056e8b40 x1874670272862336/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827379 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827354.771822:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ebc00 x1874670272862976/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787827354.771839:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8b40 x1874670272862336/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827379 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827354.771853:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827354.771860:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827354.771864:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272862336:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787827354.771870:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272862464:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827354.771890:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827354.771902:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827354/real 1787827354]  req@ffff9ee0056eb840 x1874670272862464/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827379 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827354.771912:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb840 x1874670272862464/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827379 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827354.771922:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827354.771925:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827354.771927:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272862464:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827354.771931:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272862592:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827354.771941:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827354.771965:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827354/real 1787827354]  req@ffff9ee0056e9680 x1874670272862592/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827379 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827354.771973:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9680 x1874670272862592/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827379 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827354.771979:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827354.771981:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827354.771983:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272862592:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827354.771987:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272862720:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787827354.771999:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827354.772005:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827354/real 1787827354]  req@ffff9ee0056e92c0 x1874670272862720/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827379 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827354.772031:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e92c0 x1874670272862720/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827379 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827354.772040:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827354.772043:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827354.772048:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272862720:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787827354.772075:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272862848:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827354.772098:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827354.772110:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827354/real 1787827354]  req@ffff9ee0056e83c0 x1874670272862848/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827379 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827354.772123:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e83c0 x1874670272862848/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827379 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827354.772131:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827354.772134:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827354.772138:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272862848:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827354.772144:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272862976:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827354.772165:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827354.772178:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827354/real 1787827354]  req@ffff9ee0056ebc00 x1874670272862976/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827379 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827354.772190:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ebc00 x1874670272862976/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827379 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827354.772197:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827354.772200:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827354.772203:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272862976:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827355.603569:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827355.795417:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787827356.627510:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827356.819399:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827357.651576:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827357.843453:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827358.675466:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827358.867441:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827359.699554:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827359.891388:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:2.0:1787827359.891439:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827359.891444:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787827359.891447:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827359.891456:0:8:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2523
00000100:00080000:2.0:1787827359.891467:0:8:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827359.891474:0:8:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787827359.891504:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b840 x1874670272863104/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827359.891528:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827359.891531:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787827359.891532:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827359.891535:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2523
00000100:00080000:2.0:1787827359.891538:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827359.891541:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827359.891548:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787827359.891578:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057283c0 x1874670272863232/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787827359.891580:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272863104:192.168.203.121@tcp:250:kworker.0
00000100:00080000:2.0:1787827359.891600:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827359.891604:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787827359.891606:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827359.891609:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2523
00000100:00080000:2.0:1787827359.891613:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827359.891616:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827359.891621:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787827359.891631:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729e00 x1874670272863360/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827359.891639:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827359.891642:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787827359.891643:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827359.891646:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2523
00000100:00080000:2.0:1787827359.891651:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000800:00000100:1.0:1787827359.891654:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:2.0:1787827359.891659:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827359.891666:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787827359.891676:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728000 x1874670272863488/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827359.891684:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827359.891687:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787827359.891689:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827359.891709:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2523
00000100:00080000:2.0:1787827359.891713:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1787827359.891721:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827359/real 1787827359]  req@ffff9ee00572b840 x1874670272863104/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827384 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827359.891721:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827359.891746:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787827359.891765:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a580 x1874670272863616/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787827359.891768:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b840 x1874670272863104/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827384 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827359.891792:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827359.891795:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787827359.891797:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827359.891801:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2523
00000100:00080000:2.0:1787827359.891808:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827359.891811:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827359.891812:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827359.891821:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:1.0:1787827359.891826:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827359.891834:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728b40 x1874670272863744/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787827359.891837:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272863104:192.168.203.121@tcp:250:kworker.0
00000100:00080000:2.0:1787827359.891856:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827359.891877:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787827359.891879:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827359.891883:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2523
00000100:00080000:2.0:1787827359.891886:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827359.891890:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787827359.891894:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272863232:192.168.203.121@tcp:38:kworker.0
00000008:00100000:2.0:1787827359.891897:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787827359.891913:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b0c0 x1874670272863872/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1787827359.891931:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827359.891949:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827359/real 1787827359]  req@ffff9ee0057283c0 x1874670272863232/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827384 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827359.891961:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057283c0 x1874670272863232/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827384 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827359.891970:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827359.891973:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827359.891978:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272863232:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787827359.891987:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272863360:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827359.892029:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827359.892045:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827359/real 1787827359]  req@ffff9ee005729e00 x1874670272863360/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827384 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827359.892062:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729e00 x1874670272863360/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827384 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827359.892081:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827359.892084:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827359.892087:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272863360:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827359.892093:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272863488:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827359.892112:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827359.892123:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827359/real 1787827359]  req@ffff9ee005728000 x1874670272863488/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827384 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827359.892138:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728000 x1874670272863488/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827384 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827359.892149:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827359.892153:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827359.892158:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272863488:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827359.892166:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272863616:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787827359.892204:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827359.892216:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827359/real 1787827359]  req@ffff9ee00572a580 x1874670272863616/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827384 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827359.892224:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a580 x1874670272863616/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827384 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827359.892229:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827359.892231:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827359.892234:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272863616:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787827359.892238:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272863744:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827359.892250:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827359.892256:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827359/real 1787827359]  req@ffff9ee005728b40 x1874670272863744/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827384 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827359.892264:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728b40 x1874670272863744/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827384 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827359.892268:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827359.892270:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827359.892272:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272863744:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827359.892286:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272863872:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827359.892296:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827359.892302:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827359/real 1787827359]  req@ffff9ee00572b0c0 x1874670272863872/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827384 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827359.892309:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b0c0 x1874670272863872/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827384 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827359.892314:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827359.892316:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827359.892317:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272863872:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827360.723512:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827360.915390:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787827361.747578:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827361.939414:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827362.771509:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827362.963396:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827363.795523:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827363.987383:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827364.819523:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827365.011475:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:1.0:1787827365.011510:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827365.011519:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1787827365.011524:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827365.011532:0:8:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2528
00000100:00080000:1.0:1787827365.011541:0:8:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827365.011547:0:8:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787827365.011580:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a21c0 x1874670272864000/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827365.011609:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827365.011612:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787827365.011613:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827365.011616:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2528
00000100:00080000:1.0:1787827365.011619:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827365.011623:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827365.011633:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787827365.011647:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0f00 x1874670272864128/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827365.011670:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827365.011675:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787827365.011677:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827365.011682:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2528
00000100:00080000:1.0:1787827365.011687:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827365.011691:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827365.011698:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787827365.011699:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272864000:192.168.203.121@tcp:250:kworker.0
00000100:00100000:1.0:1787827365.011712:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1680 x1874670272864256/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827365.011725:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827365.011728:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787827365.011730:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827365.011732:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2528
00000100:00080000:1.0:1787827365.011748:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827365.011751:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827365.011754:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:0.0:1787827365.011758:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827365.011765:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a2940 x1874670272864384/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827365.011773:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827365.011775:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787827365.011777:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827365.011779:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2528
00000100:00080000:1.0:1787827365.011781:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827365.011784:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827365.011793:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787827365.011799:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827365/real 1787827365]  req@ffff9ee0056a21c0 x1874670272864000/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827390 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827365.011804:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a3c00 x1874670272864512/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827365.011833:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827365.011836:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787827365.011837:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827365.011840:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2528
00000100:00080000:1.0:1787827365.011844:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1787827365.011848:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a21c0 x1874670272864000/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827390 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827365.011850:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827365.011854:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787827365.011864:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1a40 x1874670272864640/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827365.011867:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827365.011877:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:1.0:1787827365.011879:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1787827365.011882:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272864000:192.168.203.121@tcp:250:kworker.0
00000100:00080000:1.0:1787827365.011883:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787827365.011887:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827365.011892:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2528
00000100:00100000:0.0:1787827365.011896:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272864128:192.168.203.121@tcp:38:kworker.0
00000100:00080000:1.0:1787827365.011896:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827365.011904:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827365.011907:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787827365.011916:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a12c0 x1874670272864768/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1787827365.011928:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827365.011940:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827365/real 1787827365]  req@ffff9ee0056a0f00 x1874670272864128/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827390 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827365.011950:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0f00 x1874670272864128/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827390 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827365.011956:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827365.011959:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827365.011961:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272864128:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787827365.011980:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272864256:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787827365.011993:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827365.011999:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827365/real 1787827365]  req@ffff9ee0056a1680 x1874670272864256/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827390 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827365.012006:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1680 x1874670272864256/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827390 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827365.012011:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827365.012013:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827365.012015:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272864256:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787827365.012019:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272864384:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787827365.012028:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827365.012033:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827365/real 1787827365]  req@ffff9ee0056a2940 x1874670272864384/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827390 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827365.012041:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a2940 x1874670272864384/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827390 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827365.012046:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827365.012047:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827365.012049:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272864384:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787827365.012053:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272864512:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787827365.012062:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827365.012067:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827365/real 1787827365]  req@ffff9ee0056a3c00 x1874670272864512/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827390 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827365.012074:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a3c00 x1874670272864512/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827390 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827365.012078:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827365.012080:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827365.012082:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272864512:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787827365.012085:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272864640:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787827365.012094:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827365.012100:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827365/real 1787827365]  req@ffff9ee0056a1a40 x1874670272864640/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827390 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827365.012106:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1a40 x1874670272864640/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827390 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827365.012116:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827365.012118:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827365.012120:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272864640:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787827365.012123:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272864768:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787827365.012132:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827365.012137:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827365/real 1787827365]  req@ffff9ee0056a12c0 x1874670272864768/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827390 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827365.012144:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a12c0 x1874670272864768/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827390 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827365.012149:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827365.012151:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827365.012152:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272864768:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827365.843494:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827366.035393:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787827366.867527:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827367.059447:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827367.891504:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827368.083383:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827368.915744:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827369.107442:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827369.939504:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827370.131448:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:2.0:1787827370.131499:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827370.131505:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787827370.131510:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827370.131522:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2533
00000100:00080000:2.0:1787827370.131537:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827370.131546:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787827370.131596:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729a40 x1874670272864896/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827370.131637:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827370.131641:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787827370.131642:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827370.131646:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2533
00000100:00080000:2.0:1787827370.131649:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827370.131653:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827370.131666:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787827370.131689:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572ad00 x1874670272865024/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827370.131698:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827370.131701:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787827370.131703:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827370.131706:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2533
00000100:00080000:2.0:1787827370.131708:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827370.131712:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827370.131718:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787827370.131731:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272864896:192.168.203.121@tcp:250:kworker.0
00000100:00100000:2.0:1787827370.131731:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b480 x1874670272865152/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827370.131760:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827370.131763:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787827370.131766:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827370.131771:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2533
00000100:00080000:2.0:1787827370.131774:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827370.131779:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827370.131783:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787827370.131797:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b0c0 x1874670272865280/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827370.131804:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827370.131807:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787827370.131809:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827370.131815:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2533
00000100:00080000:2.0:1787827370.131818:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827370.131821:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827370.131825:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787827370.131835:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728b40 x1874670272865408/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1787827370.131844:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:2.0:1787827370.131861:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827370.131865:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787827370.131868:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827370.131874:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2533
00000100:00080000:2.0:1787827370.131877:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827370.131880:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827370.131885:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787827370.131902:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a580 x1874670272865536/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787827370.131910:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827370/real 1787827370]  req@ffff9ee005729a40 x1874670272864896/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827395 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827370.131930:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827370.131934:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787827370.131936:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827370.131944:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2533
00000100:00080000:2.0:1787827370.131958:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827370.131968:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827370.131973:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787827370.131981:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729a40 x1874670272864896/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827395 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827370.131993:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728000 x1874670272865664/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827370.132005:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827370.132019:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827370.132027:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272864896:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787827370.132037:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272865024:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787827370.132064:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827370.132076:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827370/real 1787827370]  req@ffff9ee00572ad00 x1874670272865024/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827395 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827370.132089:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572ad00 x1874670272865024/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827395 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827370.132097:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827370.132101:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827370.132104:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272865024:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787827370.132142:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272865152:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787827370.132166:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827370.132183:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827370/real 1787827370]  req@ffff9ee00572b480 x1874670272865152/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827395 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827370.132202:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b480 x1874670272865152/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827395 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827370.132215:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827370.132220:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827370.132225:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272865152:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787827370.132235:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272865280:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787827370.132264:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827370.132282:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827370/real 1787827370]  req@ffff9ee00572b0c0 x1874670272865280/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827395 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827370.132296:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b0c0 x1874670272865280/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827395 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827370.132303:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827370.132307:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827370.132310:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272865280:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787827370.132355:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272865408:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787827370.132392:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827370.132404:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827370/real 1787827370]  req@ffff9ee005728b40 x1874670272865408/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827395 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827370.132415:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728b40 x1874670272865408/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827395 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827370.132423:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827370.132426:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827370.132429:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272865408:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787827370.132436:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272865536:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787827370.132451:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827370.132459:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827370/real 1787827370]  req@ffff9ee00572a580 x1874670272865536/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827395 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827370.132469:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a580 x1874670272865536/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827395 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827370.132495:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827370.132498:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827370.132502:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272865536:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787827370.132508:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272865664:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787827370.132525:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827370.132534:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827370/real 1787827370]  req@ffff9ee005728000 x1874670272865664/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827395 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827370.132544:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728000 x1874670272865664/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827395 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827370.132552:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827370.132555:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827370.132558:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272865664:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827370.963611:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827371.155490:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787827371.987523:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827372.179458:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827373.011640:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827373.203440:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827374.035609:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827374.227455:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827375.059488:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1787827375.251457:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827375.251472:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787827375.251479:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1787827375.251480:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:2.0:1787827375.251497:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2538
00000100:00080000:2.0:1787827375.251513:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827375.251523:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787827375.251572:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729e00 x1874670272865792/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827375.251619:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827375.251624:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787827375.251626:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827375.251632:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2538
00000100:00080000:2.0:1787827375.251638:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827375.251643:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827375.251658:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787827375.251659:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272865792:192.168.203.121@tcp:250:kworker.0
00000100:00100000:2.0:1787827375.251687:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057283c0 x1874670272865920/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827375.251703:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827375.251708:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787827375.251710:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827375.251715:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2538
00000100:00080000:2.0:1787827375.251721:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827375.251726:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000800:00000100:0.0:1787827375.251733:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000008:00100000:2.0:1787827375.251737:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787827375.251755:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b840 x1874670272866048/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827375.251770:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1787827375.251773:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827375/real 1787827375]  req@ffff9ee005729e00 x1874670272865792/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827400 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827375.251791:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:0.0:1787827375.251793:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729e00 x1874670272865792/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827400 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827375.251798:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827375.251811:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827375.251813:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2538
00000100:00080000:0.0:1787827375.251819:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:2.0:1787827375.251822:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1787827375.251824:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272865792:192.168.203.121@tcp:250:kworker.0
00000100:00080000:2.0:1787827375.251835:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827375.251845:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787827375.251854:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272865920:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787827375.251863:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728f00 x1874670272866176/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1787827375.251875:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:2.0:1787827375.251877:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827375.251881:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787827375.251884:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827375.251892:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2538
00000100:00100000:0.0:1787827375.251894:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827375/real 1787827375]  req@ffff9ee0057283c0 x1874670272865920/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827400 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827375.251899:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827375.251913:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787827375.251919:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057283c0 x1874670272865920/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827400 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:2.0:1787827375.251920:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00080000:0.0:1787827375.251937:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:2.0:1787827375.251943:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a1c0 x1874670272866304/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827375.251947:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827375.251962:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272865920:192.168.203.121@tcp:38:kworker.0
00000100:00080000:2.0:1787827375.251976:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1787827375.251985:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272866048:192.168.203.121@tcp:8:kworker.0
00000100:00080000:2.0:1787827375.251985:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787827375.251989:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827375.251996:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2538
00000100:00080000:2.0:1787827375.252001:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827375.252005:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827375.252009:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:0.0:1787827375.252011:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827375.252031:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827375/real 1787827375]  req@ffff9ee00572b840 x1874670272866048/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827400 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827375.252033:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a940 x1874670272866432/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827375.252100:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827375.252104:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:0.0:1787827375.252106:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b840 x1874670272866048/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827400 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827375.252108:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827375.252122:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2538
00000100:00080000:0.0:1787827375.252135:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827375.252135:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827375.252146:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00080000:2.0:1787827375.252147:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787827375.252156:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272866048:192.168.203.121@tcp:8:kworker.0
00000008:00100000:2.0:1787827375.252158:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787827375.252178:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728780 x1874670272866560/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787827375.252182:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272866176:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787827375.252222:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827375.252233:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827375/real 1787827375]  req@ffff9ee005728f00 x1874670272866176/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827400 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827375.252242:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728f00 x1874670272866176/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827400 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827375.252247:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827375.252250:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827375.252252:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272866176:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787827375.252255:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272866304:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787827375.252265:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827375.252271:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827375/real 1787827375]  req@ffff9ee00572a1c0 x1874670272866304/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827400 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827375.252278:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a1c0 x1874670272866304/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827400 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827375.252282:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827375.252284:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827375.252286:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272866304:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787827375.252289:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272866432:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787827375.252299:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827375.252304:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827375/real 1787827375]  req@ffff9ee00572a940 x1874670272866432/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827400 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827375.252351:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a940 x1874670272866432/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827400 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827375.252360:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827375.252363:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827375.252367:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272866432:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787827375.252383:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272866560:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787827375.252404:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827375.252413:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827375/real 1787827375]  req@ffff9ee005728780 x1874670272866560/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827400 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827375.252421:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728780 x1874670272866560/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827400 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827375.252426:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827375.252429:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827375.252431:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272866560:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827376.083523:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827376.275499:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787827377.107652:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827377.299428:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827378.131529:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827378.323414:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827379.155516:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827379.347392:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827380.179539:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827380.371434:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:1.0:1787827380.371451:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827380.371459:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1787827380.371464:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827380.371475:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2544
00000100:00080000:1.0:1787827380.371487:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827380.371495:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787827380.371532:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a3480 x1874670272866688/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827380.371579:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827380.371591:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787827380.371593:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827380.371597:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2544
00000100:00080000:1.0:1787827380.371607:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827380.371613:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827380.371624:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787827380.371629:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272866688:192.168.203.121@tcp:250:kworker.0
00000100:00100000:1.0:1787827380.371642:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0b40 x1874670272866816/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827380.371656:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827380.371660:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787827380.371662:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827380.371666:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2544
00000100:00080000:1.0:1787827380.371670:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827380.371675:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827380.371680:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787827380.371691:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a2580 x1874670272866944/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827380.371702:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:0.0:1787827380.371708:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:1.0:1787827380.371710:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787827380.371713:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827380.371719:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2544
00000100:00080000:1.0:1787827380.371724:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827380.371728:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827380.371735:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787827380.371748:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a03c0 x1874670272867072/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787827380.371753:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827380/real 1787827380]  req@ffff9ee0056a3480 x1874670272866688/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827405 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827380.371773:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827380.371778:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00100000:0.0:1787827380.371781:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a3480 x1874670272866688/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827405 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827380.371783:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827380.371794:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2544
00000100:00080000:0.0:1787827380.371797:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827380.371800:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827380.371803:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827380.371811:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272866688:192.168.203.121@tcp:250:kworker.0
00000100:00080000:1.0:1787827380.371811:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827380.371823:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787827380.371838:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1e00 x1874670272867200/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787827380.371839:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272866816:192.168.203.121@tcp:38:kworker.0
00000100:00080000:1.0:1787827380.371855:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827380.371860:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787827380.371863:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:0.0:1787827380.371864:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:1.0:1787827380.371873:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2544
00000100:00080000:1.0:1787827380.371878:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1787827380.371883:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827380/real 1787827380]  req@ffff9ee0056a0b40 x1874670272866816/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827405 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827380.371886:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827380.371895:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787827380.371910:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0b40 x1874670272866816/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827405 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827380.371912:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0000 x1874670272867328/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827380.371941:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827380.371942:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827380.371950:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787827380.371954:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00080000:1.0:1787827380.371954:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1787827380.371961:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272866816:192.168.203.121@tcp:38:kworker.0
00000100:00080000:1.0:1787827380.371963:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2544
00000100:00080000:1.0:1787827380.371971:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1787827380.371974:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272866944:192.168.203.121@tcp:8:kworker.0
00000100:00080000:1.0:1787827380.371976:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827380.371984:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787827380.371999:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0780 x1874670272867456/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1787827380.372003:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827380.372015:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827380/real 1787827380]  req@ffff9ee0056a2580 x1874670272866944/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827405 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827380.372025:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a2580 x1874670272866944/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827405 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827380.372031:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827380.372034:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827380.372036:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272866944:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787827380.372041:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272867072:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787827380.372052:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827380.372058:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827380/real 1787827380]  req@ffff9ee0056a03c0 x1874670272867072/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827405 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827380.372065:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a03c0 x1874670272867072/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827405 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827380.372071:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827380.372074:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827380.372078:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272867072:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787827380.372096:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272867200:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787827380.372117:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827380.372129:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827380/real 1787827380]  req@ffff9ee0056a1e00 x1874670272867200/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827405 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827380.372138:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1e00 x1874670272867200/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827405 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827380.372143:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827380.372145:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827380.372147:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272867200:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787827380.372151:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272867328:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787827380.372164:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827380.372171:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827380/real 1787827380]  req@ffff9ee0056a0000 x1874670272867328/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827405 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827380.372178:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0000 x1874670272867328/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827405 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827380.372183:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827380.372185:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827380.372187:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272867328:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787827380.372190:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272867456:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787827380.372199:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827380.372204:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827380/real 1787827380]  req@ffff9ee0056a0780 x1874670272867456/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827405 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827380.372211:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0780 x1874670272867456/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827405 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827380.372216:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827380.372218:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827380.372219:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272867456:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827381.203534:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827381.395396:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787827382.227533:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827382.419435:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827383.251617:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827383.443424:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827384.275653:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827384.467424:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827385.299607:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827385.491372:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:0.0:1787827385.491422:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827385.491428:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1787827385.491431:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827385.491438:0:8:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2549
00000100:00080000:0.0:1787827385.491448:0:8:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827385.491454:0:8:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787827385.491485:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8000 x1874670272867584/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827385.491507:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827385.491510:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787827385.491511:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827385.491527:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2549
00000100:00080000:0.0:1787827385.491532:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827385.491536:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827385.491545:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787827385.491551:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272867584:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787827385.491558:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8f00 x1874670272867712/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827385.491567:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827385.491570:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787827385.491571:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827385.491585:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2549
00000100:00080000:0.0:1787827385.491587:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827385.491590:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827385.491594:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787827385.491602:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ebc00 x1874670272867840/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827385.491609:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827385.491611:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787827385.491612:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827385.491615:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2549
00000100:00080000:0.0:1787827385.491618:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827385.491620:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827385.491624:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787827385.491631:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e83c0 x1874670272867968/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827385.491638:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827385.491640:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787827385.491642:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827385.491644:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2549
00000100:00080000:0.0:1787827385.491647:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827385.491650:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787827385.491653:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272867712:192.168.203.121@tcp:38:kworker.0
00000008:00100000:0.0:1787827385.491655:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787827385.491669:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e92c0 x1874670272868096/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827385.491678:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827385.491680:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787827385.491682:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1787827385.491685:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272867840:192.168.203.121@tcp:8:kworker.0
00000100:00080000:0.0:1787827385.491687:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2549
00000100:00080000:0.0:1787827385.491694:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827385.491697:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827385.491701:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787827385.491712:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272867968:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787827385.491713:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9680 x1874670272868224/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827385.491724:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827385.491737:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787827385.491738:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827385.491742:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2549
00000100:00080000:0.0:1787827385.491745:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1787827385.491749:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272868096:192.168.203.121@tcp:38:kworker.0
00000100:00080000:0.0:1787827385.491750:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827385.491758:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787827385.491770:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb840 x1874670272868352/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787827385.491777:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272868224:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827385.491798:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272868352:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827386.323577:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827386.515436:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787827387.347532:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827387.539368:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827388.371488:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827388.563393:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000400:00000100:3.0:1787827388.563517:0:2354:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.203.121:988
00000400:00000100:3.0:1787827388.563571:0:2354:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.203.121@tcp at host 192.168.203.121 was unreachable: the network or that node may be down, or Lustre may be misconfigured.
00000800:00000100:3.0:1787827388.563586:0:2354:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:3.0:1787827388.563613:0:2354:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:3.0:1787827388.563622:0:2354:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:3.0:1787827388.563630:0:2354:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:3.0:1787827388.563640:0:2354:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000100:00100000:1.0:1787827388.563646:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827385/real 1787827388]  req@ffff9ee0056e8f00 x1874670272867712/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827410 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000800:00000100:3.0:1787827388.563656:0:2354:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000100:00100000:1.0:1787827388.563675:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8f00 x1874670272867712/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827410 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000800:00000100:3.0:1787827388.563682:0:2354:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000100:00080000:1.0:1787827388.563697:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827388.563720:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827388.563726:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272867712:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787827388.563734:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827385/real 1787827388]  req@ffff9ee0056ebc00 x1874670272867840/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827410 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827388.563748:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ebc00 x1874670272867840/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827410 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827388.563756:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827388.563759:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827388.563762:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272867840:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827388.563768:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827385/real 1787827388]  req@ffff9ee0056e83c0 x1874670272867968/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827410 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827388.563780:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e83c0 x1874670272867968/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827410 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827388.563795:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827388.563798:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827388.563802:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272867968:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827388.563809:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827385/real 1787827388]  req@ffff9ee0056e8000 x1874670272867584/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827410 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827388.563822:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8000 x1874670272867584/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827410 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827388.563830:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827388.563834:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827388.563838:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272867584:192.168.203.121@tcp:250:kworker.0
00000100:00100000:1.0:1787827388.563862:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827385/real 1787827388]  req@ffff9ee0056eb840 x1874670272868352/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827410 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827388.563874:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb840 x1874670272868352/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827410 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827388.563880:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827388.563883:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827388.563885:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272868352:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827388.563891:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827385/real 1787827388]  req@ffff9ee0056e92c0 x1874670272868096/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827410 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827388.563910:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e92c0 x1874670272868096/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827410 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827388.563919:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827388.563923:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827388.563926:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272868096:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787827388.563933:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827385/real 1787827388]  req@ffff9ee0056e9680 x1874670272868224/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827410 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827388.563945:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9680 x1874670272868224/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827410 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827388.563952:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827388.563955:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827388.563958:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272868224:192.168.203.121@tcp:8:kworker.0
00010000:00010000:3.0:1787827389.395576:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827389.587450:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827390.419640:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1787827390.611446:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827390.611460:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1787827390.611467:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827390.611522:0:8:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2554
00000100:00080000:0.0:1787827390.611537:0:8:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827390.611546:0:8:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787827390.611610:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8b40 x1874670272868480/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787827390.611647:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:0.0:1787827390.611649:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827390.611659:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787827390.611663:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827390.611681:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2554
00000100:00080000:0.0:1787827390.611689:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827390.611698:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827390.611711:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787827390.611758:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272868480:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787827390.611763:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb480 x1874670272868608/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827390.611781:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827390.611786:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787827390.611788:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827390.611795:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2554
00000100:00080000:0.0:1787827390.611801:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827390.611805:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827390.611812:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787827390.611826:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8780 x1874670272868736/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827390.611838:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827390.611843:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787827390.611845:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827390.611849:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2554
00000100:00080000:0.0:1787827390.611871:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827390.611877:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827390.611884:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787827390.611901:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ea580 x1874670272868864/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827390.611915:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827390.611925:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000800:00000100:3.0:1787827390.611927:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:0.0:1787827390.611930:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827390.611941:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2554
00000100:00080000:0.0:1787827390.611950:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827390.611959:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827390.611971:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787827390.612000:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9a40 x1874670272868992/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827390.612038:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1787827390.612038:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827390/real 1787827390]  req@ffff9ee0056e8b40 x1874670272868480/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827415 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827390.612056:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787827390.612065:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827390.612080:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2554
00000100:00080000:0.0:1787827390.612088:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1787827390.612090:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8b40 x1874670272868480/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827415 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827390.612100:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827390.612117:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:3.0:1787827390.612124:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827390.612135:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827390.612144:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb0c0 x1874670272869120/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787827390.612149:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272868480:192.168.203.121@tcp:250:kworker.0
00000100:00080000:0.0:1787827390.612177:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827390.612184:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787827390.612187:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827390.612197:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2554
00000100:00100000:3.0:1787827390.612199:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272868608:192.168.203.121@tcp:38:kworker.0
00000100:00080000:0.0:1787827390.612205:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827390.612218:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827390.612229:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:3.0:1787827390.612256:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827390.612258:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ea940 x1874670272869248/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787827390.612289:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827390/real 1787827390]  req@ffff9ee0056eb480 x1874670272868608/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827415 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827390.612314:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb480 x1874670272868608/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827415 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827390.612328:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827390.612371:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827390.612377:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272868608:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787827390.612387:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272868736:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827390.612423:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827390.612443:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827390/real 1787827390]  req@ffff9ee0056e8780 x1874670272868736/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827415 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827390.612463:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8780 x1874670272868736/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827415 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827390.612513:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827390.612519:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827390.612525:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272868736:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787827390.612535:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272868864:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827390.612569:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827390.612588:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827390/real 1787827390]  req@ffff9ee0056ea580 x1874670272868864/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827415 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827390.612607:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ea580 x1874670272868864/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827415 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827390.612621:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827390.612626:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827390.612631:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272868864:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787827390.612642:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272868992:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787827390.612675:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827390.612693:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827390/real 1787827390]  req@ffff9ee0056e9a40 x1874670272868992/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827415 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827390.613014:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9a40 x1874670272868992/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827415 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827390.613037:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827390.613046:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827390.613053:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272868992:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787827390.613065:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272869120:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827390.613113:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827390.613139:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827390/real 1787827390]  req@ffff9ee0056eb0c0 x1874670272869120/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827415 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827390.613162:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb0c0 x1874670272869120/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827415 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827390.613174:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827390.613179:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827390.613186:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272869120:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787827390.613222:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272869248:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827390.613260:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827390.613282:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827390/real 1787827390]  req@ffff9ee0056ea940 x1874670272869248/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827415 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827390.613304:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ea940 x1874670272869248/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827415 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827390.613357:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827390.613364:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827390.613372:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272869248:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827391.443546:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827391.635644:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787827392.467543:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827392.659459:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827393.491608:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827393.683438:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827394.515593:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827394.707411:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827395.539598:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827395.731484:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:2.0:1787827395.731518:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827395.731526:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787827395.731531:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827395.731543:0:8:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2559
00000100:00080000:2.0:1787827395.731559:0:8:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827395.731567:0:8:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787827395.731618:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057292c0 x1874670272869376/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827395.731646:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827395.731649:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787827395.731651:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827395.731654:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2559
00000100:00080000:2.0:1787827395.731656:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827395.731660:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827395.731674:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787827395.731684:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057292c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272869376:192.168.203.121@tcp:250:kworker.0
00000100:00100000:2.0:1787827395.731690:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729680 x1874670272869504/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827395.731704:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827395.731708:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787827395.731711:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827395.731716:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2559
00000100:00080000:2.0:1787827395.731720:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827395.731725:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827395.731731:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787827395.731746:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572bc00 x1874670272869632/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827395.731756:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827395.731761:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787827395.731764:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827395.731768:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2559
00000100:00080000:2.0:1787827395.731772:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827395.731780:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000800:00000100:3.0:1787827395.731780:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000008:00100000:2.0:1787827395.731790:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787827395.731805:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728780 x1874670272869760/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827395.731813:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827395.731816:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787827395.731817:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827395.731821:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2559
00000100:00080000:2.0:1787827395.731824:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827395.731827:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827395.731831:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787827395.731841:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827395/real 1787827395]  req@ffff9ee0057292c0 x1874670272869376/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827420 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827395.731842:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a940 x1874670272869888/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827395.731872:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827395.731875:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787827395.731876:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827395.731882:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2559
00000100:00100000:3.0:1787827395.731883:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057292c0 x1874670272869376/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827420 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827395.731885:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827395.731890:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827395.731895:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787827395.731906:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a1c0 x1874670272870016/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827395.731908:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827395.731919:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:2.0:1787827395.731920:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827395.731926:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787827395.731927:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1787827395.731929:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057292c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272869376:192.168.203.121@tcp:250:kworker.0
00000100:00080000:2.0:1787827395.731934:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2559
00000100:00080000:2.0:1787827395.731939:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827395.731942:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827395.731945:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787827395.731951:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728f00 x1874670272870144/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787827395.731966:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272869504:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787827395.731992:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827395.732005:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827395/real 1787827395]  req@ffff9ee005729680 x1874670272869504/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827420 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827395.732019:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729680 x1874670272869504/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827420 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827395.732028:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827395.732032:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827395.732036:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272869504:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787827395.732043:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272869632:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827395.732060:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827395.732070:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827395/real 1787827395]  req@ffff9ee00572bc00 x1874670272869632/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827420 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827395.732083:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572bc00 x1874670272869632/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827420 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827395.732092:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827395.732096:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827395.732100:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272869632:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787827395.732105:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272869760:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827395.732119:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827395.732128:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827395/real 1787827395]  req@ffff9ee005728780 x1874670272869760/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827420 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827395.732140:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728780 x1874670272869760/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827420 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827395.732148:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827395.732151:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827395.732155:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272869760:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787827395.732160:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272869888:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787827395.732175:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827395.732185:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827395/real 1787827395]  req@ffff9ee00572a940 x1874670272869888/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827420 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827395.732198:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a940 x1874670272869888/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827420 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827395.732206:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827395.732210:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827395.732213:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272869888:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787827395.732219:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272870016:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827395.732234:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827395.732243:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827395/real 1787827395]  req@ffff9ee00572a1c0 x1874670272870016/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827420 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827395.732255:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a1c0 x1874670272870016/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827420 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827395.732264:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827395.732266:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827395.732270:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272870016:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787827395.732275:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272870144:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827395.732295:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827395.732306:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827395/real 1787827395]  req@ffff9ee005728f00 x1874670272870144/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827420 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827395.732337:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728f00 x1874670272870144/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827420 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827395.732355:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827395.732358:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827395.732362:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272870144:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827396.563522:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827396.755423:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787827397.587662:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827397.779544:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827398.611594:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827398.803458:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827399.635572:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827399.827492:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827400.659528:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1787827400.851457:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827400.851471:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787827400.851477:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827400.851492:0:8:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2564
00000100:00100000:3.0:1787827400.851492:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:2.0:1787827400.851512:0:8:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827400.851527:0:8:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787827400.851590:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b840 x1874670272870272/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827400.851640:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827400.851645:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787827400.851648:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827400.851655:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2564
00000100:00080000:2.0:1787827400.851661:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827400.851666:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827400.851690:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787827400.851712:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057283c0 x1874670272870400/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787827400.851722:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272870272:192.168.203.121@tcp:250:kworker.0
00000100:00080000:2.0:1787827400.851735:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827400.851742:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787827400.851745:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827400.851751:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2564
00000100:00080000:2.0:1787827400.851755:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827400.851760:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827400.851766:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787827400.851783:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729e00 x1874670272870528/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827400.851797:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827400.851801:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787827400.851805:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827400.851812:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2564
00000100:00080000:2.0:1787827400.851820:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827400.851827:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000800:00000100:3.0:1787827400.851840:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000008:00100000:2.0:1787827400.851844:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787827400.851876:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728000 x1874670272870656/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827400.851901:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827400.851908:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787827400.851917:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1787827400.851921:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827400/real 1787827400]  req@ffff9ee00572b840 x1874670272870272/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827425 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827400.851927:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2564
00000100:00080000:2.0:1787827400.851937:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827400.851948:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827400.851957:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787827400.851975:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a580 x1874670272870784/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827400.851991:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827400.851996:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787827400.852001:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1787827400.852005:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b840 x1874670272870272/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827425 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827400.852011:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2564
00000100:00080000:2.0:1787827400.852016:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827400.852021:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827400.852030:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787827400.852051:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728b40 x1874670272870912/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827400.852058:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827400.852069:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827400.852078:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:2.0:1787827400.852079:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787827400.852088:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1787827400.852096:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272870272:192.168.203.121@tcp:250:kworker.0
00000100:00080000:2.0:1787827400.852107:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2564
00000100:00080000:2.0:1787827400.852119:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827400.852128:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827400.852140:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827400.852145:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272870400:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787827400.852178:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b0c0 x1874670272871040/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1787827400.852198:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827400.852225:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827400/real 1787827400]  req@ffff9ee0057283c0 x1874670272870400/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827425 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827400.852245:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057283c0 x1874670272870400/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827425 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827400.852257:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827400.852261:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827400.852265:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272870400:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787827400.852273:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272870528:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827400.852305:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827400.852350:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827400/real 1787827400]  req@ffff9ee005729e00 x1874670272870528/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827425 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827400.852376:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729e00 x1874670272870528/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827425 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827400.852386:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827400.852390:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827400.852394:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272870528:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787827400.852402:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272870656:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827400.852461:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827400.852477:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827400/real 1787827400]  req@ffff9ee005728000 x1874670272870656/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827425 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827400.852492:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728000 x1874670272870656/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827425 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827400.852512:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827400.852519:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827400.852526:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272870656:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787827400.852538:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272870784:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787827400.852576:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827400.852598:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827400/real 1787827400]  req@ffff9ee00572a580 x1874670272870784/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827425 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827400.852623:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a580 x1874670272870784/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827425 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827400.852639:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827400.852646:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827400.852662:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272870784:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787827400.852675:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272870912:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827400.852712:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827400.852735:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827400/real 1787827400]  req@ffff9ee005728b40 x1874670272870912/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827425 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827400.852758:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728b40 x1874670272870912/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827425 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827400.852774:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827400.852779:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827400.852786:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272870912:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787827400.852828:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272871040:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827400.852864:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827400.852900:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827400/real 1787827400]  req@ffff9ee00572b0c0 x1874670272871040/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827425 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827400.852925:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b0c0 x1874670272871040/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827425 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827400.852941:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827400.852959:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827400.852966:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272871040:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827401.683579:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827401.875501:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787827402.707584:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827402.899531:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827403.731624:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827403.923575:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827404.755496:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827404.947491:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827405.779574:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827405.971494:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:0.0:1787827405.971505:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827405.971513:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1787827405.971517:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827405.971539:0:8:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2569
00000100:00080000:0.0:1787827405.971550:0:8:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827405.971558:0:8:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787827405.971596:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ead00 x1874670272871168/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827405.971640:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827405.971644:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787827405.971646:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827405.971649:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2569
00000100:00080000:0.0:1787827405.971652:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827405.971655:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827405.971664:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787827405.971675:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9e00 x1874670272871296/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827405.971685:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827405.971690:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787827405.971691:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827405.971696:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2569
00000100:00080000:0.0:1787827405.971699:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827405.971702:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827405.971708:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827405.971716:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272871168:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787827405.971723:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ea940 x1874670272871424/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827405.971734:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827405.971736:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787827405.971738:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827405.971742:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2569
00000100:00080000:0.0:1787827405.971762:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827405.971766:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827405.971771:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787827405.971784:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb0c0 x1874670272871552/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827405.971795:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827405.971799:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787827405.971801:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827405.971804:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2569
00000100:00080000:0.0:1787827405.971825:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000800:00000100:3.0:1787827405.971837:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:0.0:1787827405.971840:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827405.971847:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787827405.971858:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9a40 x1874670272871680/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827405.971866:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827405.971869:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787827405.971871:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827405.971874:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2569
00000100:00080000:0.0:1787827405.971877:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827405.971880:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787827405.971885:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827405/real 1787827405]  req@ffff9ee0056ead00 x1874670272871168/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827430 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:0.0:1787827405.971887:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787827405.971902:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ea580 x1874670272871808/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787827405.971911:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ead00 x1874670272871168/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827430 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827405.971912:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827405.971922:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787827405.971925:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827405.971933:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2569
00000100:00080000:0.0:1787827405.971937:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827405.971938:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827405.971942:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00080000:3.0:1787827405.971947:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000008:00100000:0.0:1787827405.971949:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827405.971953:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272871168:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787827405.971964:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8780 x1874670272871936/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787827405.971965:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272871296:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787827405.971995:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827405.972007:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827405/real 1787827405]  req@ffff9ee0056e9e00 x1874670272871296/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827430 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827405.972018:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9e00 x1874670272871296/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827430 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827405.972024:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827405.972027:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827405.972030:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272871296:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787827405.972075:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272871424:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827405.972113:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827405.972126:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827405/real 1787827405]  req@ffff9ee0056ea940 x1874670272871424/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827430 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827405.972165:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ea940 x1874670272871424/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827430 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827405.972177:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827405.972182:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827405.972187:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272871424:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787827405.972196:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272871552:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827405.972235:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827405.972251:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827405/real 1787827405]  req@ffff9ee0056eb0c0 x1874670272871552/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827430 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827405.972273:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb0c0 x1874670272871552/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827430 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827405.972281:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827405.972284:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827405.972286:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272871552:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787827405.972292:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272871680:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787827405.972311:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827405.972370:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827405/real 1787827405]  req@ffff9ee0056e9a40 x1874670272871680/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827430 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827405.972418:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9a40 x1874670272871680/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827430 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827405.972425:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827405.972427:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827405.972430:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272871680:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787827405.972445:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272871808:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827405.972481:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827405.972492:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827405/real 1787827405]  req@ffff9ee0056ea580 x1874670272871808/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827430 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827405.972509:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ea580 x1874670272871808/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827430 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827405.972515:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827405.972518:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827405.972520:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272871808:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787827405.972525:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272871936:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827405.972538:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827405.972546:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827405/real 1787827405]  req@ffff9ee0056e8780 x1874670272871936/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827430 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827405.972556:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8780 x1874670272871936/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827430 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827405.972563:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827405.972565:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827405.972567:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272871936:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827406.803576:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827406.995443:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787827407.827496:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827408.019439:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827408.851567:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827409.043468:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827409.875576:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827410.067468:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827410.899731:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827411.091491:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:0.0:1787827411.091507:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827411.091516:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1787827411.091521:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827411.091533:0:8:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2574
00000100:00080000:0.0:1787827411.091547:0:8:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827411.091556:0:8:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787827411.091617:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb480 x1874670272872064/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827411.091666:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827411.091670:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787827411.091674:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827411.091679:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2574
00000100:00080000:0.0:1787827411.091683:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827411.091687:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827411.091698:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787827411.091713:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8b40 x1874670272872192/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827411.091726:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827411.091730:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787827411.091733:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827411.091740:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2574
00000100:00100000:3.0:1787827411.091743:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272872064:192.168.203.121@tcp:250:kworker.0
00000100:00080000:0.0:1787827411.091745:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827411.091755:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827411.091766:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787827411.091778:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9680 x1874670272872320/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827411.091791:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827411.091797:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787827411.091801:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827411.091808:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2574
00000100:00080000:0.0:1787827411.091815:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827411.091839:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827411.091847:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:3.0:1787827411.091865:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827411.091871:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e92c0 x1874670272872448/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827411.091890:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827411.091912:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787827411.091916:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827411.091924:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2574
00000100:00080000:0.0:1787827411.091931:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827411.091942:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787827411.091943:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827411/real 1787827411]  req@ffff9ee0056eb480 x1874670272872064/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827436 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:0.0:1787827411.091949:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787827411.091973:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb840 x1874670272872576/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827411.091986:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1787827411.091989:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb480 x1874670272872064/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827436 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827411.091991:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787827411.091998:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827411.092012:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2574
00000100:00080000:0.0:1787827411.092020:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827411.092021:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827411.092052:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00080000:3.0:1787827411.092058:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000008:00100000:0.0:1787827411.092061:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827411.092068:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272872064:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787827411.092079:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8000 x1874670272872704/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787827411.092085:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272872192:192.168.203.121@tcp:38:kworker.0
00000100:00080000:0.0:1787827411.092104:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827411.092108:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787827411.092110:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827411.092117:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2574
00000100:00080000:0.0:1787827411.092125:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000800:00000100:3.0:1787827411.092132:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:0.0:1787827411.092140:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827411.092151:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827411.092164:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827411/real 1787827411]  req@ffff9ee0056e8b40 x1874670272872192/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827436 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827411.092177:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e83c0 x1874670272872832/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787827411.092195:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8b40 x1874670272872192/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827436 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827411.092266:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827411.092275:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827411.092280:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272872192:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787827411.092397:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272872320:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827411.092443:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827411.092459:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827411/real 1787827411]  req@ffff9ee0056e9680 x1874670272872320/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827436 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827411.092472:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9680 x1874670272872320/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827436 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827411.092489:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827411.092492:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827411.092496:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272872320:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787827411.092502:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272872448:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827411.092520:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827411.092530:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827411/real 1787827411]  req@ffff9ee0056e92c0 x1874670272872448/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827436 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827411.092542:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e92c0 x1874670272872448/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827436 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827411.092551:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827411.092554:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827411.092557:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272872448:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787827411.092563:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272872576:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787827411.092604:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827411.092620:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827411/real 1787827411]  req@ffff9ee0056eb840 x1874670272872576/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827436 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827411.092639:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb840 x1874670272872576/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827436 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827411.092651:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827411.092657:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827411.092663:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272872576:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787827411.092673:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272872704:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827411.092704:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827411.092716:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827411/real 1787827411]  req@ffff9ee0056e8000 x1874670272872704/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827436 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827411.092728:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8000 x1874670272872704/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827436 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827411.092737:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827411.092740:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827411.092743:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272872704:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787827411.092751:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272872832:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827411.092779:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827411.092796:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827411/real 1787827411]  req@ffff9ee0056e83c0 x1874670272872832/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827436 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827411.092816:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e83c0 x1874670272872832/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827436 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827411.092829:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827411.092833:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827411.092836:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272872832:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827411.923615:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827412.115483:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787827412.947576:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827413.139471:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827413.971578:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827414.163464:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827414.995557:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827415.187443:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827416.019488:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827416.211449:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787827416.211487:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827416.211492:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787827416.211495:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827416.211503:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2579
00000100:00080000:3.0:1787827416.211524:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827416.211532:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787827416.211565:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057043c0 x1874670272872960/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827416.211589:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827416.211592:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787827416.211594:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827416.211596:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2579
00000100:00080000:3.0:1787827416.211599:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827416.211602:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827416.211610:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787827416.211619:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057052c0 x1874670272873088/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827416.211628:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1787827416.211629:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272872960:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787827416.211635:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787827416.211638:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827416.211641:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2579
00000100:00080000:3.0:1787827416.211643:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827416.211645:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827416.211649:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827416.211660:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704b40 x1874670272873216/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827416.211669:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827416.211673:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787827416.211675:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827416.211679:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2579
00000100:00080000:3.0:1787827416.211684:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827416.211688:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827416.211694:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1787827416.211698:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827416.211717:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707480 x1874670272873344/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827416.211725:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827416.211728:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787827416.211730:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827416.211733:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2579
00000100:00080000:3.0:1787827416.211737:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1787827416.211738:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827416/real 1787827416]  req@ffff9ee0057043c0 x1874670272872960/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827441 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827416.211743:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827416.211750:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787827416.211761:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057043c0 x1874670272872960/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827441 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827416.211762:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057061c0 x1874670272873472/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827416.211795:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827416.211796:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827416.211801:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787827416.211804:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827416.211807:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:3.0:1787827416.211810:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2579
00000100:00080000:3.0:1787827416.211814:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1787827416.211818:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272872960:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787827416.211819:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827416.211826:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827416.211833:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705a40 x1874670272873600/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827416.211839:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827416.211841:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787827416.211843:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827416.211845:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2579
00000100:00080000:3.0:1787827416.211847:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1787827416.211849:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272873088:192.168.203.121@tcp:38:kworker.0
00000100:00080000:3.0:1787827416.211852:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827416.211858:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827416.211868:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704780 x1874670272873728/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1787827416.211879:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827416.211893:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827416/real 1787827416]  req@ffff9ee0057052c0 x1874670272873088/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827441 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827416.211902:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057052c0 x1874670272873088/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827441 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827416.211909:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827416.211911:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827416.211913:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272873088:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787827416.211917:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272873216:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827416.211939:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827416.211945:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827416/real 1787827416]  req@ffff9ee005704b40 x1874670272873216/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827441 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827416.211953:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704b40 x1874670272873216/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827441 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827416.211958:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827416.211960:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827416.211962:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272873216:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827416.211966:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272873344:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827416.211976:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827416.211981:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827416/real 1787827416]  req@ffff9ee005707480 x1874670272873344/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827441 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827416.211989:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707480 x1874670272873344/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827441 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827416.211994:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827416.211995:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827416.211997:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272873344:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827416.212001:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272873472:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787827416.212010:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827416.212015:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827416/real 1787827416]  req@ffff9ee0057061c0 x1874670272873472/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827441 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827416.212021:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057061c0 x1874670272873472/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827441 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827416.212029:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827416.212032:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827416.212036:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272873472:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787827416.212041:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272873600:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827416.212060:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827416.212072:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827416/real 1787827416]  req@ffff9ee005705a40 x1874670272873600/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827441 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827416.212083:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705a40 x1874670272873600/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827441 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827416.212089:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827416.212091:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827416.212093:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272873600:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827416.212107:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272873728:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827416.212120:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827416.212127:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827416/real 1787827416]  req@ffff9ee005704780 x1874670272873728/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827441 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827416.212134:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704780 x1874670272873728/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827441 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827416.212139:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827416.212141:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827416.212144:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272873728:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827417.043501:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827417.235465:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787827418.067573:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827418.259541:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827419.091573:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827419.283630:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827420.115597:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827420.307373:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827421.139498:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827421.331380:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:1.0:1787827421.331428:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827421.331435:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1787827421.331440:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827421.331449:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2585
00000100:00080000:1.0:1787827421.331460:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827421.331475:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787827421.331518:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a30c0 x1874670272873856/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827421.331549:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827421.331551:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787827421.331553:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827421.331557:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2585
00000100:00080000:1.0:1787827421.331561:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827421.331565:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827421.331576:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787827421.331583:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272873856:192.168.203.121@tcp:250:kworker.0
00000100:00100000:1.0:1787827421.331606:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0780 x1874670272873984/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827421.331618:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827421.331622:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787827421.331624:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827421.331628:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2585
00000100:00080000:1.0:1787827421.331633:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827421.331638:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827421.331644:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:3.0:1787827421.331650:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827421.331681:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0000 x1874670272874112/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827421.331694:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1787827421.331699:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827421/real 1787827421]  req@ffff9ee0056a30c0 x1874670272873856/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827446 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827421.331700:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787827421.331704:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827421.331710:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2585
00000100:00080000:1.0:1787827421.331714:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827421.331720:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827421.331742:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827421.331750:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a30c0 x1874670272873856/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827446 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827421.331755:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1e00 x1874670272874240/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827421.331768:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827421.331776:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:1.0:1787827421.331778:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1787827421.331782:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272873856:192.168.203.121@tcp:250:kworker.0
00000100:00080000:1.0:1787827421.331783:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787827421.331787:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827421.331793:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2585
00000100:00080000:1.0:1787827421.331796:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827421.331799:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827421.331803:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787827421.331806:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272873984:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787827421.331812:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a03c0 x1874670272874368/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827421.331821:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827421.331824:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787827421.331826:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827421.331829:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2585
00000800:00000100:3.0:1787827421.331833:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:1.0:1787827421.331839:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827421.331844:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827421.331850:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827421.331854:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827421/real 1787827421]  req@ffff9ee0056a0780 x1874670272873984/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827446 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827421.331861:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a2580 x1874670272874496/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827421.331882:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827421.331885:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787827421.331887:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1787827421.331889:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0780 x1874670272873984/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827446 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827421.331892:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2585
00000100:00080000:1.0:1787827421.331897:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827421.331903:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00080000:3.0:1787827421.331909:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000008:00100000:1.0:1787827421.331910:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:3.0:1787827421.331917:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827421.331928:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272873984:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787827421.331932:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0b40 x1874670272874624/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787827421.331937:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272874112:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827421.331968:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827421.331977:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827421/real 1787827421]  req@ffff9ee0056a0000 x1874670272874112/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827446 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827421.331985:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0000 x1874670272874112/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827446 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827421.331995:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827421.331997:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827421.331999:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272874112:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787827421.332003:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272874240:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827421.332024:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827421.332030:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827421/real 1787827421]  req@ffff9ee0056a1e00 x1874670272874240/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827446 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827421.332037:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1e00 x1874670272874240/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827446 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827421.332042:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827421.332044:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827421.332046:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272874240:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787827421.332058:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272874368:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787827421.332068:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827421.332074:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827421/real 1787827421]  req@ffff9ee0056a03c0 x1874670272874368/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827446 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827421.332093:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a03c0 x1874670272874368/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827446 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827421.332098:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827421.332100:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827421.332102:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272874368:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787827421.332106:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272874496:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827421.332115:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827421.332121:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827421/real 1787827421]  req@ffff9ee0056a2580 x1874670272874496/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827446 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827421.332128:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a2580 x1874670272874496/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827446 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827421.332132:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827421.332134:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827421.332136:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272874496:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787827421.332139:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272874624:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827421.332156:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827421.332161:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827421/real 1787827421]  req@ffff9ee0056a0b40 x1874670272874624/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827446 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827421.332168:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0b40 x1874670272874624/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827446 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827421.332172:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827421.332174:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827421.332176:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272874624:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827422.163461:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827422.355379:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787827423.187547:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827423.379439:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827424.211499:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827424.403419:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827425.235586:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827425.427408:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827426.259518:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827426.451409:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:1.0:1787827426.451411:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827426.451419:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1787827426.451423:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827426.451431:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2590
00000100:00080000:1.0:1787827426.451440:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827426.451454:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787827426.451507:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a3480 x1874670272874752/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827426.451535:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827426.451538:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787827426.451540:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827426.451544:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2590
00000100:00080000:1.0:1787827426.451548:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827426.451569:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827426.451589:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787827426.451595:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272874752:192.168.203.121@tcp:250:kworker.0
00000100:00100000:1.0:1787827426.451602:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a12c0 x1874670272874880/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827426.451611:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827426.451613:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787827426.451615:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827426.451617:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2590
00000100:00080000:1.0:1787827426.451620:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827426.451623:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827426.451626:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787827426.451634:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1a40 x1874670272875008/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827426.451640:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827426.451642:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787827426.451644:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827426.451647:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2590
00000100:00080000:1.0:1787827426.451650:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827426.451652:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000800:00000100:3.0:1787827426.451657:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000008:00100000:1.0:1787827426.451658:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787827426.451668:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a3c00 x1874670272875136/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827426.451675:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827426.451677:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787827426.451678:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827426.451681:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2590
00000100:00080000:1.0:1787827426.451683:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827426.451685:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827426.451688:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787827426.451697:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827426/real 1787827426]  req@ffff9ee0056a3480 x1874670272874752/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827451 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827426.451699:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a2940 x1874670272875264/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827426.451731:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827426.451734:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787827426.451735:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827426.451741:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2590
00000100:00100000:3.0:1787827426.451741:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a3480 x1874670272874752/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827451 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827426.451744:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827426.451751:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827426.451759:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:3.0:1787827426.451761:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827426.451767:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827426.451769:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1680 x1874670272875392/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827426.451785:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1787827426.451788:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272874752:192.168.203.121@tcp:250:kworker.0
00000100:00080000:1.0:1787827426.451789:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787827426.451792:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827426.451798:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2590
00000100:00080000:1.0:1787827426.451800:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827426.451803:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827426.451805:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787827426.451812:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0f00 x1874670272875520/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787827426.451816:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272874880:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787827426.451843:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827426.451855:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827426/real 1787827426]  req@ffff9ee0056a12c0 x1874670272874880/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827451 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827426.451864:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a12c0 x1874670272874880/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827451 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827426.451871:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827426.451875:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827426.451880:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272874880:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787827426.451886:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272875008:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827426.451903:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827426.451911:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827426/real 1787827426]  req@ffff9ee0056a1a40 x1874670272875008/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827451 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827426.451920:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1a40 x1874670272875008/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827451 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827426.451926:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827426.451928:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827426.451930:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272875008:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787827426.451934:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272875136:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827426.451952:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827426.451959:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827426/real 1787827426]  req@ffff9ee0056a3c00 x1874670272875136/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827451 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827426.451985:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a3c00 x1874670272875136/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827451 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827426.451992:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827426.451996:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827426.451998:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272875136:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787827426.452005:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272875264:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787827426.452020:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827426.452030:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827426/real 1787827426]  req@ffff9ee0056a2940 x1874670272875264/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827451 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827426.452038:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a2940 x1874670272875264/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827451 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827426.452046:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827426.452049:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827426.452052:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272875264:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787827426.452057:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272875392:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827426.452135:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827426.452145:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827426/real 1787827426]  req@ffff9ee0056a1680 x1874670272875392/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827451 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827426.452153:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1680 x1874670272875392/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827451 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827426.452158:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827426.452161:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827426.452163:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272875392:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787827426.452178:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272875520:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827426.452192:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827426.452312:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827426/real 1787827426]  req@ffff9ee0056a0f00 x1874670272875520/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827451 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827426.452391:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0f00 x1874670272875520/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827451 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827426.452404:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827426.452408:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827426.452411:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272875520:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827427.283577:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827427.475510:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787827428.307452:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827428.499524:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827429.331486:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827429.523423:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827430.355454:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827430.547427:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827431.379474:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827431.571416:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:0.0:1787827431.571429:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827431.571446:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1787827431.571450:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827431.571458:0:8:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2595
00000100:00080000:0.0:1787827431.571467:0:8:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827431.571473:0:8:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787827431.571512:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ebc00 x1874670272875648/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827431.571544:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827431.571547:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787827431.571548:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827431.571551:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2595
00000100:00080000:0.0:1787827431.571554:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827431.571557:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827431.571565:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787827431.571574:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272875648:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787827431.571577:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8f00 x1874670272875776/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827431.571587:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827431.571589:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787827431.571591:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827431.571594:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2595
00000100:00080000:0.0:1787827431.571606:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827431.571609:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827431.571612:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787827431.571622:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e83c0 x1874670272875904/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827431.571628:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827431.571630:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787827431.571631:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827431.571635:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2595
00000100:00080000:0.0:1787827431.571638:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827431.571641:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827431.571643:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:3.0:1787827431.571647:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827431.571655:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8000 x1874670272876032/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827431.571663:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827431.571665:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787827431.571667:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827431.571669:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2595
00000100:00080000:0.0:1787827431.571671:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827431.571674:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827431.571677:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787827431.571685:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827431/real 1787827431]  req@ffff9ee0056ebc00 x1874670272875648/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827456 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827431.571687:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb840 x1874670272876160/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827431.571714:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1787827431.571717:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ebc00 x1874670272875648/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827456 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827431.571721:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787827431.571726:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827431.571734:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827431.571735:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2595
00000100:00080000:3.0:1787827431.571751:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:0.0:1787827431.571752:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1787827431.571757:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272875648:192.168.203.121@tcp:250:kworker.0
00000100:00080000:0.0:1787827431.571761:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827431.571768:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787827431.571778:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e92c0 x1874670272876288/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787827431.571781:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272875776:192.168.203.121@tcp:38:kworker.0
00000100:00080000:0.0:1787827431.571799:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:3.0:1787827431.571809:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:0.0:1787827431.571817:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787827431.571820:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1787827431.571824:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827431/real 1787827431]  req@ffff9ee0056e8f00 x1874670272875776/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827456 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827431.571827:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2595
00000100:00080000:0.0:1787827431.571836:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1787827431.571842:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8f00 x1874670272875776/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827456 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827431.571846:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00080000:3.0:1787827431.571851:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000008:00100000:0.0:1787827431.571855:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:3.0:1787827431.571857:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827431.571862:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272875776:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787827431.571868:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272875904:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787827431.571871:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9680 x1874670272876416/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1787827431.571902:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827431.571911:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827431/real 1787827431]  req@ffff9ee0056e83c0 x1874670272875904/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827456 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827431.571919:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e83c0 x1874670272875904/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827456 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827431.571924:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827431.571926:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827431.571928:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272875904:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787827431.571931:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272876032:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827431.571941:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827431.571948:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827431/real 1787827431]  req@ffff9ee0056e8000 x1874670272876032/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827456 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827431.571960:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8000 x1874670272876032/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827456 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827431.571975:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827431.571978:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827431.571982:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272876032:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787827431.571988:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272876160:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787827431.572010:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827431.572033:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827431/real 1787827431]  req@ffff9ee0056eb840 x1874670272876160/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827456 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827431.572046:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb840 x1874670272876160/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827456 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827431.572054:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827431.572070:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827431.572078:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272876160:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787827431.572106:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272876288:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827431.572134:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827431.572145:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827431/real 1787827431]  req@ffff9ee0056e92c0 x1874670272876288/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827456 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827431.572158:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e92c0 x1874670272876288/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827456 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827431.572166:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827431.572169:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827431.572173:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272876288:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787827431.572179:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272876416:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827431.572212:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827431.572226:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827431/real 1787827431]  req@ffff9ee0056e9680 x1874670272876416/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827456 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827431.572248:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9680 x1874670272876416/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827456 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827431.572256:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827431.572259:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827431.572262:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272876416:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827432.403507:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827432.595418:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787827433.427587:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827433.619398:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827434.451526:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827434.643444:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827435.475462:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827435.667430:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827436.499609:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827436.691437:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:2.0:1787827436.691468:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827436.691476:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787827436.691482:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827436.691493:0:8:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2600
00000100:00080000:2.0:1787827436.691504:0:8:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827436.691510:0:8:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787827436.691542:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b480 x1874670272876544/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827436.691564:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827436.691567:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787827436.691569:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827436.691571:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2600
00000100:00080000:2.0:1787827436.691573:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827436.691576:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827436.691589:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787827436.691601:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572ad00 x1874670272876672/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827436.691609:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827436.691612:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787827436.691613:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827436.691615:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2600
00000100:00080000:2.0:1787827436.691617:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827436.691620:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827436.691624:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787827436.691642:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729a40 x1874670272876800/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787827436.691642:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272876544:192.168.203.121@tcp:250:kworker.0
00000100:00080000:2.0:1787827436.691672:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827436.691674:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787827436.691676:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827436.691681:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2600
00000100:00080000:2.0:1787827436.691683:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827436.691687:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827436.691690:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787827436.691700:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b0c0 x1874670272876928/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827436.691707:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827436.691710:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787827436.691711:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827436.691714:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2600
00000100:00080000:2.0:1787827436.691734:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827436.691737:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827436.691741:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787827436.691763:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728b40 x1874670272877056/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1787827436.691764:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:2.0:1787827436.691777:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827436.691781:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787827436.691783:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827436.691788:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2600
00000100:00080000:2.0:1787827436.691791:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827436.691796:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827436.691801:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787827436.691809:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a580 x1874670272877184/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827436.691819:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827436.691822:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787827436.691824:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827436.691829:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2600
00000100:00100000:3.0:1787827436.691830:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827436/real 1787827436]  req@ffff9ee00572b480 x1874670272876544/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827461 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827436.691832:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827436.691841:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827436.691853:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787827436.691870:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728000 x1874670272877312/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787827436.691876:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b480 x1874670272876544/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827461 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827436.691935:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827436.691941:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827436.691947:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272876544:192.168.203.121@tcp:250:kworker.0
00000100:00100000:3.0:1787827436.691954:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272876672:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787827436.691976:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827436.691986:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827436/real 1787827436]  req@ffff9ee00572ad00 x1874670272876672/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827461 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827436.691996:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572ad00 x1874670272876672/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827461 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827436.692003:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827436.692005:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827436.692007:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272876672:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787827436.692042:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272876800:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827436.692069:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827436.692085:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827436/real 1787827436]  req@ffff9ee005729a40 x1874670272876800/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827461 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827436.692098:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729a40 x1874670272876800/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827461 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827436.692105:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827436.692108:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827436.692110:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272876800:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787827436.692116:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272876928:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827436.692133:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827436.692142:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827436/real 1787827436]  req@ffff9ee00572b0c0 x1874670272876928/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827461 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827436.692151:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b0c0 x1874670272876928/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827461 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827436.692157:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827436.692176:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827436.692179:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272876928:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787827436.692185:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272877056:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787827436.692202:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827436.692212:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827436/real 1787827436]  req@ffff9ee005728b40 x1874670272877056/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827461 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827436.692221:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728b40 x1874670272877056/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827461 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827436.692228:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827436.692230:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827436.692233:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272877056:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787827436.692237:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272877184:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827436.692249:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827436.692256:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827436/real 1787827436]  req@ffff9ee00572a580 x1874670272877184/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827461 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827436.692265:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a580 x1874670272877184/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827461 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827436.692271:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827436.692273:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827436.692275:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272877184:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787827436.692280:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272877312:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827436.692292:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827436.692299:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827436/real 1787827436]  req@ffff9ee005728000 x1874670272877312/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827461 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827436.692307:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728000 x1874670272877312/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827461 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827436.692359:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827436.692363:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827436.692366:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272877312:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827437.523478:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827437.715380:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787827438.547471:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827438.739391:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827439.571439:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827439.763429:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827440.595502:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827440.787427:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827441.619481:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827441.811396:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:0.0:1787827441.811452:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827441.811461:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1787827441.811466:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827441.811478:0:8:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2605
00000100:00080000:0.0:1787827441.811491:0:8:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827441.811498:0:8:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787827441.811544:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8b40 x1874670272877440/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827441.811580:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827441.811587:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787827441.811590:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827441.811597:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2605
00000100:00080000:0.0:1787827441.811605:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827441.811613:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827441.811626:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787827441.811633:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272877440:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787827441.811648:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb480 x1874670272877568/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827441.811661:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827441.811664:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787827441.811667:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827441.811673:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2605
00000100:00080000:0.0:1787827441.811680:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827441.811684:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827441.811689:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787827441.811703:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8780 x1874670272877696/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1787827441.811707:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:0.0:1787827441.811720:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827441.811724:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787827441.811726:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827441.811731:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2605
00000100:00080000:0.0:1787827441.811734:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827441.811737:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827441.811742:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827441.811755:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827441/real 1787827441]  req@ffff9ee0056e8b40 x1874670272877440/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827466 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827441.811756:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ea580 x1874670272877824/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827441.811813:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827441.811819:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787827441.811822:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827441.811827:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2605
00000100:00080000:0.0:1787827441.811833:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1787827441.811833:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8b40 x1874670272877440/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827466 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827441.811847:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827441.811858:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00080000:3.0:1787827441.811861:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827441.811868:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827441.811873:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9a40 x1874670272877952/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787827441.811881:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272877440:192.168.203.121@tcp:250:kworker.0
00000100:00080000:0.0:1787827441.811906:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827441.811921:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00100000:3.0:1787827441.811922:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272877568:192.168.203.121@tcp:38:kworker.0
00000100:00080000:0.0:1787827441.811924:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827441.811930:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2605
00000100:00080000:0.0:1787827441.811937:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827441.811946:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827441.811950:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787827441.811963:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb0c0 x1874670272878080/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827441.811972:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827441.811979:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787827441.811981:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827441.811985:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2605
00000800:00000100:3.0:1787827441.811990:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:0.0:1787827441.811992:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827441.811998:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827441.812003:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827441.812018:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827441/real 1787827441]  req@ffff9ee0056eb480 x1874670272877568/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827466 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827441.812020:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ea940 x1874670272878208/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787827441.812096:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb480 x1874670272877568/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827466 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827441.812108:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827441.812113:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827441.812116:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272877568:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787827441.812136:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272877696:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827441.812178:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827441.812187:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827441/real 1787827441]  req@ffff9ee0056e8780 x1874670272877696/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827466 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827441.812200:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8780 x1874670272877696/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827466 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827441.812206:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827441.812208:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827441.812210:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272877696:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787827441.812214:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272877824:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827441.812226:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827441.812232:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827441/real 1787827441]  req@ffff9ee0056ea580 x1874670272877824/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827466 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827441.812239:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ea580 x1874670272877824/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827466 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827441.812244:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827441.812246:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827441.812248:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272877824:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787827441.812252:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272877952:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787827441.812262:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827441.812267:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827441/real 1787827441]  req@ffff9ee0056e9a40 x1874670272877952/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827466 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827441.812274:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9a40 x1874670272877952/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827466 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827441.812283:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827441.812286:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827441.812288:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272877952:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787827441.812300:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272878080:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827441.812311:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827441.812317:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827441/real 1787827441]  req@ffff9ee0056eb0c0 x1874670272878080/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827466 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827441.812324:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb0c0 x1874670272878080/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827466 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827441.812349:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827441.812351:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827441.812353:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272878080:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787827441.812358:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272878208:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827441.812370:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827441.812377:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827441/real 1787827441]  req@ffff9ee0056ea940 x1874670272878208/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827466 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827441.812385:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ea940 x1874670272878208/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827466 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827441.812390:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827441.812392:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827441.812394:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272878208:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827442.643581:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827442.835445:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787827443.667575:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827443.859432:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827444.691599:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827444.883473:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827445.715478:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827445.907412:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827446.739536:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827446.931443:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:2.0:1787827446.931488:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827446.931501:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787827446.931505:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827446.931515:0:8:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2610
00000100:00080000:2.0:1787827446.931528:0:8:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827446.931536:0:8:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787827446.931579:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729e00 x1874670272878336/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827446.931621:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827446.931626:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787827446.931628:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827446.931634:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2610
00000100:00080000:2.0:1787827446.931640:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827446.931647:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787827446.931659:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272878336:192.168.203.121@tcp:250:kworker.0
00000008:00100000:2.0:1787827446.931660:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787827446.931686:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057283c0 x1874670272878464/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827446.931702:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827446.931707:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787827446.931709:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827446.931715:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2610
00000100:00080000:2.0:1787827446.931730:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827446.931736:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827446.931741:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:3.0:1787827446.931747:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827446.931752:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b840 x1874670272878592/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827446.931762:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827446.931765:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787827446.931767:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827446.931772:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2610
00000100:00080000:2.0:1787827446.931776:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827446.931786:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827446.931793:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827446.931796:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827446/real 1787827446]  req@ffff9ee005729e00 x1874670272878336/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827471 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827446.931805:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728f00 x1874670272878720/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827446.931827:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1787827446.931829:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729e00 x1874670272878336/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827471 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827446.931833:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787827446.931840:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827446.931856:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2610
00000100:00080000:2.0:1787827446.931862:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827446.931863:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827446.931869:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00080000:3.0:1787827446.931871:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000008:00100000:2.0:1787827446.931881:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787827446.931885:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272878336:192.168.203.121@tcp:250:kworker.0
00000100:00100000:2.0:1787827446.931895:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a1c0 x1874670272878848/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827446.931905:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827446.931907:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787827446.931910:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827446.931913:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2610
00000100:00100000:3.0:1787827446.931919:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272878464:192.168.203.121@tcp:38:kworker.0
00000100:00080000:2.0:1787827446.931920:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827446.931931:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827446.931933:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787827446.931954:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a940 x1874670272878976/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1787827446.931969:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:2.0:1787827446.931983:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827446.931986:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787827446.931988:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827446.931992:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2610
00000100:00100000:3.0:1787827446.931992:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827446/real 1787827446]  req@ffff9ee0057283c0 x1874670272878464/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827471 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827446.932001:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827446.932014:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827446.932025:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827446.932031:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057283c0 x1874670272878464/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827471 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827446.932041:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728780 x1874670272879104/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827446.932110:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827446.932115:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827446.932119:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272878464:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787827446.932143:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272878592:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827446.932167:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827446.932178:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827446/real 1787827446]  req@ffff9ee00572b840 x1874670272878592/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827471 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827446.932188:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b840 x1874670272878592/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827471 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827446.932195:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827446.932198:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827446.932201:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272878592:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787827446.932206:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272878720:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827446.932218:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827446.932225:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827446/real 1787827446]  req@ffff9ee005728f00 x1874670272878720/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827471 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827446.932234:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728f00 x1874670272878720/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827471 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827446.932240:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827446.932242:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827446.932245:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272878720:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787827446.932250:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272878848:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787827446.932263:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827446.932270:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827446/real 1787827446]  req@ffff9ee00572a1c0 x1874670272878848/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827471 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827446.932278:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a1c0 x1874670272878848/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827471 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827446.932285:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827446.932287:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827446.932289:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272878848:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787827446.932306:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272878976:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827446.932320:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827446.932368:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827446/real 1787827446]  req@ffff9ee00572a940 x1874670272878976/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827471 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827446.932383:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a940 x1874670272878976/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827471 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827446.932391:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827446.932395:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827446.932398:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272878976:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787827446.932405:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272879104:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827446.932427:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827446.932437:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827446/real 1787827446]  req@ffff9ee005728780 x1874670272879104/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827471 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827446.932445:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728780 x1874670272879104/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827471 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827446.932451:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827446.932453:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827446.932455:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272879104:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827447.763460:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827447.955452:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787827448.787477:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827448.979418:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827449.811524:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827450.003436:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827450.835519:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827451.027448:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827451.859521:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827452.051428:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:0.0:1787827452.051447:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827452.051456:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1787827452.051462:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827452.051475:0:8:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2615
00000100:00080000:0.0:1787827452.051490:0:8:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827452.051500:0:8:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787827452.051557:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9e00 x1874670272879232/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827452.051583:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827452.051587:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787827452.051589:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827452.051594:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2615
00000100:00080000:0.0:1787827452.051598:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827452.051603:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827452.051617:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787827452.051627:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272879232:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787827452.051634:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ead00 x1874670272879360/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827452.051650:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827452.051653:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787827452.051655:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827452.051657:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2615
00000100:00080000:0.0:1787827452.051661:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827452.051664:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827452.051668:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787827452.051678:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ea940 x1874670272879488/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827452.051692:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827452.051695:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787827452.051696:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827452.051699:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2615
00000100:00080000:0.0:1787827452.051702:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827452.051704:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827452.051708:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787827452.051716:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb0c0 x1874670272879616/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827452.051722:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827452.051725:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787827452.051726:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827452.051729:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2615
00000100:00080000:0.0:1787827452.051733:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827452.051737:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827452.051740:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787827452.051745:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272879360:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787827452.051751:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9a40 x1874670272879744/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827452.051760:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827452.051764:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787827452.051765:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827452.051769:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2615
00000100:00080000:0.0:1787827452.051772:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827452.051775:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787827452.051778:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272879488:192.168.203.121@tcp:8:kworker.0
00000008:00100000:0.0:1787827452.051780:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787827452.051797:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ea580 x1874670272879872/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827452.051808:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827452.051812:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787827452.051814:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827452.051818:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2615
00000100:00100000:3.0:1787827452.051818:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272879616:192.168.203.121@tcp:8:kworker.0
00000100:00080000:0.0:1787827452.051825:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827452.051829:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827452.051833:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787827452.051845:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8780 x1874670272880000/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787827452.051848:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272879744:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787827452.051879:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272879872:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787827452.051898:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272880000:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827452.883535:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827453.075413:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787827453.907518:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827454.099373:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827454.931503:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827455.123382:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000400:00000100:2.0:1787827455.123681:0:2352:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.203.121:988
00000400:00000100:2.0:1787827455.123727:0:2352:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.203.121@tcp at host 192.168.203.121 was unreachable: the network or that node may be down, or Lustre may be misconfigured.
00000800:00000100:2.0:1787827455.123745:0:2352:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:2.0:1787827455.123781:0:2352:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:2.0:1787827455.123790:0:2352:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:2.0:1787827455.123799:0:2352:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:2.0:1787827455.123808:0:2352:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:2.0:1787827455.123818:0:2352:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:2.0:1787827455.123826:0:2352:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000100:00100000:3.0:1787827455.123848:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827452/real 1787827455]  req@ffff9ee0056e8780 x1874670272880000/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827477 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827455.123874:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8780 x1874670272880000/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827477 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827455.123888:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827455.123895:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827455.123901:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272880000:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787827455.123911:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827452/real 1787827455]  req@ffff9ee0056e9a40 x1874670272879744/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827477 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827455.123926:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9a40 x1874670272879744/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827477 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827455.123936:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827455.123940:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827455.123946:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272879744:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787827455.123954:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827452/real 1787827455]  req@ffff9ee0056ea580 x1874670272879872/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827477 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827455.123968:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ea580 x1874670272879872/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827477 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827455.123984:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827455.123987:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827455.123997:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272879872:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787827455.124004:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827452/real 1787827455]  req@ffff9ee0056ead00 x1874670272879360/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827477 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827455.124017:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ead00 x1874670272879360/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827477 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827455.124025:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827455.124029:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827455.124049:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272879360:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787827455.124057:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827452/real 1787827455]  req@ffff9ee0056ea940 x1874670272879488/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827477 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827455.124071:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ea940 x1874670272879488/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827477 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827455.124079:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827455.124083:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827455.124086:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272879488:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787827455.124093:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827452/real 1787827455]  req@ffff9ee0056eb0c0 x1874670272879616/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827477 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827455.124105:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb0c0 x1874670272879616/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827477 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827455.124114:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827455.124117:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827455.124121:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272879616:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787827455.124127:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827452/real 1787827455]  req@ffff9ee0056e9e00 x1874670272879232/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827477 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827455.124138:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9e00 x1874670272879232/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827477 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827455.124145:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827455.124148:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827455.124151:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272879232:192.168.203.121@tcp:250:kworker.0
00010000:00010000:3.0:1787827455.955504:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827456.147412:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827456.979495:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827457.171424:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787827457.171458:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827457.171464:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787827457.171468:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827457.171477:0:8:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2620
00000100:00080000:3.0:1787827457.171488:0:8:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827457.171496:0:8:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787827457.171531:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705e00 x1874670272880128/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827457.171567:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827457.171572:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787827457.171574:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827457.171579:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2620
00000100:00080000:3.0:1787827457.171583:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827457.171588:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827457.171598:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787827457.171618:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707840 x1874670272880256/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827457.171632:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827457.171636:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787827457.171639:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1787827457.171642:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272880128:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787827457.171646:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2620
00000100:00080000:3.0:1787827457.171654:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827457.171659:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827457.171665:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827457.171680:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704780 x1874670272880384/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827457.171690:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827457.171694:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787827457.171696:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827457.171700:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2620
00000100:00080000:3.0:1787827457.171705:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827457.171708:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000800:00000100:1.0:1787827457.171715:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000008:00100000:3.0:1787827457.171717:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827457.171732:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705a40 x1874670272880512/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827457.171755:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827457.171759:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787827457.171761:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1787827457.171767:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827457/real 1787827457]  req@ffff9ee005705e00 x1874670272880128/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827482 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827457.171768:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2620
00000100:00080000:3.0:1787827457.171775:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827457.171785:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827457.171793:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787827457.171798:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705e00 x1874670272880128/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827482 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827457.171811:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:3.0:1787827457.171816:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057061c0 x1874670272880640/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827457.171819:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827457.171828:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272880128:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787827457.171839:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827457.171844:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787827457.171847:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827457.171852:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2620
00000100:00080000:3.0:1787827457.171857:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1787827457.171860:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272880256:192.168.203.121@tcp:38:kworker.0
00000100:00080000:3.0:1787827457.171866:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827457.171874:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827457.171888:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707480 x1874670272880768/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1787827457.171897:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787827457.171908:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827457.171912:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787827457.171914:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1787827457.171920:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827457/real 1787827457]  req@ffff9ee005707840 x1874670272880256/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827482 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827457.171922:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2620
00000100:00080000:3.0:1787827457.171930:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827457.171937:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787827457.171944:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707840 x1874670272880256/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827482 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:3.0:1787827457.171945:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:1.0:1787827457.171959:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:3.0:1787827457.171965:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704b40 x1874670272880896/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827457.171966:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827457.171974:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272880256:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787827457.171988:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272880384:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827457.172015:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827457.172050:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827457/real 1787827457]  req@ffff9ee005704780 x1874670272880384/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827482 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827457.172064:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704780 x1874670272880384/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827482 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827457.172072:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827457.172076:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827457.172079:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272880384:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827457.172085:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272880512:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827457.172107:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827457.172120:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827457/real 1787827457]  req@ffff9ee005705a40 x1874670272880512/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827482 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827457.172131:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705a40 x1874670272880512/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827482 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827457.172145:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827457.172148:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827457.172152:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272880512:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827457.172158:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272880640:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787827457.172177:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827457.172188:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827457/real 1787827457]  req@ffff9ee0057061c0 x1874670272880640/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827482 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827457.172199:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057061c0 x1874670272880640/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827482 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827457.172206:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827457.172209:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827457.172212:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272880640:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787827457.172230:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272880768:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827457.172248:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827457.172259:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827457/real 1787827457]  req@ffff9ee005707480 x1874670272880768/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827482 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827457.172270:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707480 x1874670272880768/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827482 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827457.172277:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827457.172280:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827457.172283:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272880768:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827457.172289:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272880896:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827457.172305:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827457.172343:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827457/real 1787827457]  req@ffff9ee005704b40 x1874670272880896/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827482 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827457.172366:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704b40 x1874670272880896/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827482 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827457.172374:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827457.172378:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827457.172381:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272880896:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827458.003538:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827458.195412:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787827459.027544:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827459.219389:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827460.051486:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827460.243419:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827461.075490:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827461.267389:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827462.099561:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827462.291509:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787827462.291527:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827462.291533:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787827462.291538:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827462.291549:0:8:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2626
00000100:00080000:3.0:1787827462.291562:0:8:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827462.291569:0:8:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787827462.291610:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057052c0 x1874670272881024/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827462.291640:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827462.291645:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787827462.291647:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827462.291652:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2626
00000100:00100000:1.0:1787827462.291657:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272881024:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787827462.291658:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827462.291667:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827462.291678:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787827462.291696:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057043c0 x1874670272881152/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827462.291710:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827462.291714:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787827462.291717:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827462.291723:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2626
00000100:00080000:3.0:1787827462.291729:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000800:00000100:1.0:1787827462.291732:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787827462.291741:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827462.291749:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827462.291766:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706580 x1874670272881280/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827462.291777:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1787827462.291782:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827462/real 1787827462]  req@ffff9ee0057052c0 x1874670272881024/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827487 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827462.291783:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787827462.291787:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827462.291798:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2626
00000100:00080000:3.0:1787827462.291804:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1787827462.291808:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057052c0 x1874670272881024/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827487 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827462.291819:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827462.291823:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827462.291828:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272881024:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787827462.291893:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787827462.291896:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272881152:192.168.203.121@tcp:38:kworker.0
00000008:00100000:3.0:1787827462.291903:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827462.291923:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057070c0 x1874670272881408/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1787827462.291924:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827462.291938:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827462/real 1787827462]  req@ffff9ee0057043c0 x1874670272881152/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827487 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827462.291948:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057043c0 x1874670272881152/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827487 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827462.291954:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827462.291957:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827462.291959:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272881152:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787827462.291964:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272881280:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827462.291978:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827462.292001:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827462/real 1787827462]  req@ffff9ee005706580 x1874670272881280/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827487 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827462.292010:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706580 x1874670272881280/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827487 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827462.292015:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827462.292018:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827462.292020:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272881280:192.168.203.121@tcp:8:kworker.0
00000100:00080000:3.0:1787827462.292099:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827462.292103:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787827462.292106:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827462.292112:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2626
00000100:00080000:3.0:1787827462.292118:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1787827462.292126:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272881408:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827462.292146:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827462.292157:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827462/real 1787827462]  req@ffff9ee0057070c0 x1874670272881408/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827487 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827462.292173:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057070c0 x1874670272881408/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827487 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827462.292176:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827462.292185:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00080000:1.0:1787827462.292189:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827462.292196:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827462.292201:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707c00 x1874670272881536/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787827462.292205:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272881408:192.168.203.121@tcp:8:kworker.0
00000100:00080000:3.0:1787827462.292219:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827462.292222:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787827462.292224:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1787827462.292228:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272881536:192.168.203.121@tcp:38:kworker.0
00000100:00080000:3.0:1787827462.292229:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2626
00000100:00080000:3.0:1787827462.292237:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827462.292242:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827462.292246:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1787827462.292255:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827462.292259:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704000 x1874670272881664/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827462.292268:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1787827462.292269:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827462/real 1787827462]  req@ffff9ee005707c00 x1874670272881536/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827487 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827462.292276:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787827462.292280:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827462.292286:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2626
00000100:00100000:1.0:1787827462.292291:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707c00 x1874670272881536/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827487 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827462.292291:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827462.292298:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827462.292305:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:1.0:1787827462.292307:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827462.292312:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827462.292315:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706d00 x1874670272881792/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787827462.292350:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272881536:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787827462.292369:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272881664:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827462.292396:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827462.292413:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827462/real 1787827462]  req@ffff9ee005704000 x1874670272881664/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827487 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827462.292428:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704000 x1874670272881664/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827487 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827462.292438:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827462.292442:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827462.292447:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272881664:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827462.292457:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272881792:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827462.292483:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827462.292496:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827462/real 1787827462]  req@ffff9ee005706d00 x1874670272881792/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827487 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827462.292509:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706d00 x1874670272881792/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827487 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827462.292517:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827462.292520:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827462.292523:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272881792:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827463.123484:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827463.315407:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787827464.147500:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827464.339390:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827465.171558:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827465.363453:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827466.195482:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827466.387480:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827467.219462:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1787827467.411434:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827467.411442:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1787827467.411447:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827467.411458:0:8:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2631
00000100:00100000:2.0:1787827467.411460:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:0.0:1787827467.411468:0:8:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827467.411476:0:8:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787827467.411509:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb480 x1874670272881920/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827467.411532:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827467.411535:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787827467.411536:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827467.411539:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2631
00000100:00080000:0.0:1787827467.411541:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827467.411544:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827467.411551:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787827467.411559:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8b40 x1874670272882048/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827467.411568:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827467.411571:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00100000:1.0:1787827467.411571:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272881920:192.168.203.121@tcp:250:kworker.0
00000100:00080000:0.0:1787827467.411573:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827467.411581:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2631
00000100:00080000:0.0:1787827467.411584:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827467.411586:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827467.411589:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787827467.411598:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9680 x1874670272882176/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827467.411605:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827467.411607:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787827467.411608:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827467.411612:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2631
00000100:00080000:0.0:1787827467.411623:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827467.411625:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827467.411629:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1787827467.411633:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827467.411638:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e92c0 x1874670272882304/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827467.411646:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827467.411648:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787827467.411649:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827467.411652:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2631
00000100:00080000:0.0:1787827467.411654:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827467.411656:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827467.411659:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787827467.411668:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb840 x1874670272882432/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787827467.411671:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827467/real 1787827467]  req@ffff9ee0056eb480 x1874670272881920/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827492 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827467.411690:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827467.411693:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787827467.411695:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827467.411699:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2631
00000100:00100000:1.0:1787827467.411699:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb480 x1874670272881920/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827492 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827467.411704:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827467.411711:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827467.411718:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:1.0:1787827467.411720:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:0.0:1787827467.411725:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8000 x1874670272882560/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827467.411726:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827467.411736:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272881920:192.168.203.121@tcp:250:kworker.0
00000100:00080000:0.0:1787827467.411739:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827467.411745:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787827467.411747:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827467.411750:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2631
00000100:00080000:0.0:1787827467.411752:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827467.411754:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827467.411758:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787827467.411764:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e83c0 x1874670272882688/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787827467.411771:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272882048:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787827467.411807:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827467.411818:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827467/real 1787827467]  req@ffff9ee0056e8b40 x1874670272882048/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827492 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827467.411827:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8b40 x1874670272882048/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827492 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827467.411833:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827467.411836:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827467.411838:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272882048:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787827467.411842:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272882176:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827467.411855:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827467.411861:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827467/real 1787827467]  req@ffff9ee0056e9680 x1874670272882176/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827492 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827467.411868:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9680 x1874670272882176/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827492 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827467.411873:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827467.411875:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827467.411877:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272882176:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827467.411881:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272882304:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827467.411890:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827467.411895:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827467/real 1787827467]  req@ffff9ee0056e92c0 x1874670272882304/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827492 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827467.411902:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e92c0 x1874670272882304/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827492 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827467.411907:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827467.411909:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827467.411911:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272882304:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827467.411914:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272882432:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787827467.411923:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827467.411929:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827467/real 1787827467]  req@ffff9ee0056eb840 x1874670272882432/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827492 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827467.411935:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb840 x1874670272882432/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827492 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827467.411940:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827467.411942:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827467.411944:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272882432:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787827467.411961:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272882560:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827467.411974:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827467.411981:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827467/real 1787827467]  req@ffff9ee0056e8000 x1874670272882560/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827492 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827467.411989:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8000 x1874670272882560/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827492 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827467.411994:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827467.411996:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827467.411999:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272882560:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827467.412011:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272882688:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827467.412021:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827467.412027:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827467/real 1787827467]  req@ffff9ee0056e83c0 x1874670272882688/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827492 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827467.412034:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e83c0 x1874670272882688/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827492 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827467.412039:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827467.412040:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827467.412042:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272882688:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827468.243536:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827468.435455:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787827469.267486:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827469.459468:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827470.291503:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827470.483423:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827471.315506:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827471.507476:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827472.339513:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1787827472.531415:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1787827472.531415:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:0.0:1787827472.531427:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1787827472.531433:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827472.531445:0:8:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2636
00000100:00080000:0.0:1787827472.531461:0:8:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827472.531470:0:8:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787827472.531518:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8f00 x1874670272882816/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827472.531551:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827472.531555:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787827472.531557:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827472.531561:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2636
00000100:00080000:0.0:1787827472.531565:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827472.531571:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827472.531590:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787827472.531609:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ebc00 x1874670272882944/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787827472.531626:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272882816:192.168.203.121@tcp:250:kworker.0
00000100:00080000:0.0:1787827472.531629:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827472.531640:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787827472.531643:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827472.531649:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2636
00000100:00080000:0.0:1787827472.531655:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827472.531662:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827472.531668:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787827472.531687:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e83c0 x1874670272883072/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1787827472.531699:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:0.0:1787827472.531701:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827472.531707:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787827472.531711:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827472.531719:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2636
00000100:00080000:0.0:1787827472.531726:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827472.531732:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827472.531739:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787827472.531745:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827472/real 1787827472]  req@ffff9ee0056e8f00 x1874670272882816/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827497 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827472.531758:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8000 x1874670272883200/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787827472.531762:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8f00 x1874670272882816/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827497 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827472.531810:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827472.531814:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787827472.531817:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827472.531817:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827472.531833:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2636
00000100:00080000:1.0:1787827472.531835:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:0.0:1787827472.531839:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1787827472.531846:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272882816:192.168.203.121@tcp:250:kworker.0
00000100:00080000:0.0:1787827472.531851:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827472.531859:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787827472.531874:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb840 x1874670272883328/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787827472.531883:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272882944:192.168.203.121@tcp:38:kworker.0
00000100:00080000:0.0:1787827472.531893:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827472.531899:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787827472.531902:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827472.531908:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2636
00000100:00080000:0.0:1787827472.531930:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000800:00000100:1.0:1787827472.531937:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:0.0:1787827472.531939:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827472.531950:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787827472.531967:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827472/real 1787827472]  req@ffff9ee0056ebc00 x1874670272882944/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827497 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827472.531969:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e92c0 x1874670272883456/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827472.532012:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827472.532020:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787827472.532023:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827472.532030:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2636
00000100:00100000:1.0:1787827472.532031:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ebc00 x1874670272882944/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827497 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827472.532036:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827472.532049:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00080000:1.0:1787827472.532056:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000008:00100000:0.0:1787827472.532059:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:1.0:1787827472.532063:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827472.532073:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272882944:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787827472.532083:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272883072:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787827472.532084:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9680 x1874670272883584/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1787827472.532114:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827472.532126:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827472/real 1787827472]  req@ffff9ee0056e83c0 x1874670272883072/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827497 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827472.532135:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e83c0 x1874670272883072/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827497 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827472.532141:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827472.532143:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827472.532145:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272883072:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827472.532149:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272883200:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827472.532160:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827472.532166:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827472/real 1787827472]  req@ffff9ee0056e8000 x1874670272883200/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827497 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827472.532173:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8000 x1874670272883200/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827497 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827472.532179:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827472.532181:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827472.532183:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272883200:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827472.532197:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272883328:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787827472.532207:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827472.532213:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827472/real 1787827472]  req@ffff9ee0056eb840 x1874670272883328/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827497 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827472.532220:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb840 x1874670272883328/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827497 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827472.532225:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827472.532228:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827472.532229:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272883328:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787827472.532233:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272883456:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827472.532243:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827472.532248:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827472/real 1787827472]  req@ffff9ee0056e92c0 x1874670272883456/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827497 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827472.532255:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e92c0 x1874670272883456/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827497 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827472.532260:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827472.532262:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827472.532265:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272883456:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827472.532268:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272883584:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827472.532277:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827472.532283:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827472/real 1787827472]  req@ffff9ee0056e9680 x1874670272883584/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827497 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827472.532289:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9680 x1874670272883584/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827497 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827472.532303:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827472.532305:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827472.532312:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272883584:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827473.363526:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827473.555461:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787827474.387502:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827474.579447:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827475.411467:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827475.603368:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827476.435492:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827476.627412:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827477.459451:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1787827477.651447:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1787827477.651449:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787827477.651459:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787827477.651464:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827477.651475:0:8:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2641
00000100:00080000:3.0:1787827477.651488:0:8:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827477.651497:0:8:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787827477.651541:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705680 x1874670272883712/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827477.651570:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827477.651573:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787827477.651575:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827477.651578:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2641
00000100:00080000:3.0:1787827477.651581:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827477.651584:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827477.651594:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787827477.651603:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706940 x1874670272883840/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827477.651611:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827477.651613:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787827477.651615:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827477.651618:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2641
00000100:00080000:3.0:1787827477.651620:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827477.651623:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827477.651627:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787827477.651628:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272883712:192.168.203.121@tcp:250:kworker.0
00000100:00100000:3.0:1787827477.651639:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706d00 x1874670272883968/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827477.651646:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827477.651648:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787827477.651650:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827477.651652:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2641
00000100:00080000:3.0:1787827477.651654:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827477.651657:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827477.651660:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827477.651666:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704000 x1874670272884096/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827477.651686:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827477.651688:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787827477.651690:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827477.651693:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2641
00000100:00080000:3.0:1787827477.651696:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827477.651699:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827477.651702:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000800:00000100:1.0:1787827477.651708:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827477.651711:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707c00 x1874670272884224/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827477.651719:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827477.651723:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787827477.651724:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827477.651727:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2641
00000100:00080000:3.0:1787827477.651730:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827477.651732:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827477.651735:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827477.651742:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057070c0 x1874670272884352/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827477.651749:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827477.651754:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:1.0:1787827477.651755:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827477/real 1787827477]  req@ffff9ee005705680 x1874670272883712/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827502 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827477.651756:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827477.651762:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2641
00000100:00080000:3.0:1787827477.651768:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827477.651773:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827477.651778:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787827477.651783:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705680 x1874670272883712/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827502 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827477.651787:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706580 x1874670272884480/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827477.651804:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827477.651810:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827477.651814:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272883712:192.168.203.121@tcp:250:kworker.0
00000100:00100000:1.0:1787827477.651820:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272883840:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787827477.651838:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827477.651847:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827477/real 1787827477]  req@ffff9ee005706940 x1874670272883840/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827502 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827477.651856:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706940 x1874670272883840/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827502 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827477.651861:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827477.651864:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827477.651867:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272883840:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787827477.651905:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272883968:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827477.651936:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827477.651947:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827477/real 1787827477]  req@ffff9ee005706d00 x1874670272883968/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827502 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827477.651960:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706d00 x1874670272883968/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827502 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827477.651969:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827477.651973:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827477.651977:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272883968:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827477.651984:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272884096:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827477.652012:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827477.652025:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827477/real 1787827477]  req@ffff9ee005704000 x1874670272884096/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827502 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827477.652038:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704000 x1874670272884096/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827502 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827477.652046:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827477.652048:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827477.652051:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272884096:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827477.652055:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272884224:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787827477.652071:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827477.652078:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827477/real 1787827477]  req@ffff9ee005707c00 x1874670272884224/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827502 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827477.652097:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707c00 x1874670272884224/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827502 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827477.652102:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827477.652104:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827477.652106:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272884224:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787827477.652110:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272884352:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827477.652120:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827477.652126:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827477/real 1787827477]  req@ffff9ee0057070c0 x1874670272884352/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827502 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827477.652133:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057070c0 x1874670272884352/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827502 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827477.652138:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827477.652140:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827477.652143:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272884352:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827477.652146:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272884480:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827477.652164:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827477.652170:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827477/real 1787827477]  req@ffff9ee005706580 x1874670272884480/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827502 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827477.652176:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706580 x1874670272884480/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827502 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827477.652181:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827477.652183:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827477.652185:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272884480:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827478.483502:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827478.675420:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787827479.507466:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827479.699457:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827480.531522:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827480.723415:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827481.555528:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827481.747443:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827482.579582:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827482.771374:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787827482.771405:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827482.771411:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787827482.771417:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827482.771429:0:8:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2646
00000100:00080000:3.0:1787827482.771441:0:8:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827482.771449:0:8:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787827482.771522:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057043c0 x1874670272884608/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827482.771556:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827482.771559:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787827482.771561:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827482.771564:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2646
00000100:00080000:3.0:1787827482.771568:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827482.771571:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827482.771582:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787827482.771594:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057052c0 x1874670272884736/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827482.771606:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827482.771609:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787827482.771611:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827482.771617:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2646
00000100:00080000:3.0:1787827482.771630:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1787827482.771633:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272884608:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787827482.771633:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827482.771640:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827482.771650:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704b40 x1874670272884864/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827482.771656:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827482.771659:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787827482.771661:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827482.771663:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2646
00000100:00080000:3.0:1787827482.771666:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827482.771669:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827482.771672:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827482.771680:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707480 x1874670272884992/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827482.771696:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827482.771698:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787827482.771700:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827482.771703:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2646
00000100:00080000:3.0:1787827482.771707:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827482.771710:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827482.771714:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787827482.771722:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057061c0 x1874670272885120/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1787827482.771728:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787827482.771737:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827482.771740:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787827482.771742:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827482.771747:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2646
00000100:00080000:3.0:1787827482.771751:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827482.771754:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827482.771757:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827482.771765:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705a40 x1874670272885248/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827482.771771:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827482.771773:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787827482.771775:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827482.771778:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2646
00000100:00080000:3.0:1787827482.771781:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827482.771784:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827482.771787:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787827482.771789:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827482/real 1787827482]  req@ffff9ee0057043c0 x1874670272884608/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827507 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827482.771799:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704780 x1874670272885376/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787827482.771814:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057043c0 x1874670272884608/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827507 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827482.771837:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827482.771856:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827482.771861:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272884608:192.168.203.121@tcp:250:kworker.0
00000100:00100000:1.0:1787827482.771890:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272884736:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787827482.771912:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827482.771931:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827482/real 1787827482]  req@ffff9ee0057052c0 x1874670272884736/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827507 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827482.771941:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057052c0 x1874670272884736/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827507 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827482.771948:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827482.771950:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827482.771953:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272884736:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787827482.771957:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272884864:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827482.771972:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827482.771980:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827482/real 1787827482]  req@ffff9ee005704b40 x1874670272884864/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827507 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827482.771988:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704b40 x1874670272884864/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827507 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827482.771994:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827482.771996:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827482.771998:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272884864:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827482.772002:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272884992:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827482.772013:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827482.772019:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827482/real 1787827482]  req@ffff9ee005707480 x1874670272884992/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827507 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827482.772027:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707480 x1874670272884992/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827507 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827482.772034:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827482.772036:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827482.772039:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272884992:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827482.772042:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272885120:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787827482.772052:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827482.772065:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827482/real 1787827482]  req@ffff9ee0057061c0 x1874670272885120/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827507 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827482.772072:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057061c0 x1874670272885120/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827507 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827482.772078:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827482.772081:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827482.772083:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272885120:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787827482.772087:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272885248:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827482.772098:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827482.772104:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827482/real 1787827482]  req@ffff9ee005705a40 x1874670272885248/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827507 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827482.772111:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705a40 x1874670272885248/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827507 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827482.772117:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827482.772119:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827482.772121:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272885248:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827482.772125:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272885376:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827482.772135:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827482.772141:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827482/real 1787827482]  req@ffff9ee005704780 x1874670272885376/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827507 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827482.772148:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704780 x1874670272885376/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827507 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827482.772153:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827482.772155:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827482.772157:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272885376:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827483.603537:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827483.795434:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787827484.627458:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827484.819380:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827485.651481:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827485.843411:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827486.675596:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827486.867424:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827487.699568:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1787827487.891378:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827487.891386:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787827487.891391:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827487.891416:0:8:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2651
00000100:00080000:3.0:1787827487.891427:0:8:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827487.891435:0:8:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787827487.891472:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707840 x1874670272885504/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787827487.891511:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787827487.891513:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827487.891526:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787827487.891529:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827487.891542:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2651
00000100:00080000:3.0:1787827487.891547:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827487.891550:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827487.891559:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787827487.891571:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705e00 x1874670272885632/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827487.891581:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827487.891585:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787827487.891587:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827487.891590:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2651
00000100:00080000:3.0:1787827487.891593:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827487.891596:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787827487.891606:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272885504:192.168.203.121@tcp:250:kworker.0
00000008:00100000:3.0:1787827487.891606:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827487.891623:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704780 x1874670272885760/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827487.891632:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827487.891634:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787827487.891635:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827487.891638:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2651
00000100:00080000:3.0:1787827487.891639:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827487.891641:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827487.891646:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827487.891657:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705a40 x1874670272885888/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827487.891673:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827487.891676:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787827487.891677:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827487.891680:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2651
00000100:00080000:3.0:1787827487.891682:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827487.891684:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827487.891687:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787827487.891694:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057061c0 x1874670272886016/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827487.891701:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827487.891703:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787827487.891705:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827487.891707:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2651
00000100:00080000:3.0:1787827487.891709:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827487.891711:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827487.891714:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827487.891722:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707480 x1874670272886144/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827487.891728:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827487.891731:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787827487.891733:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:1.0:1787827487.891742:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787827487.891743:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2651
00000100:00080000:3.0:1787827487.891755:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827487.891758:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827487.891762:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827487.891771:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704b40 x1874670272886272/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787827487.891872:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827487/real 1787827487]  req@ffff9ee005707840 x1874670272885504/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827512 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827487.891929:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707840 x1874670272885504/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827512 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827487.891951:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827487.891958:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827487.891966:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272885504:192.168.203.121@tcp:250:kworker.0
00000100:00100000:1.0:1787827487.892007:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272885632:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787827487.892042:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827487.892076:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827487/real 1787827487]  req@ffff9ee005705e00 x1874670272885632/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827512 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827487.892092:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705e00 x1874670272885632/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827512 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827487.892103:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827487.892108:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827487.892113:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272885632:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787827487.892146:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272885760:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827487.892174:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827487.892189:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827487/real 1787827487]  req@ffff9ee005704780 x1874670272885760/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827512 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827487.892205:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704780 x1874670272885760/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827512 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827487.892216:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827487.892220:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827487.892224:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272885760:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827487.892233:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272885888:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827487.892267:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827487.892281:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827487/real 1787827487]  req@ffff9ee005705a40 x1874670272885888/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827512 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827487.892296:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705a40 x1874670272885888/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827512 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827487.892308:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827487.892312:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827487.892357:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272885888:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827487.892366:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272886016:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787827487.892390:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827487.892404:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827487/real 1787827487]  req@ffff9ee0057061c0 x1874670272886016/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827512 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827487.892420:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057061c0 x1874670272886016/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827512 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827487.892430:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827487.892435:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827487.892439:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272886016:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787827487.892448:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272886144:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827487.892471:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827487.892484:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827487/real 1787827487]  req@ffff9ee005707480 x1874670272886144/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827512 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827487.892498:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707480 x1874670272886144/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827512 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827487.892508:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827487.892512:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827487.892517:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272886144:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827487.892524:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272886272:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827487.892546:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827487.892558:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827487/real 1787827487]  req@ffff9ee005704b40 x1874670272886272/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827512 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827487.892573:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704b40 x1874670272886272/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827512 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827487.892583:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827487.892587:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827487.892592:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272886272:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827488.723532:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827488.915396:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787827489.747539:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827489.939549:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827490.771499:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827490.963448:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827491.795587:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827491.987400:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827492.819649:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827493.011478:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:1.0:1787827493.011490:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827493.011502:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1787827493.011507:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827493.011518:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2656
00000100:00080000:1.0:1787827493.011531:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827493.011541:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787827493.011577:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a21c0 x1874670272886400/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827493.011607:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827493.011611:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787827493.011613:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827493.011616:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2656
00000100:00080000:1.0:1787827493.011619:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827493.011623:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827493.011632:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787827493.011648:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0f00 x1874670272886528/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827493.011660:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827493.011664:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787827493.011667:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827493.011676:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2656
00000100:00100000:2.0:1787827493.011679:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272886400:192.168.203.121@tcp:250:kworker.0
00000100:00080000:1.0:1787827493.011681:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827493.011700:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827493.011706:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787827493.011719:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1680 x1874670272886656/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827493.011730:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827493.011733:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787827493.011734:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827493.011739:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2656
00000100:00080000:1.0:1787827493.011741:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827493.011744:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827493.011747:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787827493.011760:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a2940 x1874670272886784/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827493.011780:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827493.011784:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787827493.011786:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827493.011789:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2656
00000100:00080000:1.0:1787827493.011793:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827493.011797:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827493.011802:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787827493.011811:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a3c00 x1874670272886912/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827493.011822:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827493.011825:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787827493.011826:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827493.011829:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2656
00000100:00080000:1.0:1787827493.011832:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827493.011835:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827493.011838:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:2.0:1787827493.011849:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827493.011850:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1a40 x1874670272887040/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827493.011867:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827493.011870:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787827493.011873:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827493.011878:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2656
00000100:00080000:1.0:1787827493.011880:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827493.011884:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827493.011890:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787827493.011898:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a12c0 x1874670272887168/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787827493.011977:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827493/real 1787827493]  req@ffff9ee0056a21c0 x1874670272886400/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827518 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827493.012008:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a21c0 x1874670272886400/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827518 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827493.012025:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827493.012032:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827493.012037:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272886400:192.168.203.121@tcp:250:kworker.0
00000100:00100000:2.0:1787827493.012076:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272886528:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787827493.012115:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827493.012133:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827493/real 1787827493]  req@ffff9ee0056a0f00 x1874670272886528/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827518 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827493.012149:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0f00 x1874670272886528/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827518 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827493.012160:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827493.012164:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827493.012169:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272886528:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787827493.012189:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272886656:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787827493.012214:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827493.012227:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827493/real 1787827493]  req@ffff9ee0056a1680 x1874670272886656/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827518 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827493.012243:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1680 x1874670272886656/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827518 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827493.012254:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827493.012258:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827493.012262:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272886656:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787827493.012269:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272886784:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787827493.012289:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827493.012299:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827493/real 1787827493]  req@ffff9ee0056a2940 x1874670272886784/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827518 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827493.012314:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a2940 x1874670272886784/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827518 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827493.012358:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827493.012363:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827493.012368:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272886784:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787827493.012376:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272886912:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787827493.012400:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827493.012413:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827493/real 1787827493]  req@ffff9ee0056a3c00 x1874670272886912/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827518 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827493.012428:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a3c00 x1874670272886912/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827518 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827493.012446:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827493.012450:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827493.012454:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272886912:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787827493.012462:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272887040:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787827493.012481:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827493.012492:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827493/real 1787827493]  req@ffff9ee0056a1a40 x1874670272887040/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827518 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827493.012506:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1a40 x1874670272887040/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827518 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827493.012515:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827493.012518:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827493.012522:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272887040:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787827493.012529:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272887168:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787827493.012549:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827493.012559:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827493/real 1787827493]  req@ffff9ee0056a12c0 x1874670272887168/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827518 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827493.012573:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a12c0 x1874670272887168/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827518 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827493.012582:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827493.012586:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827493.012591:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272887168:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827493.843544:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827494.035407:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787827494.867591:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827495.059468:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827495.891476:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827496.083412:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827496.915786:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827497.107539:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827497.939590:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1787827498.131474:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1787827498.131475:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:0.0:1787827498.131492:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1787827498.131498:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827498.131509:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2661
00000100:00080000:0.0:1787827498.131518:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827498.131527:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787827498.131575:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8b40 x1874670272887296/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827498.131604:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827498.131607:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787827498.131609:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827498.131612:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2661
00000100:00080000:0.0:1787827498.131615:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827498.131618:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827498.131639:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787827498.131658:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb480 x1874670272887424/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827498.131676:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827498.131682:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787827498.131685:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827498.131705:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2661
00000100:00100000:2.0:1787827498.131707:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272887296:192.168.203.121@tcp:250:kworker.0
00000100:00080000:0.0:1787827498.131713:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827498.131724:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827498.131744:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787827498.131766:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9e00 x1874670272887552/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827498.131788:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827498.131792:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787827498.131795:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827498.131801:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2661
00000100:00080000:0.0:1787827498.131809:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827498.131815:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827498.131821:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787827498.131833:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb0c0 x1874670272887680/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827498.131843:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827498.131846:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787827498.131848:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827498.131858:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2661
00000800:00000100:2.0:1787827498.131861:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:0.0:1787827498.131866:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827498.131875:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827498.131892:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787827498.131904:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ea940 x1874670272887808/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827498.131912:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827498.131916:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787827498.131919:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827498.131922:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2661
00000100:00080000:0.0:1787827498.131925:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827498.131927:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827498.131931:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787827498.131943:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ead00 x1874670272887936/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827498.131953:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827498.131955:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787827498.131956:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827498.131970:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2661
00000100:00080000:0.0:1787827498.131972:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827498.131975:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827498.131980:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787827498.131989:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827498/real 1787827498]  req@ffff9ee0056e8b40 x1874670272887296/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827523 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827498.131995:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ea580 x1874670272888064/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787827498.132069:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8b40 x1874670272887296/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827523 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827498.132085:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827498.132122:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827498.132130:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272887296:192.168.203.121@tcp:250:kworker.0
00000100:00100000:2.0:1787827498.132194:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272887424:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787827498.132255:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827498.132274:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827498/real 1787827498]  req@ffff9ee0056eb480 x1874670272887424/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827523 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827498.132290:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb480 x1874670272887424/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827523 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827498.132300:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827498.132305:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827498.132309:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272887424:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787827498.132317:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272887552:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787827498.132397:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827498.132442:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827498/real 1787827498]  req@ffff9ee0056e9e00 x1874670272887552/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827523 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827498.132460:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9e00 x1874670272887552/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827523 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827498.132468:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827498.132472:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827498.132492:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272887552:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787827498.132500:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272887680:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787827498.132526:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827498.132537:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827498/real 1787827498]  req@ffff9ee0056eb0c0 x1874670272887680/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827523 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827498.132595:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb0c0 x1874670272887680/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827523 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827498.132606:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827498.132611:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827498.132617:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272887680:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787827498.132626:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272887808:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787827498.132678:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827498.132695:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827498/real 1787827498]  req@ffff9ee0056ea940 x1874670272887808/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827523 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827498.132709:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ea940 x1874670272887808/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827523 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827498.132718:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827498.132721:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827498.132725:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272887808:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787827498.132757:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272887936:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787827498.132802:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827498.132813:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827498/real 1787827498]  req@ffff9ee0056ead00 x1874670272887936/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827523 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827498.132825:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ead00 x1874670272887936/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827523 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827498.132835:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827498.132841:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827498.132846:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272887936:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787827498.132856:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272888064:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787827498.132904:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827498.132927:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827498/real 1787827498]  req@ffff9ee0056ea580 x1874670272888064/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827523 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827498.132982:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ea580 x1874670272888064/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827523 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827498.132992:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827498.132997:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827498.133001:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272888064:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827498.963520:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827499.155426:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787827499.987542:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827500.179481:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827501.011528:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827501.203506:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827502.035462:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827502.227438:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827503.059518:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1787827503.251434:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827503.251442:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1787827503.251447:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1787827503.251458:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:1.0:1787827503.251459:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2666
00000100:00080000:1.0:1787827503.251471:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827503.251478:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787827503.251510:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a3480 x1874670272888192/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827503.251538:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827503.251541:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787827503.251542:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827503.251545:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2666
00000100:00080000:1.0:1787827503.251548:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827503.251552:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827503.251560:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787827503.251569:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0b40 x1874670272888320/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827503.251578:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1787827503.251582:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272888192:192.168.203.121@tcp:250:kworker.0
00000100:00080000:1.0:1787827503.251584:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787827503.251592:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827503.251600:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2666
00000100:00080000:1.0:1787827503.251603:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827503.251605:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827503.251608:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787827503.251617:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a2580 x1874670272888448/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827503.251624:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827503.251626:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787827503.251627:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827503.251631:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2666
00000100:00080000:1.0:1787827503.251634:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827503.251636:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827503.251640:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787827503.251649:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a03c0 x1874670272888576/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827503.251655:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827503.251657:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787827503.251658:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827503.251661:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2666
00000100:00080000:1.0:1787827503.251672:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827503.251675:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827503.251678:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000800:00000100:2.0:1787827503.251685:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827503.251687:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1e00 x1874670272888704/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827503.251716:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827503.251718:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787827503.251720:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827503.251724:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2666
00000100:00080000:1.0:1787827503.251734:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827503.251737:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827503.251741:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787827503.251756:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0000 x1874670272888832/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787827503.251763:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827503/real 1787827503]  req@ffff9ee0056a3480 x1874670272888192/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827528 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827503.251785:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827503.251790:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787827503.251793:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1787827503.251795:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a3480 x1874670272888192/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827528 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827503.251802:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2666
00000100:00080000:1.0:1787827503.251816:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827503.251820:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827503.251823:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00080000:2.0:1787827503.251830:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000008:00100000:1.0:1787827503.251835:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787827503.251835:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272888192:192.168.203.121@tcp:250:kworker.0
00000100:00100000:1.0:1787827503.251873:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0780 x1874670272888960/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787827503.251874:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272888320:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787827503.251910:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827503.251924:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827503/real 1787827503]  req@ffff9ee0056a0b40 x1874670272888320/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827528 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827503.251934:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0b40 x1874670272888320/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827528 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827503.251940:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827503.251942:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827503.251945:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272888320:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787827503.251949:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272888448:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787827503.251961:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827503.251967:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827503/real 1787827503]  req@ffff9ee0056a2580 x1874670272888448/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827528 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827503.251975:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a2580 x1874670272888448/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827528 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827503.251980:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827503.251982:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827503.251984:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272888448:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787827503.251988:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272888576:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787827503.251998:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827503.252003:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827503/real 1787827503]  req@ffff9ee0056a03c0 x1874670272888576/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827528 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827503.252011:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a03c0 x1874670272888576/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827528 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827503.252017:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827503.252019:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827503.252021:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272888576:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787827503.252025:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272888704:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787827503.252036:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827503.252042:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827503/real 1787827503]  req@ffff9ee0056a1e00 x1874670272888704/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827528 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827503.252051:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1e00 x1874670272888704/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827528 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827503.252059:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827503.252063:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827503.252067:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272888704:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787827503.252074:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272888832:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787827503.252096:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827503.252109:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827503/real 1787827503]  req@ffff9ee0056a0000 x1874670272888832/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827528 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827503.252122:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0000 x1874670272888832/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827528 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827503.252128:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827503.252130:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827503.252133:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272888832:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787827503.252151:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272888960:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787827503.252172:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827503.252184:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827503/real 1787827503]  req@ffff9ee0056a0780 x1874670272888960/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827528 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827503.252196:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0780 x1874670272888960/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827528 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827503.252204:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827503.252207:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827503.252210:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272888960:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827504.083496:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827504.275465:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787827505.107464:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827505.299461:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827506.131517:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827506.323436:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827507.155494:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827507.347431:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827508.179469:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1787827508.371432:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1787827508.371442:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:1.0:1787827508.371444:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1787827508.371450:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827508.371463:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2672
00000100:00080000:1.0:1787827508.371475:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827508.371484:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787827508.371521:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a30c0 x1874670272889088/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827508.371551:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827508.371555:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787827508.371557:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827508.371563:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2672
00000100:00080000:1.0:1787827508.371568:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827508.371574:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827508.371584:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787827508.371587:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272889088:192.168.203.121@tcp:250:kworker.0
00000100:00100000:1.0:1787827508.371606:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0780 x1874670272889216/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827508.371622:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827508.371626:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787827508.371628:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827508.371632:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2672
00000100:00080000:1.0:1787827508.371636:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827508.371639:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827508.371645:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787827508.371658:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0000 x1874670272889344/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827508.371680:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827508.371684:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787827508.371685:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827508.371688:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2672
00000100:00080000:1.0:1787827508.371691:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827508.371694:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827508.371700:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:2.0:1787827508.371701:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827508.371720:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1e00 x1874670272889472/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827508.371731:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827508.371734:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787827508.371735:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827508.371738:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2672
00000100:00080000:1.0:1787827508.371740:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827508.371743:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827508.371746:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787827508.371757:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a03c0 x1874670272889600/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827508.371763:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827508.371766:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787827508.371768:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827508.371776:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2672
00000100:00100000:2.0:1787827508.371777:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827508/real 1787827508]  req@ffff9ee0056a30c0 x1874670272889088/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827533 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827508.371782:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827508.371794:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827508.371806:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787827508.371816:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a30c0 x1874670272889088/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827533 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827508.371817:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a2580 x1874670272889728/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827508.371886:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827508.371886:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827508.371902:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787827508.371905:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827508.371906:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:1.0:1787827508.371917:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2672
00000100:00100000:2.0:1787827508.371924:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272889088:192.168.203.121@tcp:250:kworker.0
00000100:00080000:1.0:1787827508.371926:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827508.371940:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827508.371944:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787827508.371954:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0b40 x1874670272889856/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787827508.371967:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272889216:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787827508.371993:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827508.372004:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827508/real 1787827508]  req@ffff9ee0056a0780 x1874670272889216/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827533 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827508.372013:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0780 x1874670272889216/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827533 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827508.372019:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827508.372022:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827508.372025:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272889216:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787827508.372028:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272889344:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787827508.372040:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827508.372046:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827508/real 1787827508]  req@ffff9ee0056a0000 x1874670272889344/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827533 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827508.372054:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0000 x1874670272889344/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827533 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827508.372059:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827508.372061:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827508.372063:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272889344:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787827508.372067:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272889472:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787827508.372077:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827508.372083:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827508/real 1787827508]  req@ffff9ee0056a1e00 x1874670272889472/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827533 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827508.372091:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1e00 x1874670272889472/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827533 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827508.372096:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827508.372098:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827508.372100:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272889472:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787827508.372103:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272889600:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787827508.372113:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827508.372119:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827508/real 1787827508]  req@ffff9ee0056a03c0 x1874670272889600/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827533 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827508.372125:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a03c0 x1874670272889600/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827533 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827508.372130:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827508.372132:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827508.372135:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272889600:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787827508.372138:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272889728:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787827508.372148:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827508.372154:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827508/real 1787827508]  req@ffff9ee0056a2580 x1874670272889728/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827533 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827508.372166:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a2580 x1874670272889728/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827533 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827508.372171:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827508.372173:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827508.372175:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272889728:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787827508.372198:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272889856:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787827508.372210:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827508.372216:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827508/real 1787827508]  req@ffff9ee0056a0b40 x1874670272889856/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827533 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827508.372223:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0b40 x1874670272889856/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827533 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827508.372228:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827508.372231:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827508.372233:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272889856:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827509.203541:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827509.395449:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787827510.227537:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827510.419454:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827511.251513:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827511.443442:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827512.275497:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827512.467435:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827513.299685:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827513.491427:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:0.0:1787827513.491443:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827513.491454:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1787827513.491460:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827513.491472:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2677
00000100:00080000:0.0:1787827513.491496:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827513.491503:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787827513.491541:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9a40 x1874670272889984/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827513.491581:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827513.491585:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787827513.491587:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827513.491592:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2677
00000100:00080000:0.0:1787827513.491596:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827513.491603:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827513.491615:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787827513.491654:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8780 x1874670272890112/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787827513.491656:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272889984:192.168.203.121@tcp:250:kworker.0
00000100:00080000:0.0:1787827513.491695:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827513.491699:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787827513.491701:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827513.491708:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2677
00000100:00080000:0.0:1787827513.491713:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827513.491717:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827513.491723:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787827513.491741:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ea580 x1874670272890240/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827513.491762:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827513.491765:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787827513.491768:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827513.491773:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2677
00000100:00080000:0.0:1787827513.491779:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827513.491785:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827513.491793:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:2.0:1787827513.491806:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827513.491815:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ead00 x1874670272890368/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827513.491837:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827513.491842:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787827513.491845:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827513.491850:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2677
00000100:00080000:0.0:1787827513.491856:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827513.491862:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787827513.491868:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827513/real 1787827513]  req@ffff9ee0056e9a40 x1874670272889984/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827538 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:0.0:1787827513.491877:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787827513.491895:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9a40 x1874670272889984/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827538 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827513.491897:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ea940 x1874670272890496/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827513.491949:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827513.491954:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787827513.491958:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827513.491959:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827513.491973:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:0.0:1787827513.491978:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2677
00000100:00100000:2.0:1787827513.491984:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272889984:192.168.203.121@tcp:250:kworker.0
00000100:00080000:0.0:1787827513.491989:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827513.491999:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827513.492008:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787827513.492018:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272890112:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787827513.492032:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb0c0 x1874670272890624/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1787827513.492048:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:0.0:1787827513.492060:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827513.492067:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:2.0:1787827513.492069:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827513/real 1787827513]  req@ffff9ee0056e8780 x1874670272890112/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827538 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827513.492074:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827513.492096:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2677
00000100:00100000:2.0:1787827513.492097:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8780 x1874670272890112/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827538 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827513.492114:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827513.492116:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827513.492133:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827513.492137:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272890112:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787827513.492143:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272890240:192.168.203.121@tcp:8:kworker.0
00000100:00080000:0.0:1787827513.492156:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000800:00000100:2.0:1787827513.492163:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000008:00100000:0.0:1787827513.492165:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787827513.492204:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9e00 x1874670272890752/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787827513.492206:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827513/real 1787827513]  req@ffff9ee0056ea580 x1874670272890240/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827538 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827513.492248:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ea580 x1874670272890240/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827538 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827513.492298:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827513.492305:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827513.492313:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272890240:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787827513.492326:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272890368:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787827513.492352:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827513.492363:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827513/real 1787827513]  req@ffff9ee0056ead00 x1874670272890368/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827538 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827513.492412:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ead00 x1874670272890368/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827538 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827513.492419:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827513.492422:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827513.492425:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272890368:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787827513.492431:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272890496:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787827513.492459:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827513.492468:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827513/real 1787827513]  req@ffff9ee0056ea940 x1874670272890496/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827538 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827513.492495:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ea940 x1874670272890496/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827538 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827513.492501:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827513.492504:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827513.492507:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272890496:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787827513.492536:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272890624:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787827513.492552:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827513.492577:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827513/real 1787827513]  req@ffff9ee0056eb0c0 x1874670272890624/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827538 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827513.492587:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb0c0 x1874670272890624/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827538 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827513.492594:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827513.492597:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827513.492599:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272890624:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787827513.492604:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272890752:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787827513.492617:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827513.492624:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827513/real 1787827513]  req@ffff9ee0056e9e00 x1874670272890752/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827538 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827513.492653:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9e00 x1874670272890752/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827538 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827513.492660:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827513.492689:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827513.492692:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272890752:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827514.323645:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827514.515472:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787827515.347594:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827515.539431:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827516.371570:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827516.563424:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827517.395525:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827517.587420:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827518.419488:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1787827518.611401:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827518.611412:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1787827518.611417:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1787827518.611429:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:0.0:1787827518.611430:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2682
00000100:00080000:0.0:1787827518.611454:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827518.611466:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787827518.611504:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb480 x1874670272890880/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827518.611528:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827518.611531:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787827518.611532:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827518.611535:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2682
00000100:00080000:0.0:1787827518.611538:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827518.611543:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827518.611551:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787827518.611571:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8b40 x1874670272891008/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827518.611580:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827518.611588:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00100000:2.0:1787827518.611588:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272890880:192.168.203.121@tcp:250:kworker.0
00000100:00080000:0.0:1787827518.611610:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827518.611615:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2682
00000100:00080000:0.0:1787827518.611618:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827518.611621:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827518.611625:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787827518.611636:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9680 x1874670272891136/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827518.611643:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827518.611645:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787827518.611646:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827518.611649:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2682
00000100:00080000:0.0:1787827518.611651:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827518.611654:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827518.611656:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787827518.611663:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e92c0 x1874670272891264/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827518.611670:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827518.611672:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787827518.611673:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827518.611676:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2682
00000100:00080000:0.0:1787827518.611685:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827518.611688:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827518.611693:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787827518.611699:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb840 x1874670272891392/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827518.611706:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827518.611708:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787827518.611710:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827518.611714:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2682
00000100:00080000:0.0:1787827518.611718:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827518.611721:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827518.611727:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787827518.611737:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8000 x1874670272891520/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827518.611746:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1787827518.611747:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272891008:192.168.203.121@tcp:38:kworker.0
00000100:00080000:0.0:1787827518.611749:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787827518.611752:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827518.611757:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2682
00000100:00080000:0.0:1787827518.611763:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827518.611766:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827518.611771:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787827518.611786:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272891136:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787827518.611788:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e83c0 x1874670272891648/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787827518.611828:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272891264:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787827518.611848:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272891392:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787827518.611867:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272891520:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787827518.611885:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272891648:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827519.443524:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827519.635385:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787827520.467634:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827520.659441:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827521.491591:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827521.683380:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000400:00000100:1.0:1787827521.683557:0:2355:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.203.121:988
00000400:00000100:1.0:1787827521.683612:0:2355:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.203.121@tcp at host 192.168.203.121 was unreachable: the network or that node may be down, or Lustre may be misconfigured.
00000800:00000100:1.0:1787827521.683629:0:2355:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:1.0:1787827521.683764:0:2355:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:1.0:1787827521.683776:0:2355:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:1.0:1787827521.683787:0:2355:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:1.0:1787827521.683798:0:2355:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:1.0:1787827521.683810:0:2355:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:1.0:1787827521.683824:0:2355:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000100:00100000:2.0:1787827521.683837:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827518/real 1787827521]  req@ffff9ee0056e8b40 x1874670272891008/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827543 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827521.683874:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8b40 x1874670272891008/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827543 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827521.683888:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827521.683894:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827521.683900:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272891008:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787827521.683912:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827518/real 1787827521]  req@ffff9ee0056e9680 x1874670272891136/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827543 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827521.683925:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9680 x1874670272891136/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827543 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827521.683933:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827521.683937:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827521.683941:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272891136:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787827521.683949:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827518/real 1787827521]  req@ffff9ee0056e92c0 x1874670272891264/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827543 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827521.683961:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e92c0 x1874670272891264/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827543 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827521.683970:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827521.683973:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827521.683977:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272891264:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787827521.683985:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827518/real 1787827521]  req@ffff9ee0056eb840 x1874670272891392/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827543 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827521.683998:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb840 x1874670272891392/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827543 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827521.684006:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827521.684009:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827521.684012:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272891392:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787827521.684021:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827518/real 1787827521]  req@ffff9ee0056eb480 x1874670272890880/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827543 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827521.684034:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb480 x1874670272890880/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827543 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827521.684043:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827521.684046:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827521.684050:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272890880:192.168.203.121@tcp:250:kworker.0
00000100:00100000:2.0:1787827521.684089:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827518/real 1787827521]  req@ffff9ee0056e8000 x1874670272891520/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827543 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827521.684104:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8000 x1874670272891520/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827543 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827521.684114:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827521.684118:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827521.684121:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272891520:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787827521.684129:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827518/real 1787827521]  req@ffff9ee0056e83c0 x1874670272891648/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827543 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827521.684148:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e83c0 x1874670272891648/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827543 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827521.684157:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827521.684161:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827521.684165:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272891648:192.168.203.121@tcp:8:kworker.0
00010000:00010000:3.0:1787827522.515544:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827522.707442:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827523.539446:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1787827523.731414:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1787827523.731418:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:2.0:1787827523.731423:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787827523.731428:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827523.731437:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2687
00000100:00080000:2.0:1787827523.731447:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827523.731453:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787827523.731483:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572bc00 x1874670272891776/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827523.731505:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827523.731507:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787827523.731508:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827523.731511:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2687
00000100:00080000:2.0:1787827523.731514:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827523.731518:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827523.731528:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787827523.731542:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729680 x1874670272891904/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787827523.731546:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272891776:192.168.203.121@tcp:250:kworker.0
00000100:00080000:2.0:1787827523.731575:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827523.731579:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787827523.731581:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827523.731586:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2687
00000100:00080000:2.0:1787827523.731589:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827523.731593:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827523.731598:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787827523.731608:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057292c0 x1874670272892032/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827523.731616:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827523.731618:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787827523.731619:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827523.731621:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2687
00000100:00080000:2.0:1787827523.731624:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000800:00000100:1.0:1787827523.731629:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:2.0:1787827523.731633:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827523.731639:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787827523.731653:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728780 x1874670272892160/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827523.731663:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827523.731666:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787827523.731669:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827523.731673:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2687
00000100:00080000:2.0:1787827523.731678:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1787827523.731679:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827523/real 1787827523]  req@ffff9ee00572bc00 x1874670272891776/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827548 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827523.731686:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827523.731696:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787827523.731709:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572bc00 x1874670272891776/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827548 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827523.731712:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a940 x1874670272892288/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827523.731737:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827523.731738:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827523.731745:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787827523.731748:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:2.0:1787827523.731750:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1787827523.731756:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272891776:192.168.203.121@tcp:250:kworker.0
00000100:00080000:2.0:1787827523.731759:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2687
00000100:00080000:2.0:1787827523.731767:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827523.731772:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827523.731777:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787827523.731789:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272891904:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787827523.731791:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a1c0 x1874670272892416/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827523.731807:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827523.731811:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787827523.731813:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827523.731817:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2687
00000800:00000100:1.0:1787827523.731822:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:2.0:1787827523.731823:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827523.731830:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827523.731836:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787827523.731842:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827523/real 1787827523]  req@ffff9ee005729680 x1874670272891904/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827548 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827523.731851:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728f00 x1874670272892544/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787827523.731864:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729680 x1874670272891904/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827548 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827523.731876:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827523.731881:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827523.731886:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272891904:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787827523.731893:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057292c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272892032:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827523.731913:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827523.731924:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827523/real 1787827523]  req@ffff9ee0057292c0 x1874670272892032/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827548 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827523.731937:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057292c0 x1874670272892032/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827548 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827523.731964:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827523.731968:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827523.731972:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057292c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272892032:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827523.731979:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272892160:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827523.731997:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827523.732008:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827523/real 1787827523]  req@ffff9ee005728780 x1874670272892160/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827548 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827523.732021:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728780 x1874670272892160/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827548 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827523.732030:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827523.732033:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827523.732037:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272892160:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827523.732044:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272892288:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787827523.732061:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827523.732071:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827523/real 1787827523]  req@ffff9ee00572a940 x1874670272892288/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827548 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827523.732084:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a940 x1874670272892288/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827548 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827523.732093:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827523.732097:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827523.732101:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272892288:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787827523.732121:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272892416:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827523.732140:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827523.732152:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827523/real 1787827523]  req@ffff9ee00572a1c0 x1874670272892416/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827548 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827523.732184:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a1c0 x1874670272892416/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827548 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827523.732193:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827523.732196:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827523.732200:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272892416:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827523.732207:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272892544:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827523.732227:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827523.732238:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827523/real 1787827523]  req@ffff9ee005728f00 x1874670272892544/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827548 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827523.732251:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728f00 x1874670272892544/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827548 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827523.732260:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827523.732264:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827523.732268:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272892544:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827524.563479:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787827524.755459:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787827525.587473:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787827525.779449:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827526.611517:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787827526.803420:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827527.635515:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787827527.827470:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827528.659482:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787827528.851457:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787827528.851483:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827528.851490:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787827528.851494:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827528.851503:0:8:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2692
00000100:00080000:3.0:1787827528.851514:0:8:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827528.851536:0:8:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787827528.851572:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057052c0 x1874670272892672/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827528.851600:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827528.851604:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787827528.851606:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827528.851609:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2692
00000100:00080000:3.0:1787827528.851613:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827528.851616:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827528.851625:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787827528.851636:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057043c0 x1874670272892800/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827528.851646:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827528.851649:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787827528.851651:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827528.851654:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2692
00000100:00080000:3.0:1787827528.851657:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827528.851663:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787827528.851665:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272892672:192.168.203.121@tcp:250:kworker.0
00000008:00100000:3.0:1787827528.851668:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827528.851683:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706580 x1874670272892928/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827528.851703:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827528.851706:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787827528.851708:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827528.851711:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2692
00000100:00080000:3.0:1787827528.851713:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827528.851716:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827528.851720:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827528.851730:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057070c0 x1874670272893056/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827528.851739:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827528.851742:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787827528.851744:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:1.0:1787827528.851748:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787827528.851753:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2692
00000100:00080000:3.0:1787827528.851756:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827528.851763:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827528.851769:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787827528.851780:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707c00 x1874670272893184/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827528.851788:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827528.851790:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787827528.851792:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827528.851796:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2692
00000100:00080000:3.0:1787827528.851798:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827528.851801:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827528.851804:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787827528.851815:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827528/real 1787827528]  req@ffff9ee0057052c0 x1874670272892672/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827553 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827528.851817:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704000 x1874670272893312/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827528.851860:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827528.851863:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787827528.851864:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1787827528.851870:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057052c0 x1874670272892672/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827553 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827528.851872:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2692
00000100:00080000:3.0:1787827528.851880:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827528.851888:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00080000:1.0:1787827528.851891:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000008:00100000:3.0:1787827528.851893:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:1.0:1787827528.851899:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827528.851907:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706d00 x1874670272893440/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787827528.851908:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272892672:192.168.203.121@tcp:250:kworker.0
00000100:00100000:1.0:1787827528.851925:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272892800:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787827528.851947:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827528.851960:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827528/real 1787827528]  req@ffff9ee0057043c0 x1874670272892800/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827553 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827528.851979:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057043c0 x1874670272892800/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827553 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827528.851990:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827528.851995:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827528.851999:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272892800:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787827528.852026:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272892928:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827528.852062:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827528.852074:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827528/real 1787827528]  req@ffff9ee005706580 x1874670272892928/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827553 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827528.852085:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706580 x1874670272892928/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827553 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827528.852097:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827528.852100:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827528.852103:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272892928:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827528.852107:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272893056:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827528.852121:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827528.852129:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827528/real 1787827528]  req@ffff9ee0057070c0 x1874670272893056/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827553 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827528.852138:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057070c0 x1874670272893056/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827553 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827528.852145:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827528.852147:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827528.852149:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272893056:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827528.852153:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272893184:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787827528.852165:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827528.852172:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827528/real 1787827528]  req@ffff9ee005707c00 x1874670272893184/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827553 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827528.852182:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707c00 x1874670272893184/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827553 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827528.852198:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827528.852200:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827528.852203:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272893184:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787827528.852207:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272893312:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827528.852219:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827528.852227:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827528/real 1787827528]  req@ffff9ee005704000 x1874670272893312/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827553 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827528.852235:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704000 x1874670272893312/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827553 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827528.852264:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827528.852266:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827528.852269:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272893312:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827528.852274:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272893440:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827528.852288:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827528.852296:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827528/real 1787827528]  req@ffff9ee005706d00 x1874670272893440/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827553 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827528.852306:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706d00 x1874670272893440/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827553 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827528.852312:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827528.852360:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827528.852363:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272893440:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827529.683582:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827529.875576:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787827530.707535:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827530.899469:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827531.731599:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827531.923535:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827532.755510:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827532.947540:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827533.779520:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827533.971415:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:1.0:1787827533.971445:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827533.971453:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1787827533.971458:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827533.971468:0:8:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2697
00000100:00080000:1.0:1787827533.971481:0:8:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827533.971503:0:8:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787827533.971540:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a3480 x1874670272893568/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827533.971572:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827533.971578:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787827533.971580:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827533.971585:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2697
00000100:00080000:1.0:1787827533.971592:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827533.971597:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827533.971609:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787827533.971613:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272893568:192.168.203.121@tcp:250:kworker.0
00000100:00100000:1.0:1787827533.971629:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a12c0 x1874670272893696/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827533.971653:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827533.971658:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787827533.971660:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827533.971667:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2697
00000100:00080000:1.0:1787827533.971674:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000800:00000100:3.0:1787827533.971678:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:1.0:1787827533.971684:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827533.971693:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787827533.971709:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1a40 x1874670272893824/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787827533.971719:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827533/real 1787827533]  req@ffff9ee0056a3480 x1874670272893568/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827558 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827533.971750:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827533.971755:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787827533.971757:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827533.971762:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2697
00000100:00080000:1.0:1787827533.971767:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827533.971771:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827533.971777:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787827533.971790:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a3c00 x1874670272893952/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787827533.971810:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a3480 x1874670272893568/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827558 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827533.971813:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827533.971824:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787827533.971828:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827533.971829:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827533.971834:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:1.0:1787827533.971840:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2697
00000100:00100000:3.0:1787827533.971840:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272893568:192.168.203.121@tcp:250:kworker.0
00000100:00080000:1.0:1787827533.971850:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827533.971859:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827533.971864:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787827533.971876:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a2940 x1874670272894080/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827533.971887:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827533.971890:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787827533.971893:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827533.971897:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2697
00000100:00080000:1.0:1787827533.971902:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827533.971906:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827533.971912:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787827533.971925:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1680 x1874670272894208/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827533.971936:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827533.971940:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787827533.971942:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827533.971946:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2697
00000100:00080000:1.0:1787827533.971951:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827533.971957:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827533.971963:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827533.971965:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272893696:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787827533.971980:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0f00 x1874670272894336/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1787827533.972030:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827533.972049:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827533/real 1787827533]  req@ffff9ee0056a12c0 x1874670272893696/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827558 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827533.972064:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a12c0 x1874670272893696/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827558 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827533.972072:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827533.972075:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827533.972077:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272893696:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787827533.972082:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272893824:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827533.972099:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827533.972107:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827533/real 1787827533]  req@ffff9ee0056a1a40 x1874670272893824/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827558 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827533.972115:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1a40 x1874670272893824/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827558 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827533.972121:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827533.972123:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827533.972125:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272893824:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787827533.972128:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272893952:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827533.972138:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827533.972144:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827533/real 1787827533]  req@ffff9ee0056a3c00 x1874670272893952/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827558 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827533.972157:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a3c00 x1874670272893952/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827558 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827533.972162:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827533.972164:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827533.972166:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272893952:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787827533.972169:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272894080:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787827533.972179:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827533.972185:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827533/real 1787827533]  req@ffff9ee0056a2940 x1874670272894080/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827558 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827533.972193:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a2940 x1874670272894080/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827558 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827533.972198:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827533.972199:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827533.972209:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272894080:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787827533.972213:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272894208:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827533.972224:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827533.972230:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827533/real 1787827533]  req@ffff9ee0056a1680 x1874670272894208/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827558 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827533.972238:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1680 x1874670272894208/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827558 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827533.972247:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827533.972249:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827533.972251:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272894208:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787827533.972271:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272894336:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827533.972282:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827533.972289:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827533/real 1787827533]  req@ffff9ee0056a0f00 x1874670272894336/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827558 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827533.972297:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0f00 x1874670272894336/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827558 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827533.972302:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827533.972304:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827533.972306:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272894336:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827534.803451:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827534.995423:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787827535.827523:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827536.019455:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827536.851536:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827537.043439:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827537.875662:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827538.067530:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827538.899568:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827539.091466:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:0.0:1787827539.091547:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827539.091553:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1787827539.091557:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827539.091565:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2702
00000100:00080000:0.0:1787827539.091575:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827539.091581:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787827539.091617:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ebc00 x1874670272894464/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827539.091661:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827539.091665:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787827539.091668:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827539.091672:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2702
00000100:00080000:0.0:1787827539.091677:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827539.091683:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827539.091695:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787827539.091731:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272894464:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787827539.091732:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8f00 x1874670272894592/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827539.091758:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827539.091762:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787827539.091765:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827539.091768:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2702
00000100:00080000:0.0:1787827539.091772:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827539.091775:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827539.091781:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787827539.091795:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e83c0 x1874670272894720/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1787827539.091803:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:0.0:1787827539.091811:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827539.091815:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787827539.091817:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827539.091822:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2702
00000100:00080000:0.0:1787827539.091833:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827539.091836:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827539.091860:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827539.091870:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827539/real 1787827539]  req@ffff9ee0056ebc00 x1874670272894464/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827564 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827539.091878:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8000 x1874670272894848/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827539.091908:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827539.091913:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00100000:3.0:1787827539.091916:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ebc00 x1874670272894464/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827564 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827539.091917:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827539.091931:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2702
00000100:00080000:0.0:1787827539.091940:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827539.091948:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00080000:3.0:1787827539.091948:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827539.091963:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000008:00100000:0.0:1787827539.091966:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787827539.091974:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272894464:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787827539.091984:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb480 x1874670272894976/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827539.091997:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827539.092000:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787827539.092002:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827539.092007:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2702
00000100:00080000:0.0:1787827539.092010:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827539.092018:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787827539.092018:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272894592:192.168.203.121@tcp:38:kworker.0
00000008:00100000:0.0:1787827539.092028:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787827539.092042:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb840 x1874670272895104/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827539.092054:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827539.092058:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787827539.092060:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:3.0:1787827539.092069:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:0.0:1787827539.092070:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2702
00000100:00080000:0.0:1787827539.092080:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827539.092086:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827539.092091:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827539.092098:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827539/real 1787827539]  req@ffff9ee0056e8f00 x1874670272894592/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827564 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827539.092108:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e92c0 x1874670272895232/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787827539.092125:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8f00 x1874670272894592/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827564 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827539.092152:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827539.092156:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827539.092160:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272894592:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787827539.092166:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272894720:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827539.092196:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827539.092206:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827539/real 1787827539]  req@ffff9ee0056e83c0 x1874670272894720/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827564 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827539.092215:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e83c0 x1874670272894720/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827564 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827539.092255:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827539.092258:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827539.092262:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272894720:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787827539.092268:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272894848:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827539.092287:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827539.092297:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827539/real 1787827539]  req@ffff9ee0056e8000 x1874670272894848/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827564 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827539.092309:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8000 x1874670272894848/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827564 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827539.092342:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827539.092346:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827539.092349:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272894848:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787827539.092355:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272894976:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787827539.092373:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827539.092384:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827539/real 1787827539]  req@ffff9ee0056eb480 x1874670272894976/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827564 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827539.092396:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb480 x1874670272894976/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827564 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827539.092404:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827539.092407:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827539.092412:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272894976:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787827539.092439:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272895104:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827539.092508:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827539.092531:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827539/real 1787827539]  req@ffff9ee0056eb840 x1874670272895104/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827564 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827539.092551:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb840 x1874670272895104/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827564 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827539.092561:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827539.092564:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827539.092568:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272895104:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787827539.092575:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272895232:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827539.092600:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827539.092612:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827539/real 1787827539]  req@ffff9ee0056e92c0 x1874670272895232/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827564 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827539.092624:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e92c0 x1874670272895232/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827564 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827539.092633:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827539.092636:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827539.092640:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272895232:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827539.923560:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827540.115395:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787827540.947566:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827541.139501:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827541.971457:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827542.163460:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827542.995565:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827543.187452:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827544.019520:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827544.211422:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:2.0:1787827544.211435:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827544.211442:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787827544.211445:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827544.211453:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2707
00000100:00080000:2.0:1787827544.211462:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827544.211469:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787827544.211499:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b840 x1874670272895360/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827544.211518:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827544.211521:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787827544.211522:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827544.211525:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2707
00000100:00080000:2.0:1787827544.211527:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827544.211530:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827544.211538:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787827544.211547:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272895360:192.168.203.121@tcp:250:kworker.0
00000100:00100000:2.0:1787827544.211549:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057283c0 x1874670272895488/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827544.211561:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827544.211563:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787827544.211564:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827544.211567:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2707
00000100:00080000:2.0:1787827544.211569:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827544.211571:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827544.211574:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787827544.211583:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729e00 x1874670272895616/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827544.211589:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827544.211591:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787827544.211593:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827544.211596:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2707
00000100:00080000:2.0:1787827544.211599:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827544.211601:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827544.211604:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:3.0:1787827544.211609:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827544.211615:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728000 x1874670272895744/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827544.211623:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827544.211625:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787827544.211627:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827544.211630:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2707
00000100:00080000:2.0:1787827544.211632:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827544.211635:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827544.211638:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787827544.211645:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a580 x1874670272895872/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827544.211652:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827544.211655:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00100000:3.0:1787827544.211655:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827544/real 1787827544]  req@ffff9ee00572b840 x1874670272895360/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827569 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827544.211659:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827544.211667:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2707
00000100:00080000:2.0:1787827544.211671:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827544.211677:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827544.211681:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827544.211685:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b840 x1874670272895360/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827569 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827544.211693:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728b40 x1874670272896000/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827544.211698:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827544.211703:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827544.211706:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:2.0:1787827544.211708:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787827544.211712:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1787827544.211715:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272895360:192.168.203.121@tcp:250:kworker.0
00000100:00080000:2.0:1787827544.211718:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2707
00000100:00080000:2.0:1787827544.211723:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827544.211726:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827544.211728:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787827544.211734:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b0c0 x1874670272896128/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787827544.211740:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272895488:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787827544.211762:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827544.211772:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827544/real 1787827544]  req@ffff9ee0057283c0 x1874670272895488/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827569 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827544.211780:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057283c0 x1874670272895488/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827569 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827544.211786:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827544.211788:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827544.211791:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272895488:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787827544.211795:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272895616:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827544.211806:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827544.211812:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827544/real 1787827544]  req@ffff9ee005729e00 x1874670272895616/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827569 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827544.211819:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729e00 x1874670272895616/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827569 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827544.211824:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827544.211826:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827544.211828:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272895616:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787827544.211831:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272895744:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827544.211840:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827544.211846:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827544/real 1787827544]  req@ffff9ee005728000 x1874670272895744/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827569 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827544.211853:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728000 x1874670272895744/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827569 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827544.211858:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827544.211859:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827544.211861:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272895744:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787827544.211864:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272895872:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787827544.211873:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827544.211878:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827544/real 1787827544]  req@ffff9ee00572a580 x1874670272895872/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827569 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827544.211886:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a580 x1874670272895872/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827569 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827544.211891:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827544.211892:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827544.211894:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272895872:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787827544.211897:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272896000:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827544.211906:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827544.211914:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827544/real 1787827544]  req@ffff9ee005728b40 x1874670272896000/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827569 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827544.211925:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728b40 x1874670272896000/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827569 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827544.211933:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827544.211936:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827544.211940:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272896000:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787827544.211961:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272896128:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827544.211980:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827544.211988:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827544/real 1787827544]  req@ffff9ee00572b0c0 x1874670272896128/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827569 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827544.211996:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b0c0 x1874670272896128/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827569 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827544.212005:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827544.212008:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827544.212010:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272896128:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827545.043559:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827545.235521:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787827546.067610:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827546.259408:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827547.091504:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827547.283478:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827548.115516:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787827548.307448:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827549.139586:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1787827549.331469:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827549.331481:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787827549.331488:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1787827549.331495:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:2.0:1787827549.331502:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2713
00000100:00080000:2.0:1787827549.331519:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827549.331529:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787827549.331579:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729a40 x1874670272896256/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827549.331617:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827549.331622:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787827549.331625:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827549.331630:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2713
00000100:00080000:2.0:1787827549.331635:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827549.331640:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827549.331652:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787827549.331666:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572ad00 x1874670272896384/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827549.331681:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827549.331686:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787827549.331689:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827549.331693:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2713
00000100:00080000:2.0:1787827549.331698:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827549.331703:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827549.331710:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827549.331718:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272896256:192.168.203.121@tcp:250:kworker.0
00000100:00100000:2.0:1787827549.331729:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b480 x1874670272896512/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827549.331744:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827549.331748:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787827549.331750:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827549.331755:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2713
00000100:00080000:2.0:1787827549.331759:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827549.331764:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827549.331770:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787827549.331785:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b0c0 x1874670272896640/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827549.331808:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:3.0:1787827549.331812:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:2.0:1787827549.331823:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787827549.331830:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827549.331842:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2713
00000100:00080000:2.0:1787827549.331851:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827549.331860:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827549.331871:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787827549.331880:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827549/real 1787827549]  req@ffff9ee005729a40 x1874670272896256/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827574 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827549.331905:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728b40 x1874670272896768/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787827549.331913:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729a40 x1874670272896256/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827574 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827549.331966:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827549.331968:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827549.331975:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787827549.331983:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:2.0:1787827549.331984:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827549.331993:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2713
00000100:00080000:2.0:1787827549.331999:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827549.332005:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787827549.332016:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272896256:192.168.203.121@tcp:250:kworker.0
00000008:00100000:2.0:1787827549.332018:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827549.332040:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272896384:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787827549.332049:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a580 x1874670272896896/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827549.332065:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827549.332069:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787827549.332073:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827549.332078:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2713
00000100:00080000:2.0:1787827549.332086:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827549.332091:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827549.332102:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:3.0:1787827549.332102:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827549.332128:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728000 x1874670272897024/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787827549.332148:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827549/real 1787827549]  req@ffff9ee00572ad00 x1874670272896384/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827574 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827549.332190:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572ad00 x1874670272896384/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827574 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827549.332202:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827549.332206:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827549.332210:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272896384:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787827549.332244:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272896512:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827549.332275:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827549.332291:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827549/real 1787827549]  req@ffff9ee00572b480 x1874670272896512/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827574 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827549.332306:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b480 x1874670272896512/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827574 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827549.332358:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827549.332363:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827549.332368:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272896512:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787827549.332400:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272896640:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827549.332435:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827549.332451:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827549/real 1787827549]  req@ffff9ee00572b0c0 x1874670272896640/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827574 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827549.332466:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b0c0 x1874670272896640/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827574 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827549.332485:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827549.332489:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827549.332493:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272896640:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787827549.332500:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272896768:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787827549.332519:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827549.332530:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827549/real 1787827549]  req@ffff9ee005728b40 x1874670272896768/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827574 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827549.332544:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728b40 x1874670272896768/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827574 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827549.332553:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827549.332557:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827549.332560:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272896768:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787827549.332567:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272896896:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827549.332585:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827549.332596:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827549/real 1787827549]  req@ffff9ee00572a580 x1874670272896896/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827574 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827549.332610:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a580 x1874670272896896/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827574 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827549.332619:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827549.332622:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827549.332626:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272896896:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787827549.332634:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272897024:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827549.332652:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827549.332662:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827549/real 1787827549]  req@ffff9ee005728000 x1874670272897024/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827574 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827549.332675:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728000 x1874670272897024/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827574 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827549.332685:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827549.332688:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827549.332692:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272897024:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827550.163481:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827550.355510:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787827551.187476:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827551.379385:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827552.211509:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827552.403405:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827553.235523:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827553.427388:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827554.259481:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827554.451428:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:2.0:1787827554.451448:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827554.451457:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787827554.451480:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827554.451488:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2718
00000100:00080000:2.0:1787827554.451498:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827554.451506:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787827554.451547:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729e00 x1874670272897152/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827554.451579:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827554.451582:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787827554.451583:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827554.451586:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2718
00000100:00080000:2.0:1787827554.451590:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827554.451596:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827554.451605:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787827554.451618:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272897152:192.168.203.121@tcp:250:kworker.0
00000100:00100000:2.0:1787827554.451619:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057283c0 x1874670272897280/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827554.451644:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827554.451647:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787827554.451648:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827554.451652:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2718
00000100:00080000:2.0:1787827554.451654:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827554.451656:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827554.451660:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787827554.451670:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b840 x1874670272897408/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827554.451678:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827554.451681:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787827554.451682:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827554.451684:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2718
00000100:00080000:2.0:1787827554.451686:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827554.451688:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827554.451691:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787827554.451696:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728f00 x1874670272897536/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827554.451702:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827554.451704:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787827554.451705:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827554.451707:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2718
00000100:00080000:2.0:1787827554.451709:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827554.451711:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827554.451715:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787827554.451720:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a1c0 x1874670272897664/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827554.451726:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827554.451728:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787827554.451729:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827554.451732:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2718
00000100:00080000:2.0:1787827554.451741:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827554.451744:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827554.451747:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787827554.451757:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a940 x1874670272897792/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1787827554.451758:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:2.0:1787827554.451766:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827554.451768:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787827554.451770:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827554.451772:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2718
00000100:00080000:2.0:1787827554.451775:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827554.451778:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827554.451781:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787827554.451789:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728780 x1874670272897920/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787827554.451820:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827554/real 1787827554]  req@ffff9ee005729e00 x1874670272897152/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827579 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827554.451843:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729e00 x1874670272897152/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827579 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827554.451862:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827554.451866:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827554.451871:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272897152:192.168.203.121@tcp:250:kworker.0
00000100:00100000:3.0:1787827554.451899:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272897280:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787827554.451928:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827554.451938:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827554/real 1787827554]  req@ffff9ee0057283c0 x1874670272897280/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827579 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827554.451946:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057283c0 x1874670272897280/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827579 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827554.451952:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827554.451954:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827554.451957:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272897280:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787827554.451961:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272897408:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827554.451972:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827554.451978:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827554/real 1787827554]  req@ffff9ee00572b840 x1874670272897408/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827579 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827554.451985:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b840 x1874670272897408/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827579 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827554.451990:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827554.451992:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827554.451994:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272897408:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787827554.451998:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272897536:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827554.452008:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827554.452015:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827554/real 1787827554]  req@ffff9ee005728f00 x1874670272897536/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827579 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827554.452027:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728f00 x1874670272897536/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827579 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827554.452035:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827554.452038:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827554.452041:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272897536:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787827554.452048:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272897664:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787827554.452068:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827554.452078:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827554/real 1787827554]  req@ffff9ee00572a1c0 x1874670272897664/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827579 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827554.452095:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a1c0 x1874670272897664/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827579 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827554.452101:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827554.452103:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827554.452105:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272897664:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787827554.452108:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272897792:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827554.452121:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827554.452128:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827554/real 1787827554]  req@ffff9ee00572a940 x1874670272897792/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827579 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827554.452136:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a940 x1874670272897792/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827579 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827554.452141:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827554.452143:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827554.452145:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272897792:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787827554.452148:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272897920:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827554.452157:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827554.452162:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827554/real 1787827554]  req@ffff9ee005728780 x1874670272897920/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827579 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827554.452170:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728780 x1874670272897920/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827579 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827554.452175:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827554.452176:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827554.452178:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272897920:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827555.283557:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827555.475426:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787827556.307481:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827556.499384:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827557.331513:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827557.523444:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827558.355459:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827558.547441:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827559.379471:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827559.571424:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:2.0:1787827559.571443:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827559.571452:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787827559.571457:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827559.571469:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2723
00000100:00080000:2.0:1787827559.571481:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827559.571489:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787827559.571533:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057292c0 x1874670272898048/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827559.571564:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827559.571567:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787827559.571569:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827559.571572:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2723
00000100:00080000:2.0:1787827559.571575:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827559.571577:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827559.571587:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787827559.571596:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729680 x1874670272898176/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827559.571604:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827559.571607:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787827559.571608:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827559.571611:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2723
00000100:00080000:2.0:1787827559.571613:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827559.571615:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827559.571619:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827559.571625:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057292c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272898048:192.168.203.121@tcp:250:kworker.0
00000100:00100000:2.0:1787827559.571628:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572bc00 x1874670272898304/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827559.571638:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827559.571640:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787827559.571641:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827559.571643:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2723
00000100:00080000:2.0:1787827559.571645:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827559.571648:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827559.571651:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787827559.571659:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728780 x1874670272898432/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827559.571666:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827559.571669:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787827559.571670:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827559.571672:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2723
00000100:00080000:2.0:1787827559.571694:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827559.571698:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827559.571701:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787827559.571708:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a940 x1874670272898560/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1787827559.571712:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:2.0:1787827559.571722:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827559.571725:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787827559.571727:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827559.571731:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2723
00000100:00080000:2.0:1787827559.571735:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827559.571737:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827559.571740:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787827559.571748:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a1c0 x1874670272898688/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827559.571754:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827559.571757:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787827559.571759:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827559.571763:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2723
00000100:00100000:3.0:1787827559.571764:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827559/real 1787827559]  req@ffff9ee0057292c0 x1874670272898048/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827584 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827559.571765:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827559.571771:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827559.571777:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787827559.571788:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728f00 x1874670272898816/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787827559.571793:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057292c0 x1874670272898048/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827584 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827559.571806:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827559.571809:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827559.571813:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057292c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272898048:192.168.203.121@tcp:250:kworker.0
00000100:00100000:3.0:1787827559.571819:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272898176:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787827559.571836:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827559.571845:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827559/real 1787827559]  req@ffff9ee005729680 x1874670272898176/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827584 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827559.571853:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729680 x1874670272898176/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827584 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827559.571858:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827559.571861:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827559.571863:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272898176:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787827559.571883:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272898304:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827559.571895:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827559.571902:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827559/real 1787827559]  req@ffff9ee00572bc00 x1874670272898304/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827584 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827559.571914:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572bc00 x1874670272898304/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827584 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827559.571919:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827559.571921:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827559.571923:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272898304:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787827559.571927:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272898432:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827559.571936:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827559.571941:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827559/real 1787827559]  req@ffff9ee005728780 x1874670272898432/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827584 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827559.571949:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728780 x1874670272898432/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827584 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827559.571954:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827559.571956:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827559.571958:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272898432:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787827559.571961:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272898560:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787827559.571970:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827559.571976:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827559/real 1787827559]  req@ffff9ee00572a940 x1874670272898560/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827584 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827559.571982:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a940 x1874670272898560/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827584 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827559.571991:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827559.571994:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827559.571996:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272898560:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787827559.571999:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272898688:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827559.572008:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827559.572014:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827559/real 1787827559]  req@ffff9ee00572a1c0 x1874670272898688/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827584 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827559.572020:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a1c0 x1874670272898688/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827584 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827559.572025:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827559.572026:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827559.572028:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272898688:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787827559.572031:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272898816:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827559.572041:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827559.572047:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827559/real 1787827559]  req@ffff9ee005728f00 x1874670272898816/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827584 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827559.572053:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728f00 x1874670272898816/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827584 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827559.572065:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827559.572068:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827559.572071:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272898816:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827560.403462:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827560.595420:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787827561.427486:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827561.619424:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827562.451489:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827562.643432:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827563.475458:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827563.667400:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827564.499610:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827564.691469:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:1.0:1787827564.691486:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827564.691496:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1787827564.691501:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827564.691515:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2728
00000100:00080000:1.0:1787827564.691530:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827564.691541:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787827564.691596:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a21c0 x1874670272898944/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827564.691623:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827564.691629:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787827564.691630:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827564.691634:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2728
00000100:00080000:1.0:1787827564.691637:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827564.691642:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827564.691653:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787827564.691657:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272898944:192.168.203.121@tcp:250:kworker.0
00000100:00100000:1.0:1787827564.691667:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0f00 x1874670272899072/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827564.691676:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827564.691679:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787827564.691680:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827564.691683:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2728
00000100:00080000:1.0:1787827564.691685:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827564.691688:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827564.691692:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787827564.691701:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1680 x1874670272899200/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827564.691707:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827564.691709:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787827564.691711:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827564.691714:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2728
00000100:00080000:1.0:1787827564.691717:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827564.691719:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827564.691723:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787827564.691731:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a2940 x1874670272899328/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827564.691738:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827564.691740:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787827564.691741:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827564.691744:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2728
00000100:00080000:1.0:1787827564.691746:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827564.691751:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000800:00000100:3.0:1787827564.691755:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000008:00100000:1.0:1787827564.691756:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787827564.691767:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a3c00 x1874670272899456/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827564.691773:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827564.691775:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787827564.691776:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827564.691780:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2728
00000100:00080000:1.0:1787827564.691791:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827564.691794:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827564.691797:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787827564.691806:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1a40 x1874670272899584/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827564.691813:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827564.691815:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787827564.691817:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827564.691823:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2728
00000100:00100000:3.0:1787827564.691824:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827564/real 1787827564]  req@ffff9ee0056a21c0 x1874670272898944/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827589 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827564.691826:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827564.691831:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827564.691837:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787827564.691848:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a12c0 x1874670272899712/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787827564.691858:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a21c0 x1874670272898944/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827589 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827564.691874:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827564.691880:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827564.691885:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272898944:192.168.203.121@tcp:250:kworker.0
00000100:00100000:3.0:1787827564.691927:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272899072:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787827564.691956:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827564.691971:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827564/real 1787827564]  req@ffff9ee0056a0f00 x1874670272899072/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827589 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827564.691986:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0f00 x1874670272899072/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827589 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827564.692004:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827564.692008:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827564.692012:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272899072:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787827564.692020:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272899200:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827564.692063:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827564.692081:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827564/real 1787827564]  req@ffff9ee0056a1680 x1874670272899200/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827589 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827564.692099:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1680 x1874670272899200/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827589 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827564.692111:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827564.692116:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827564.692121:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272899200:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787827564.692131:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272899328:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827564.692163:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827564.692180:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827564/real 1787827564]  req@ffff9ee0056a2940 x1874670272899328/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827589 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827564.692199:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a2940 x1874670272899328/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827589 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827564.692211:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827564.692215:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827564.692221:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272899328:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787827564.692230:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272899456:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787827564.692262:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827564.692302:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827564/real 1787827564]  req@ffff9ee0056a3c00 x1874670272899456/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827589 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827564.692359:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a3c00 x1874670272899456/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827589 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827564.692369:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827564.692373:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827564.692377:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272899456:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787827564.692384:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272899584:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827564.692408:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827564.692421:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827564/real 1787827564]  req@ffff9ee0056a1a40 x1874670272899584/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827589 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827564.692435:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1a40 x1874670272899584/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827589 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827564.692444:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827564.692447:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827564.692451:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272899584:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787827564.692458:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272899712:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827564.692482:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827564.692495:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827564/real 1787827564]  req@ffff9ee0056a12c0 x1874670272899712/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827589 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827564.692509:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a12c0 x1874670272899712/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827589 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827564.692518:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827564.692522:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827564.692526:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272899712:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827565.523522:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827565.715418:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787827566.547501:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827566.739466:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827567.571504:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827567.763429:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827568.595531:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827568.787434:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827569.619602:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827569.811377:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:1.0:1787827569.811384:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827569.811390:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1787827569.811395:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827569.811406:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2733
00000100:00080000:1.0:1787827569.811417:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827569.811426:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787827569.811473:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a3480 x1874670272899840/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827569.811496:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827569.811499:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787827569.811501:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827569.811504:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2733
00000100:00080000:1.0:1787827569.811506:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827569.811509:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827569.811532:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787827569.811544:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0b40 x1874670272899968/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787827569.811548:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272899840:192.168.203.121@tcp:250:kworker.0
00000100:00080000:1.0:1787827569.811565:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827569.811568:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787827569.811570:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827569.811574:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2733
00000100:00080000:1.0:1787827569.811577:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827569.811580:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827569.811584:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787827569.811594:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a2580 x1874670272900096/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827569.811601:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827569.811604:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787827569.811605:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827569.811609:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2733
00000100:00080000:1.0:1787827569.811613:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827569.811616:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827569.811619:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787827569.811627:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a03c0 x1874670272900224/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827569.811633:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827569.811635:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787827569.811636:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:3.0:1787827569.811642:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:1.0:1787827569.811645:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2733
00000100:00080000:1.0:1787827569.811649:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827569.811653:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827569.811657:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787827569.811666:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1e00 x1874670272900352/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827569.811672:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827569.811676:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787827569.811677:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827569.811680:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2733
00000100:00080000:1.0:1787827569.811682:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827569.811685:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827569.811688:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787827569.811695:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0000 x1874670272900480/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827569.811702:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827569.811706:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787827569.811708:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827569.811712:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2733
00000100:00080000:1.0:1787827569.811722:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827569.811725:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827569.811728:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787827569.811739:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0780 x1874670272900608/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787827569.811749:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827569/real 1787827569]  req@ffff9ee0056a3480 x1874670272899840/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827594 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827569.811785:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a3480 x1874670272899840/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827594 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827569.811799:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827569.811803:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827569.811918:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272899840:192.168.203.121@tcp:250:kworker.0
00000100:00100000:3.0:1787827569.812019:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272899968:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787827569.812071:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827569.812083:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827569/real 1787827569]  req@ffff9ee0056a0b40 x1874670272899968/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827594 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827569.812108:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0b40 x1874670272899968/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827594 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827569.812115:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827569.812118:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827569.812121:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272899968:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787827569.812126:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272900096:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827569.812142:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827569.812150:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827569/real 1787827569]  req@ffff9ee0056a2580 x1874670272900096/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827594 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827569.812159:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a2580 x1874670272900096/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827594 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827569.812165:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827569.812167:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827569.812170:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272900096:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787827569.812173:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272900224:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827569.812184:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827569.812191:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827569/real 1787827569]  req@ffff9ee0056a03c0 x1874670272900224/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827594 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827569.812200:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a03c0 x1874670272900224/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827594 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827569.812206:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827569.812208:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827569.812210:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272900224:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787827569.812214:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272900352:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787827569.812278:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827569.812287:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827569/real 1787827569]  req@ffff9ee0056a1e00 x1874670272900352/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827594 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827569.812296:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1e00 x1874670272900352/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827594 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827569.812302:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827569.812304:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827569.812306:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272900352:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787827569.812310:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272900480:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827569.812322:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827569.812328:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827569/real 1787827569]  req@ffff9ee0056a0000 x1874670272900480/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827594 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827569.812357:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0000 x1874670272900480/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827594 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827569.812368:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827569.812370:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827569.812372:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272900480:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787827569.812376:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272900608:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827569.812389:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827569.812396:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827569/real 1787827569]  req@ffff9ee0056a0780 x1874670272900608/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827594 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827569.812403:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0780 x1874670272900608/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827594 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827569.812408:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827569.812410:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827569.812412:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272900608:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827570.643588:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827570.835449:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787827571.667498:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827571.859451:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827572.691504:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827572.883417:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827573.715542:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827573.907401:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827574.739514:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1787827574.931406:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1787827574.931410:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:1.0:1787827574.931418:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1787827574.931440:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827574.931452:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2738
00000100:00080000:1.0:1787827574.931463:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827574.931471:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787827574.931513:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a30c0 x1874670272900736/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827574.931541:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827574.931545:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787827574.931565:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827574.931569:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2738
00000100:00080000:1.0:1787827574.931573:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827574.931577:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827574.931587:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787827574.931602:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0780 x1874670272900864/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827574.931618:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1787827574.931620:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272900736:192.168.203.121@tcp:250:kworker.0
00000100:00080000:1.0:1787827574.931623:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787827574.931628:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827574.931633:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2738
00000100:00080000:1.0:1787827574.931635:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827574.931639:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827574.931649:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787827574.931660:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0000 x1874670272900992/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827574.931671:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827574.931701:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787827574.931703:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827574.931716:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2738
00000100:00080000:1.0:1787827574.931721:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827574.931724:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827574.931729:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787827574.931740:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1e00 x1874670272901120/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827574.931748:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827574.931754:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787827574.931768:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:3.0:1787827574.931768:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:1.0:1787827574.931777:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2738
00000100:00080000:1.0:1787827574.931781:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827574.931785:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827574.931788:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787827574.931798:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a03c0 x1874670272901248/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827574.931805:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827574.931808:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787827574.931810:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827574.931815:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2738
00000100:00080000:1.0:1787827574.931819:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827574.931825:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787827574.931828:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827574/real 1787827574]  req@ffff9ee0056a30c0 x1874670272900736/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827599 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:1.0:1787827574.931830:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787827574.931844:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a2580 x1874670272901376/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827574.931857:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827574.931860:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787827574.931862:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1787827574.931868:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a30c0 x1874670272900736/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827599 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827574.931869:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2738
00000100:00080000:1.0:1787827574.931875:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827574.931881:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827574.931889:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:3.0:1787827574.931902:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:1.0:1787827574.931904:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0b40 x1874670272901504/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827574.931917:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827574.931927:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272900736:192.168.203.121@tcp:250:kworker.0
00000100:00100000:3.0:1787827574.931957:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272900864:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787827574.931986:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827574.932018:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827574/real 1787827574]  req@ffff9ee0056a0780 x1874670272900864/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827599 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827574.932040:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0780 x1874670272900864/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827599 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827574.932049:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827574.932053:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827574.932057:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272900864:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787827574.932063:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272900992:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827574.932120:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827574.932138:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827574/real 1787827574]  req@ffff9ee0056a0000 x1874670272900992/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827599 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827574.932159:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0000 x1874670272900992/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827599 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827574.932182:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827574.932187:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827574.932193:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272900992:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787827574.932239:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272901120:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827574.932264:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827574.932277:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827574/real 1787827574]  req@ffff9ee0056a1e00 x1874670272901120/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827599 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827574.932289:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1e00 x1874670272901120/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827599 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827574.932298:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827574.932301:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827574.932305:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272901120:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787827574.932311:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272901248:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787827574.932373:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827574.932391:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827574/real 1787827574]  req@ffff9ee0056a03c0 x1874670272901248/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827599 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827574.932411:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a03c0 x1874670272901248/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827599 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827574.932425:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827574.932430:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827574.932436:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272901248:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787827574.932445:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272901376:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827574.932473:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827574.932489:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827574/real 1787827574]  req@ffff9ee0056a2580 x1874670272901376/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827599 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827574.932507:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a2580 x1874670272901376/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827599 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827574.932519:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827574.932524:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827574.932529:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272901376:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787827574.932538:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272901504:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827574.932567:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827574.932584:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827574/real 1787827574]  req@ffff9ee0056a0b40 x1874670272901504/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827599 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827574.932603:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0b40 x1874670272901504/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827599 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827574.932616:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827574.932621:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827574.932648:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272901504:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827575.763523:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827575.955428:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787827576.787571:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827576.979400:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827577.811476:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827578.003426:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827578.835472:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827579.027417:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827579.859471:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827580.051418:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:0.0:1787827580.051423:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827580.051429:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1787827580.051433:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827580.051440:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2743
00000100:00080000:0.0:1787827580.051449:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827580.051455:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787827580.051487:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9680 x1874670272901632/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827580.051508:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827580.051511:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787827580.051512:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827580.051514:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2743
00000100:00080000:0.0:1787827580.051517:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827580.051520:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827580.051527:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787827580.051539:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272901632:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787827580.051540:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8b40 x1874670272901760/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827580.051553:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827580.051555:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787827580.051556:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827580.051560:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2743
00000100:00080000:0.0:1787827580.051563:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827580.051566:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827580.051569:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787827580.051579:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9e00 x1874670272901888/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827580.051586:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827580.051588:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787827580.051590:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827580.051592:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2743
00000100:00080000:0.0:1787827580.051594:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827580.051596:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827580.051600:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:3.0:1787827580.051602:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827580.051610:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb0c0 x1874670272902016/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827580.051618:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827580.051620:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787827580.051621:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827580.051623:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2743
00000100:00080000:0.0:1787827580.051626:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827580.051628:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827580.051631:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787827580.051639:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827580/real 1787827580]  req@ffff9ee0056e9680 x1874670272901632/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827605 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827580.051641:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ea940 x1874670272902144/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827580.051669:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827580.051671:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787827580.051673:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1787827580.051675:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9680 x1874670272901632/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827605 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827580.051679:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2743
00000100:00080000:0.0:1787827580.051684:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827580.051691:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00080000:3.0:1787827580.051694:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000008:00100000:0.0:1787827580.051706:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:3.0:1787827580.051710:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827580.051715:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272901632:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787827580.051718:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ead00 x1874670272902272/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827580.051725:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827580.051728:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787827580.051729:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827580.051732:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2743
00000100:00080000:0.0:1787827580.051734:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1787827580.051736:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272901760:192.168.203.121@tcp:38:kworker.0
00000100:00080000:0.0:1787827580.051739:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827580.051744:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787827580.051753:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ea580 x1874670272902400/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1787827580.051771:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827580.051788:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827580/real 1787827580]  req@ffff9ee0056e8b40 x1874670272901760/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827605 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827580.051800:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8b40 x1874670272901760/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827605 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827580.051806:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827580.051808:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827580.051811:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272901760:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787827580.051816:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272901888:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827580.051831:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827580.051839:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827580/real 1787827580]  req@ffff9ee0056e9e00 x1874670272901888/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827605 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827580.051846:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9e00 x1874670272901888/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827605 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827580.051851:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827580.051853:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827580.051856:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272901888:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787827580.051859:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272902016:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827580.051869:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827580.051874:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827580/real 1787827580]  req@ffff9ee0056eb0c0 x1874670272902016/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827605 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827580.051889:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb0c0 x1874670272902016/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827605 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827580.051894:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827580.051897:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827580.051899:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272902016:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787827580.051902:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272902144:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787827580.051912:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827580.051918:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827580/real 1787827580]  req@ffff9ee0056ea940 x1874670272902144/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827605 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827580.051926:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ea940 x1874670272902144/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827605 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827580.051931:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827580.051932:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827580.051934:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272902144:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787827580.051937:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272902272:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827580.051947:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827580.051952:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827580/real 1787827580]  req@ffff9ee0056ead00 x1874670272902272/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827605 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827580.051960:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ead00 x1874670272902272/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827605 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827580.051964:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827580.051966:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827580.051968:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272902272:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787827580.051980:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272902400:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827580.051990:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827580.051996:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827580/real 1787827580]  req@ffff9ee0056ea580 x1874670272902400/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827605 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827580.052003:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ea580 x1874670272902400/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827605 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827580.052012:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827580.052014:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827580.052016:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272902400:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827580.883573:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827581.075415:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787827581.907478:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827582.099482:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827582.931509:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827583.123388:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827583.955573:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827584.147413:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827584.979547:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827585.171381:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:0.0:1787827585.171390:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827585.171396:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1787827585.171399:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827585.171407:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2748
00000100:00080000:0.0:1787827585.171416:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827585.171422:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787827585.171453:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8780 x1874670272902528/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827585.171475:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827585.171479:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787827585.171481:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827585.171485:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2748
00000100:00080000:0.0:1787827585.171489:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827585.171494:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827585.171504:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787827585.171504:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272902528:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787827585.171523:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9a40 x1874670272902656/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827585.171533:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827585.171535:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787827585.171537:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827585.171540:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2748
00000100:00080000:0.0:1787827585.171544:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827585.171547:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827585.171551:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787827585.171560:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ea580 x1874670272902784/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827585.171567:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827585.171569:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787827585.171571:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827585.171573:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2748
00000100:00080000:0.0:1787827585.171576:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827585.171578:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827585.171581:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787827585.171589:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ead00 x1874670272902912/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827585.171595:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827585.171597:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787827585.171598:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827585.171602:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2748
00000100:00080000:0.0:1787827585.171606:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827585.171611:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787827585.171611:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272902656:192.168.203.121@tcp:38:kworker.0
00000008:00100000:0.0:1787827585.171618:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787827585.171629:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ea940 x1874670272903040/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827585.171639:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827585.171641:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787827585.171643:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827585.171646:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2748
00000100:00100000:3.0:1787827585.171648:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272902784:192.168.203.121@tcp:8:kworker.0
00000100:00080000:0.0:1787827585.171651:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827585.171654:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827585.171658:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787827585.171670:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb0c0 x1874670272903168/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827585.171677:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827585.171680:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787827585.171681:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1787827585.171685:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272902912:192.168.203.121@tcp:8:kworker.0
00000100:00080000:0.0:1787827585.171688:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2748
00000100:00080000:0.0:1787827585.171693:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827585.171695:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827585.171699:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787827585.171708:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9e00 x1874670272903296/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787827585.171713:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272903040:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787827585.171738:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272903168:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787827585.171753:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272903296:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827586.003589:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827586.195404:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787827587.027583:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827587.219439:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827588.051513:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827588.243396:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000400:00000100:1.0:1787827588.243523:0:2353:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.203.121:988
00000400:00000100:1.0:1787827588.243569:0:2353:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.203.121@tcp at host 192.168.203.121 was unreachable: the network or that node may be down, or Lustre may be misconfigured.
00000800:00000100:1.0:1787827588.243584:0:2353:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:1.0:1787827588.243615:0:2353:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:1.0:1787827588.243621:0:2353:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:1.0:1787827588.243627:0:2353:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:1.0:1787827588.243635:0:2353:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:1.0:1787827588.243643:0:2353:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:1.0:1787827588.243651:0:2353:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000100:00100000:3.0:1787827588.243658:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827585/real 1787827588]  req@ffff9ee0056ea940 x1874670272903040/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827610 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827588.243678:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ea940 x1874670272903040/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827610 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827588.243688:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827588.243693:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827588.243698:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272903040:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787827588.243705:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827585/real 1787827588]  req@ffff9ee0056eb0c0 x1874670272903168/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827610 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827588.243719:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb0c0 x1874670272903168/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827610 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827588.243727:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827588.243731:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827588.243734:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272903168:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787827588.243740:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827585/real 1787827588]  req@ffff9ee0056e9a40 x1874670272902656/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827610 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827588.243752:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9a40 x1874670272902656/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827610 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827588.243760:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827588.243764:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827588.243767:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272902656:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787827588.243777:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827585/real 1787827588]  req@ffff9ee0056ea580 x1874670272902784/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827610 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827588.243790:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ea580 x1874670272902784/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827610 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827588.243798:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827588.243802:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827588.243805:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272902784:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787827588.243812:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827585/real 1787827588]  req@ffff9ee0056ead00 x1874670272902912/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827610 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827588.243825:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ead00 x1874670272902912/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827610 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827588.243833:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827588.243837:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827588.243840:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272902912:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787827588.243847:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827585/real 1787827588]  req@ffff9ee0056e8780 x1874670272902528/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827610 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827588.243860:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8780 x1874670272902528/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827610 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827588.243868:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827588.243872:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827588.243875:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272902528:192.168.203.121@tcp:250:kworker.0
00000100:00100000:3.0:1787827588.243904:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827585/real 1787827588]  req@ffff9ee0056e9e00 x1874670272903296/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827610 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827588.243917:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9e00 x1874670272903296/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827610 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827588.243936:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827588.243943:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827588.243947:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272903296:192.168.203.121@tcp:8:kworker.0
00010000:00010000:3.0:1787827589.075472:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827589.267407:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827590.099530:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827590.291468:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:1.0:1787827590.291518:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827590.291527:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1787827590.291533:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827590.291545:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2754
00000100:00080000:1.0:1787827590.291559:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827590.291581:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787827590.291611:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a3480 x1874670272903424/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827590.291631:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827590.291635:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787827590.291637:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827590.291641:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2754
00000100:00080000:1.0:1787827590.291645:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827590.291650:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827590.291659:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787827590.291669:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272903424:192.168.203.121@tcp:250:kworker.0
00000100:00100000:1.0:1787827590.291671:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a12c0 x1874670272903552/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827590.291681:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827590.291684:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787827590.291686:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827590.291689:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2754
00000100:00080000:1.0:1787827590.291692:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827590.291695:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827590.291700:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787827590.291709:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1a40 x1874670272903680/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827590.291717:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827590.291720:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787827590.291722:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827590.291725:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2754
00000800:00000100:3.0:1787827590.291726:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:1.0:1787827590.291728:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827590.291731:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827590.291735:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787827590.291743:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a3c00 x1874670272903808/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827590.291751:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827590.291754:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787827590.291755:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827590.291759:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2754
00000100:00080000:1.0:1787827590.291762:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1787827590.291762:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827590/real 1787827590]  req@ffff9ee0056a3480 x1874670272903424/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827615 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827590.291766:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827590.291770:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787827590.291779:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a2940 x1874670272903936/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787827590.291779:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a3480 x1874670272903424/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827615 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827590.291790:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827590.291791:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827590.291793:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787827590.291795:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827590.291795:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:1.0:1787827590.291799:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2754
00000100:00100000:3.0:1787827590.291799:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272903424:192.168.203.121@tcp:250:kworker.0
00000100:00080000:1.0:1787827590.291802:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827590.291805:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827590.291809:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787827590.291817:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1680 x1874670272904064/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787827590.291820:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272903552:192.168.203.121@tcp:38:kworker.0
00000100:00080000:1.0:1787827590.291827:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827590.291830:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787827590.291839:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827590.291842:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2754
00000100:00080000:1.0:1787827590.291846:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827590.291850:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000800:00000100:3.0:1787827590.291854:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000008:00100000:1.0:1787827590.291855:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787827590.291865:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0f00 x1874670272904192/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787827590.291869:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827590/real 1787827590]  req@ffff9ee0056a12c0 x1874670272903552/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827615 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827590.291881:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a12c0 x1874670272903552/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827615 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827590.291890:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827590.291894:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827590.291897:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272903552:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787827590.291904:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272903680:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827590.291926:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827590.291937:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827590/real 1787827590]  req@ffff9ee0056a1a40 x1874670272903680/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827615 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827590.291953:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1a40 x1874670272903680/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827615 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827590.291960:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827590.291963:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827590.291966:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272903680:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787827590.291973:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272903808:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827590.291991:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827590.292001:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827590/real 1787827590]  req@ffff9ee0056a3c00 x1874670272903808/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827615 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827590.292012:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a3c00 x1874670272903808/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827615 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827590.292020:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827590.292023:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827590.292026:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272903808:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787827590.292032:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272903936:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787827590.292051:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827590.292061:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827590/real 1787827590]  req@ffff9ee0056a2940 x1874670272903936/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827615 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827590.292072:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a2940 x1874670272903936/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827615 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827590.292080:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827590.292083:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827590.292085:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272903936:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787827590.292120:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272904064:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827590.292143:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827590.292155:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827590/real 1787827590]  req@ffff9ee0056a1680 x1874670272904064/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827615 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827590.292167:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1680 x1874670272904064/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827615 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827590.292175:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827590.292178:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827590.292181:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272904064:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787827590.292188:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272904192:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827590.292208:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827590.292220:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827590/real 1787827590]  req@ffff9ee0056a0f00 x1874670272904192/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827615 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827590.292232:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0f00 x1874670272904192/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827615 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827590.292240:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827590.292244:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827590.292247:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272904192:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827591.123435:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827591.315403:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787827592.147545:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827592.339472:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827593.171515:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827593.363442:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827594.195548:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827594.387406:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827595.219450:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827595.411426:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:0.0:1787827595.411435:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827595.411441:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1787827595.411445:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827595.411452:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2759
00000100:00080000:0.0:1787827595.411461:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827595.411467:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787827595.411500:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8b40 x1874670272904320/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827595.411528:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827595.411531:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787827595.411532:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827595.411535:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2759
00000100:00080000:0.0:1787827595.411538:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827595.411541:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827595.411549:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787827595.411557:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272904320:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787827595.411560:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9680 x1874670272904448/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827595.411570:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827595.411572:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787827595.411574:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827595.411576:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2759
00000100:00080000:0.0:1787827595.411579:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827595.411581:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827595.411584:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787827595.411592:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e92c0 x1874670272904576/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827595.411598:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827595.411600:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787827595.411601:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827595.411604:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2759
00000100:00080000:0.0:1787827595.411607:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827595.411620:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827595.411623:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:3.0:1787827595.411627:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827595.411639:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb840 x1874670272904704/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827595.411651:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827595.411654:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787827595.411656:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827595.411659:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2759
00000100:00080000:0.0:1787827595.411662:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1787827595.411664:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827595/real 1787827595]  req@ffff9ee0056e8b40 x1874670272904320/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827620 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827595.411670:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827595.411681:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787827595.411687:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8b40 x1874670272904320/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827620 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827595.411700:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb480 x1874670272904832/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827595.411703:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827595.411711:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827595.411719:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272904320:192.168.203.121@tcp:250:kworker.0
00000100:00080000:0.0:1787827595.411721:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827595.411726:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787827595.411728:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827595.411732:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2759
00000100:00080000:0.0:1787827595.411735:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827595.411739:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787827595.411742:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272904448:192.168.203.121@tcp:38:kworker.0
00000008:00100000:0.0:1787827595.411745:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787827595.411758:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8000 x1874670272904960/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1787827595.411765:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:0.0:1787827595.411773:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827595.411776:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787827595.411777:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1787827595.411780:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827595/real 1787827595]  req@ffff9ee0056e9680 x1874670272904448/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827620 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827595.411782:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2759
00000100:00080000:0.0:1787827595.411789:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827595.411794:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787827595.411798:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9680 x1874670272904448/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827620 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:0.0:1787827595.411799:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:3.0:1787827595.411811:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:0.0:1787827595.411814:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e83c0 x1874670272905088/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827595.411817:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827595.411824:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272904448:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787827595.411834:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272904576:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827595.411855:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827595.411866:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827595/real 1787827595]  req@ffff9ee0056e92c0 x1874670272904576/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827620 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827595.411879:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e92c0 x1874670272904576/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827620 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827595.411888:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827595.411891:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827595.411895:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272904576:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787827595.411901:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272904704:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827595.411916:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827595.411926:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827595/real 1787827595]  req@ffff9ee0056eb840 x1874670272904704/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827620 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827595.411933:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb840 x1874670272904704/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827620 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827595.411938:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827595.411940:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827595.411943:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272904704:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787827595.411946:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272904832:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787827595.411956:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827595.411961:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827595/real 1787827595]  req@ffff9ee0056eb480 x1874670272904832/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827620 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827595.411968:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb480 x1874670272904832/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827620 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827595.411973:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827595.411975:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827595.411976:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272904832:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787827595.411987:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272904960:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827595.411997:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827595.412003:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827595/real 1787827595]  req@ffff9ee0056e8000 x1874670272904960/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827620 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827595.412011:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8000 x1874670272904960/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827620 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827595.412015:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827595.412017:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827595.412019:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272904960:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787827595.412022:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272905088:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827595.412031:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827595.412036:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827595/real 1787827595]  req@ffff9ee0056e83c0 x1874670272905088/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827620 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827595.412043:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e83c0 x1874670272905088/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827620 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827595.412048:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827595.412050:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827595.412052:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272905088:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827596.243530:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827596.435434:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787827597.267535:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827597.459486:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827598.291526:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827598.483418:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827599.315525:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827599.507470:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827600.339845:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827600.531413:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:2.0:1787827600.531451:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827600.531458:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787827600.531462:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827600.531481:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2764
00000100:00080000:2.0:1787827600.531492:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827600.531499:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787827600.531536:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b840 x1874670272905216/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827600.531562:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827600.531565:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787827600.531567:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827600.531570:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2764
00000100:00080000:2.0:1787827600.531573:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827600.531577:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827600.531604:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787827600.531612:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272905216:192.168.203.121@tcp:250:kworker.0
00000100:00100000:2.0:1787827600.531620:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057283c0 x1874670272905344/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827600.531632:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827600.531635:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787827600.531638:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827600.531641:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2764
00000100:00080000:2.0:1787827600.531644:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827600.531647:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827600.531652:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787827600.531662:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729e00 x1874670272905472/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827600.531670:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827600.531673:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787827600.531675:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827600.531679:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2764
00000100:00080000:2.0:1787827600.531682:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827600.531693:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827600.531696:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787827600.531707:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728000 x1874670272905600/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1787827600.531709:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:2.0:1787827600.531719:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827600.531722:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787827600.531724:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827600.531728:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2764
00000100:00080000:2.0:1787827600.531732:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827600.531735:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827600.531739:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787827600.531759:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a580 x1874670272905728/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827600.531772:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827600.531778:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00100000:3.0:1787827600.531780:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827600/real 1787827600]  req@ffff9ee00572b840 x1874670272905216/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827625 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827600.531783:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827600.531796:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2764
00000100:00080000:2.0:1787827600.531805:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1787827600.531811:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b840 x1874670272905216/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827625 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827600.531818:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827600.531833:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:3.0:1787827600.531834:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827600.531842:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827600.531847:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272905216:192.168.203.121@tcp:250:kworker.0
00000100:00100000:2.0:1787827600.531857:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728b40 x1874670272905856/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827600.531868:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827600.531872:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:3.0:1787827600.531876:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272905344:192.168.203.121@tcp:38:kworker.0
00000100:00080000:2.0:1787827600.531877:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827600.531897:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2764
00000100:00080000:2.0:1787827600.531901:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827600.531905:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827600.531910:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:3.0:1787827600.531923:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827600.531927:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b0c0 x1874670272905984/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787827600.531942:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827600/real 1787827600]  req@ffff9ee0057283c0 x1874670272905344/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827625 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827600.531962:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057283c0 x1874670272905344/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827625 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827600.531969:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827600.531972:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827600.531975:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272905344:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787827600.531981:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272905472:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827600.531996:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827600.532005:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827600/real 1787827600]  req@ffff9ee005729e00 x1874670272905472/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827625 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827600.532041:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729e00 x1874670272905472/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827625 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827600.532062:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827600.532065:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827600.532068:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272905472:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787827600.532074:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272905600:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827600.532093:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827600.532103:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827600/real 1787827600]  req@ffff9ee005728000 x1874670272905600/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827625 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827600.532113:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728000 x1874670272905600/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827625 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827600.532119:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827600.532122:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827600.532125:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272905600:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787827600.532129:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272905728:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787827600.532142:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827600.532149:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827600/real 1787827600]  req@ffff9ee00572a580 x1874670272905728/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827625 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827600.532158:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a580 x1874670272905728/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827625 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827600.532170:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827600.532173:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827600.532175:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272905728:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787827600.532180:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272905856:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827600.532192:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827600.532199:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827600/real 1787827600]  req@ffff9ee005728b40 x1874670272905856/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827625 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827600.532208:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728b40 x1874670272905856/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827625 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827600.532215:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827600.532217:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827600.532219:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272905856:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787827600.532237:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272905984:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827600.532250:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827600.532258:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827600/real 1787827600]  req@ffff9ee00572b0c0 x1874670272905984/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827625 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827600.532276:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b0c0 x1874670272905984/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827625 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827600.532282:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827600.532285:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827600.532288:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272905984:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827601.363502:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827601.555442:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787827602.387601:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827602.579449:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827603.411571:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827603.603418:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827604.435536:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827604.627477:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827605.459542:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1787827605.651407:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827605.651419:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787827605.651424:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827605.651435:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2769
00000100:00080000:2.0:1787827605.651448:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1787827605.651453:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:2.0:1787827605.651459:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787827605.651522:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b480 x1874670272906112/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827605.651560:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827605.651564:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787827605.651566:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827605.651573:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2769
00000100:00080000:2.0:1787827605.651579:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827605.651584:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787827605.651606:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272906112:192.168.203.121@tcp:250:kworker.0
00000008:00100000:2.0:1787827605.651622:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787827605.651641:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572ad00 x1874670272906240/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827605.651654:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827605.651657:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787827605.651658:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827605.651661:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2769
00000100:00080000:2.0:1787827605.651665:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827605.651668:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827605.651673:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:3.0:1787827605.651678:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827605.651683:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729a40 x1874670272906368/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827605.651695:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827605.651698:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787827605.651701:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827605.651704:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2769
00000100:00080000:2.0:1787827605.651708:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827605.651711:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827605.651716:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787827605.651725:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b0c0 x1874670272906496/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787827605.651746:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827605/real 1787827605]  req@ffff9ee00572b480 x1874670272906112/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827630 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827605.651766:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827605.651782:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787827605.651787:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827605.651799:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2769
00000100:00080000:2.0:1787827605.651806:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827605.651810:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787827605.651815:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b480 x1874670272906112/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827630 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:2.0:1787827605.651819:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787827605.651848:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728b40 x1874670272906624/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827605.651848:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827605.651874:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827605.651881:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:2.0:1787827605.651884:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787827605.651891:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1787827605.651894:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272906112:192.168.203.121@tcp:250:kworker.0
00000100:00080000:2.0:1787827605.651902:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2769
00000100:00080000:2.0:1787827605.651908:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827605.651913:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827605.651918:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787827605.651935:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a580 x1874670272906752/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787827605.651940:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272906240:192.168.203.121@tcp:38:kworker.0
00000100:00080000:2.0:1787827605.651971:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827605.651975:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787827605.651977:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827605.651984:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2769
00000100:00080000:2.0:1787827605.652037:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827605.652043:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000800:00000100:3.0:1787827605.652051:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000008:00100000:2.0:1787827605.652055:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827605.652070:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827605/real 1787827605]  req@ffff9ee00572ad00 x1874670272906240/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827630 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827605.652071:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728000 x1874670272906880/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787827605.652132:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572ad00 x1874670272906240/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827630 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827605.652149:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827605.652154:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827605.652157:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272906240:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787827605.652175:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272906368:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827605.652203:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827605.652221:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827605/real 1787827605]  req@ffff9ee005729a40 x1874670272906368/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827630 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827605.652232:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729a40 x1874670272906368/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827630 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827605.652240:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827605.652243:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827605.652246:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272906368:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787827605.652252:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272906496:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827605.652281:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827605.652292:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827605/real 1787827605]  req@ffff9ee00572b0c0 x1874670272906496/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827630 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827605.652303:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b0c0 x1874670272906496/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827630 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827605.652310:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827605.652349:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827605.652356:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272906496:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787827605.652366:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272906624:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787827605.652399:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827605.652433:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827605/real 1787827605]  req@ffff9ee005728b40 x1874670272906624/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827630 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827605.652444:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728b40 x1874670272906624/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827630 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827605.652451:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827605.652460:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827605.652463:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272906624:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787827605.652483:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272906752:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827605.652517:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827605.652526:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827605/real 1787827605]  req@ffff9ee00572a580 x1874670272906752/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827630 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827605.652535:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a580 x1874670272906752/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827630 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827605.652541:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827605.652543:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827605.652546:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272906752:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787827605.652550:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272906880:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827605.652562:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827605.652569:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827605/real 1787827605]  req@ffff9ee005728000 x1874670272906880/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827630 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827605.652577:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728000 x1874670272906880/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827630 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827605.652583:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827605.652586:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827605.652588:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272906880:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827606.483511:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827606.675403:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787827607.507548:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827607.699446:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827608.531610:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827608.723439:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827609.555540:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827609.747413:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827610.579680:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1787827610.771500:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1787827610.771501:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:1.0:1787827610.771536:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1787827610.771543:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827610.771557:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2774
00000100:00080000:1.0:1787827610.771573:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827610.771606:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787827610.771654:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a21c0 x1874670272907008/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827610.771687:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827610.771691:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787827610.771692:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827610.771696:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2774
00000100:00080000:1.0:1787827610.771699:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827610.771702:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827610.771714:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787827610.771726:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0f00 x1874670272907136/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827610.771737:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1787827610.771738:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272907008:192.168.203.121@tcp:250:kworker.0
00000100:00080000:1.0:1787827610.771742:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787827610.771746:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827610.771754:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2774
00000100:00080000:1.0:1787827610.771758:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827610.771763:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827610.771770:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787827610.771786:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1680 x1874670272907264/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827610.771799:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827610.771804:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787827610.771807:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827610.771811:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2774
00000100:00080000:1.0:1787827610.771816:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827610.771820:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827610.771826:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787827610.771837:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a2940 x1874670272907392/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827610.771844:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827610.771847:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787827610.771849:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827610.771852:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2774
00000100:00080000:1.0:1787827610.771854:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827610.771857:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827610.771859:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787827610.771866:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a3c00 x1874670272907520/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827610.771872:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827610.771875:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787827610.771877:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827610.771879:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2774
00000100:00080000:1.0:1787827610.771881:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827610.771884:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827610.771886:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787827610.771892:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1a40 x1874670272907648/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827610.771903:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827610.771906:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787827610.771907:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827610.771910:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2774
00000100:00080000:1.0:1787827610.771912:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827610.771914:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827610.771916:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787827610.771922:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a12c0 x1874670272907776/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1787827610.772002:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827610.772098:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827610/real 1787827610]  req@ffff9ee0056a21c0 x1874670272907008/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827635 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827610.772122:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a21c0 x1874670272907008/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827635 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827610.772133:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827610.772137:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827610.772141:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272907008:192.168.203.121@tcp:250:kworker.0
00000100:00100000:3.0:1787827610.772175:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272907136:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787827610.772224:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827610.772237:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827610/real 1787827610]  req@ffff9ee0056a0f00 x1874670272907136/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827635 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827610.772259:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0f00 x1874670272907136/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827635 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827610.772267:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827610.772270:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827610.772273:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272907136:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787827610.772279:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272907264:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827610.772296:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827610.772303:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827610/real 1787827610]  req@ffff9ee0056a1680 x1874670272907264/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827635 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827610.772341:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1680 x1874670272907264/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827635 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827610.772349:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827610.772352:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827610.772355:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272907264:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787827610.772361:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272907392:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827610.772378:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827610.772387:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827610/real 1787827610]  req@ffff9ee0056a2940 x1874670272907392/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827635 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827610.772398:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a2940 x1874670272907392/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827635 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827610.772404:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827610.772407:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827610.772410:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272907392:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787827610.772415:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272907520:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787827610.772428:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827610.772435:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827610/real 1787827610]  req@ffff9ee0056a3c00 x1874670272907520/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827635 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827610.772454:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a3c00 x1874670272907520/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827635 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827610.772460:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827610.772463:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827610.772465:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272907520:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787827610.772470:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272907648:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827610.772483:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827610.772490:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827610/real 1787827610]  req@ffff9ee0056a1a40 x1874670272907648/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827635 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827610.772505:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1a40 x1874670272907648/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827635 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827610.772524:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827610.772528:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827610.772532:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272907648:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787827610.772542:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272907776:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827610.772581:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827610.772593:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827610/real 1787827610]  req@ffff9ee0056a12c0 x1874670272907776/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827635 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827610.772604:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a12c0 x1874670272907776/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827635 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827610.772611:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827610.772614:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827610.772617:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272907776:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827611.603547:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827611.795446:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787827612.627539:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827612.819515:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827613.651527:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827613.843417:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827614.675567:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827614.867411:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827615.699551:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1787827615.891417:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827615.891447:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1787827615.891453:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1787827615.891467:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:1.0:1787827615.891470:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2779
00000100:00080000:1.0:1787827615.891490:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827615.891503:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787827615.891551:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a3480 x1874670272907904/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827615.891583:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827615.891588:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787827615.891590:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827615.891594:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2779
00000100:00080000:1.0:1787827615.891599:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827615.891603:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827615.891616:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787827615.891636:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0b40 x1874670272908032/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787827615.891637:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272907904:192.168.203.121@tcp:250:kworker.0
00000100:00080000:1.0:1787827615.891667:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827615.891674:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787827615.891677:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827615.891686:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2779
00000100:00080000:1.0:1787827615.891696:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827615.891704:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827615.891714:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:3.0:1787827615.891726:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827615.891739:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a2580 x1874670272908160/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827615.891753:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827615.891757:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787827615.891760:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827615.891765:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2779
00000100:00080000:1.0:1787827615.891771:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827615.891777:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787827615.891783:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827615/real 1787827615]  req@ffff9ee0056a3480 x1874670272907904/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827640 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:1.0:1787827615.891787:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787827615.891825:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a03c0 x1874670272908288/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787827615.891835:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a3480 x1874670272907904/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827640 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827615.891840:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827615.891851:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787827615.891856:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827615.891863:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827615.891864:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2779
00000100:00080000:1.0:1787827615.891874:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827615.891877:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:1.0:1787827615.891883:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787827615.891887:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272907904:192.168.203.121@tcp:250:kworker.0
00000008:00100000:1.0:1787827615.891891:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787827615.891905:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1e00 x1874670272908416/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827615.891935:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1787827615.891939:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272908032:192.168.203.121@tcp:38:kworker.0
00000100:00080000:1.0:1787827615.891941:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787827615.891946:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827615.891953:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2779
00000100:00080000:1.0:1787827615.891958:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827615.891962:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827615.891968:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:3.0:1787827615.891976:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827615.891986:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0000 x1874670272908544/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787827615.891996:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827615/real 1787827615]  req@ffff9ee0056a0b40 x1874670272908032/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827640 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827615.892000:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827615.892009:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787827615.892014:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827615.892024:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2779
00000100:00080000:1.0:1787827615.892028:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1787827615.892032:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0b40 x1874670272908032/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827640 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827615.892036:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827615.892044:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:3.0:1787827615.892050:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827615.892054:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827615.892057:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272908032:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787827615.892063:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272908160:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827615.892081:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827615.892090:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827615/real 1787827615]  req@ffff9ee0056a2580 x1874670272908160/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827640 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827615.892101:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a2580 x1874670272908160/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827640 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827615.892121:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0780 x1874670272908672/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827615.892123:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827615.892134:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827615.892145:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272908160:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787827615.892155:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272908288:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827615.892173:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827615.892181:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827615/real 1787827615]  req@ffff9ee0056a03c0 x1874670272908288/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827640 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827615.892191:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a03c0 x1874670272908288/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827640 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827615.892198:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827615.892201:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827615.892203:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272908288:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787827615.892219:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272908416:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787827615.892233:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827615.892241:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827615/real 1787827615]  req@ffff9ee0056a1e00 x1874670272908416/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827640 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827615.892251:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1e00 x1874670272908416/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827640 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827615.892258:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827615.892260:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827615.892264:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272908416:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787827615.892269:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272908544:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827615.892282:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827615.892289:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827615/real 1787827615]  req@ffff9ee0056a0000 x1874670272908544/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827640 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827615.892298:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0000 x1874670272908544/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827640 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827615.892305:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827615.892307:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827615.892310:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272908544:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787827615.892337:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272908672:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827615.892382:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827615.892401:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827615/real 1787827615]  req@ffff9ee0056a0780 x1874670272908672/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827640 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827615.892421:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0780 x1874670272908672/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827640 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827615.892436:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827615.892442:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827615.892447:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272908672:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827616.723429:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827616.915435:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787827617.747576:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827617.939390:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827618.771596:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827618.963395:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827619.795526:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827619.987392:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827620.819552:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827621.011363:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:0.0:1787827621.012387:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827621.012394:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1787827621.012398:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827621.012407:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2784
00000100:00080000:0.0:1787827621.012418:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827621.012425:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787827621.012458:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8f00 x1874670272908800/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827621.012484:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827621.012493:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787827621.012495:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827621.012500:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2784
00000100:00080000:0.0:1787827621.012505:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827621.012513:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787827621.012513:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272908800:192.168.203.121@tcp:250:kworker.0
00000008:00100000:0.0:1787827621.012522:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787827621.012536:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ebc00 x1874670272908928/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827621.012545:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827621.012550:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787827621.012552:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827621.012554:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2784
00000100:00080000:0.0:1787827621.012560:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827621.012562:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827621.012566:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:3.0:1787827621.012570:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827621.012576:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e83c0 x1874670272909056/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827621.012585:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827621.012587:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787827621.012588:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827621.012590:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2784
00000100:00080000:0.0:1787827621.012593:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827621.012596:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827621.012599:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827621.012603:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827621/real 1787827621]  req@ffff9ee0056e8f00 x1874670272908800/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827646 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827621.012610:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8000 x1874670272909184/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787827621.012622:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8f00 x1874670272908800/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827646 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827621.012624:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827621.012634:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787827621.012638:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827621.012639:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827621.012646:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:0.0:1787827621.012650:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2784
00000100:00080000:0.0:1787827621.012655:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1787827621.012660:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272908800:192.168.203.121@tcp:250:kworker.0
00000100:00080000:0.0:1787827621.012664:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827621.012672:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787827621.012682:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272908928:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787827621.012684:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb480 x1874670272909312/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827621.012695:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827621.012698:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787827621.012700:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827621.012704:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2784
00000100:00080000:0.0:1787827621.012707:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000800:00000100:3.0:1787827621.012710:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:0.0:1787827621.012714:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827621.012719:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827621.012724:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827621/real 1787827621]  req@ffff9ee0056ebc00 x1874670272908928/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827646 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827621.012730:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb840 x1874670272909440/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787827621.012743:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ebc00 x1874670272908928/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827646 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827621.012744:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827621.012753:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787827621.012758:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827621.012761:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827621.012765:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272908928:192.168.203.121@tcp:38:kworker.0
00000100:00080000:0.0:1787827621.012767:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1787827621.012773:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272909056:192.168.203.121@tcp:8:kworker.0
00000100:00080000:0.0:1787827621.012774:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2784
00000100:00080000:0.0:1787827621.012779:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827621.012782:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827621.012786:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787827621.012797:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e92c0 x1874670272909568/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1787827621.012805:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827621.012816:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827621/real 1787827621]  req@ffff9ee0056e83c0 x1874670272909056/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827646 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827621.012828:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e83c0 x1874670272909056/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827646 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827621.012834:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827621.012836:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827621.012838:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272909056:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787827621.012842:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272909184:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827621.012859:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827621.012870:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827621/real 1787827621]  req@ffff9ee0056e8000 x1874670272909184/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827646 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827621.012899:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8000 x1874670272909184/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827646 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827621.012908:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827621.012911:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827621.012915:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272909184:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787827621.012931:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272909312:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787827621.012953:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827621.012966:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827621/real 1787827621]  req@ffff9ee0056eb480 x1874670272909312/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827646 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827621.012980:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb480 x1874670272909312/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827646 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827621.012989:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827621.012992:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827621.012995:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272909312:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787827621.013002:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272909440:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827621.013020:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827621.013028:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827621/real 1787827621]  req@ffff9ee0056eb840 x1874670272909440/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827646 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827621.013035:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb840 x1874670272909440/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827646 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827621.013041:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827621.013043:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827621.013045:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272909440:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787827621.013048:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272909568:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827621.013057:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827621.013063:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827621/real 1787827621]  req@ffff9ee0056e92c0 x1874670272909568/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827646 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827621.013069:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e92c0 x1874670272909568/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827646 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827621.013078:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827621.013080:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827621.013082:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272909568:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827621.843529:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827622.035372:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787827622.867519:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827623.059373:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827623.891624:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827624.083458:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827624.915563:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787827625.107478:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827625.939572:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1787827626.131427:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827626.131437:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1787827626.131442:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827626.131451:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2789
00000100:00080000:1.0:1787827626.131462:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827626.131470:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787827626.131514:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a30c0 x1874670272909696/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787827626.131515:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:1.0:1787827626.131547:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827626.131551:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787827626.131554:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827626.131561:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2789
00000100:00080000:1.0:1787827626.131564:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827626.131567:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827626.131576:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787827626.131582:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272909696:192.168.203.121@tcp:250:kworker.0
00000100:00100000:1.0:1787827626.131594:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0780 x1874670272909824/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827626.131605:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827626.131609:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787827626.131611:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827626.131615:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2789
00000100:00080000:1.0:1787827626.131619:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827626.131623:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827626.131627:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787827626.131645:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0000 x1874670272909952/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827626.131657:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827626.131678:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787827626.131680:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827626.131684:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2789
00000100:00080000:1.0:1787827626.131692:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827626.131696:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827626.131703:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787827626.131716:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1e00 x1874670272910080/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827626.131742:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827626.131747:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787827626.131749:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827626.131753:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2789
00000100:00080000:1.0:1787827626.131758:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827626.131763:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827626.131768:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787827626.131779:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a03c0 x1874670272910208/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827626.131792:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827626.131795:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787827626.131796:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827626.131799:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2789
00000100:00080000:1.0:1787827626.131801:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827626.131804:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827626.131807:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787827626.131813:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a2580 x1874670272910336/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827626.131820:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827626.131823:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787827626.131824:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827626.131830:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2789
00000100:00080000:1.0:1787827626.131835:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000800:00000100:3.0:1787827626.131835:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:1.0:1787827626.131841:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827626.131863:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787827626.131873:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0b40 x1874670272910464/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787827626.131941:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827626/real 1787827626]  req@ffff9ee0056a30c0 x1874670272909696/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827651 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827626.131961:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a30c0 x1874670272909696/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827651 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827626.131971:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827626.131975:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827626.131979:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272909696:192.168.203.121@tcp:250:kworker.0
00000100:00100000:3.0:1787827626.132005:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272909824:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787827626.132046:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827626.132057:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827626/real 1787827626]  req@ffff9ee0056a0780 x1874670272909824/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827651 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827626.132072:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0780 x1874670272909824/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827651 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827626.132079:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827626.132082:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827626.132084:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272909824:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787827626.132089:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272909952:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827626.132103:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827626.132110:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827626/real 1787827626]  req@ffff9ee0056a0000 x1874670272909952/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827651 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827626.132119:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0000 x1874670272909952/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827651 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827626.132125:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827626.132127:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827626.132130:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272909952:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787827626.132134:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272910080:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827626.132145:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827626.132151:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827626/real 1787827626]  req@ffff9ee0056a1e00 x1874670272910080/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827651 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827626.132160:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1e00 x1874670272910080/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827651 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827626.132171:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827626.132174:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827626.132176:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272910080:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787827626.132180:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272910208:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787827626.132191:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827626.132207:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827626/real 1787827626]  req@ffff9ee0056a03c0 x1874670272910208/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827651 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827626.132215:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a03c0 x1874670272910208/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827651 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827626.132221:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827626.132223:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827626.132226:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272910208:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787827626.132230:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272910336:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827626.132242:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827626.132248:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827626/real 1787827626]  req@ffff9ee0056a2580 x1874670272910336/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827651 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827626.132257:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a2580 x1874670272910336/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827651 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827626.132263:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827626.132265:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827626.132268:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272910336:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787827626.132272:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272910464:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827626.132284:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827626.132291:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827626/real 1787827626]  req@ffff9ee0056a0b40 x1874670272910464/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827651 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827626.132299:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0b40 x1874670272910464/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827651 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827626.132305:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827626.132307:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827626.132310:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272910464:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827626.963611:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787827627.155449:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787827627.987526:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787827628.179380:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827629.011514:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787827629.203403:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827630.035519:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787827630.227435:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827631.059612:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787827631.251461:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787827631.251543:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827631.251570:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787827631.251580:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827631.251592:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2794
00000100:00080000:3.0:1787827631.251622:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827631.251630:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787827631.251670:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706940 x1874670272910592/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827631.251701:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827631.251705:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787827631.251708:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827631.251711:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2794
00000100:00080000:3.0:1787827631.251715:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827631.251719:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827631.251730:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787827631.251761:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705680 x1874670272910720/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787827631.251771:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272910592:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787827631.251788:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827631.251794:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787827631.251796:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827631.251803:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2794
00000100:00080000:3.0:1787827631.251830:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827631.251837:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827631.251871:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827631.251887:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706d00 x1874670272910848/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827631.251897:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827631.251900:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787827631.251902:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827631.251906:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2794
00000100:00080000:3.0:1787827631.251910:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827631.251913:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827631.251917:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827631.251926:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704000 x1874670272910976/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827631.251935:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827631.251938:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787827631.251939:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827631.251943:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2794
00000100:00080000:3.0:1787827631.251946:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827631.251949:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827631.251952:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787827631.251959:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707c00 x1874670272911104/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827631.251967:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827631.251970:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787827631.251971:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:1.0:1787827631.251978:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787827631.251982:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2794
00000100:00080000:3.0:1787827631.251987:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827631.251991:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827631.251995:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827631.252005:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057070c0 x1874670272911232/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827631.252014:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827631.252017:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787827631.252019:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827631.252023:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2794
00000100:00080000:3.0:1787827631.252027:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827631.252031:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827631.252037:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787827631.252039:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827631/real 1787827631]  req@ffff9ee005706940 x1874670272910592/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827656 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827631.252051:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706580 x1874670272911360/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787827631.252150:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706940 x1874670272910592/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827656 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827631.252168:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827631.252174:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827631.252180:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272910592:192.168.203.121@tcp:250:kworker.0
00000100:00100000:1.0:1787827631.252209:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272910720:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787827631.252241:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827631.252257:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827631/real 1787827631]  req@ffff9ee005705680 x1874670272910720/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827656 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827631.252273:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705680 x1874670272910720/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827656 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827631.252295:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827631.252299:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827631.252303:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272910720:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787827631.252310:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272910848:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827631.252363:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827631.252379:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827631/real 1787827631]  req@ffff9ee005706d00 x1874670272910848/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827656 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827631.252394:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706d00 x1874670272910848/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827656 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827631.252412:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827631.252416:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827631.252420:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272910848:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827631.252427:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272910976:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827631.252450:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827631.252461:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827631/real 1787827631]  req@ffff9ee005704000 x1874670272910976/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827656 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827631.252475:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704000 x1874670272910976/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827656 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827631.252484:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827631.252487:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827631.252491:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272910976:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827631.252497:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272911104:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787827631.252515:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827631.252526:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827631/real 1787827631]  req@ffff9ee005707c00 x1874670272911104/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827656 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827631.252539:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707c00 x1874670272911104/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827656 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827631.252565:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827631.252569:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827631.252574:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272911104:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787827631.252604:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272911232:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827631.252622:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827631.252633:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827631/real 1787827631]  req@ffff9ee0057070c0 x1874670272911232/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827656 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827631.252643:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057070c0 x1874670272911232/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827656 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827631.252650:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827631.252653:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827631.252655:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272911232:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827631.252660:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272911360:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827631.252674:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827631.252682:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827631/real 1787827631]  req@ffff9ee005706580 x1874670272911360/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827656 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827631.252693:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706580 x1874670272911360/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827656 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827631.252700:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827631.252702:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827631.252705:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272911360:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827632.083531:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827632.275428:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787827633.107494:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827633.299442:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827634.131611:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787827634.323447:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827635.155483:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787827635.347421:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827636.179457:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827636.371427:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:2.0:1787827636.371441:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827636.371447:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787827636.371451:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827636.371460:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2800
00000100:00080000:2.0:1787827636.371470:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827636.371476:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787827636.371509:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729e00 x1874670272911488/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827636.371529:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827636.371531:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787827636.371533:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827636.371535:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2800
00000100:00080000:2.0:1787827636.371538:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827636.371540:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827636.371548:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787827636.371557:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057283c0 x1874670272911616/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787827636.371562:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272911488:192.168.203.121@tcp:250:kworker.0
00000100:00080000:2.0:1787827636.371568:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827636.371571:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787827636.371573:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827636.371575:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2800
00000100:00080000:2.0:1787827636.371577:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827636.371579:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827636.371583:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787827636.371590:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b840 x1874670272911744/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827636.371602:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827636.371604:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787827636.371606:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827636.371608:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2800
00000100:00080000:2.0:1787827636.371610:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827636.371612:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827636.371615:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1787827636.371620:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827636.371624:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728f00 x1874670272911872/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827636.371632:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827636.371635:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787827636.371637:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827636.371639:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2800
00000100:00080000:2.0:1787827636.371641:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827636.371643:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827636.371646:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787827636.371655:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827636/real 1787827636]  req@ffff9ee005729e00 x1874670272911488/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827661 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827636.371657:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a1c0 x1874670272912000/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827636.371692:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827636.371695:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787827636.371696:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1787827636.371700:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729e00 x1874670272911488/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827661 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827636.371703:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2800
00000100:00080000:2.0:1787827636.371709:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827636.371715:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827636.371721:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:1.0:1787827636.371722:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827636.371728:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827636.371731:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a940 x1874670272912128/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787827636.371735:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272911488:192.168.203.121@tcp:250:kworker.0
00000100:00080000:2.0:1787827636.371748:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827636.371751:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787827636.371752:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827636.371756:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2800
00000100:00080000:2.0:1787827636.371758:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827636.371759:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827636.371762:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787827636.371767:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728780 x1874670272912256/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787827636.371786:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272911616:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787827636.371834:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827636.371849:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827636/real 1787827636]  req@ffff9ee0057283c0 x1874670272911616/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827661 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827636.371859:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057283c0 x1874670272911616/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827661 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827636.371865:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827636.371868:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827636.371870:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272911616:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787827636.371875:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272911744:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827636.371890:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827636.371897:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827636/real 1787827636]  req@ffff9ee00572b840 x1874670272911744/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827661 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827636.371905:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b840 x1874670272911744/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827661 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827636.371936:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827636.371940:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827636.371944:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272911744:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827636.371951:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272911872:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827636.371972:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827636.371984:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827636/real 1787827636]  req@ffff9ee005728f00 x1874670272911872/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827661 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827636.372014:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728f00 x1874670272911872/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827661 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827636.372022:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827636.372026:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827636.372030:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272911872:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827636.372037:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272912000:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787827636.372056:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827636.372064:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827636/real 1787827636]  req@ffff9ee00572a1c0 x1874670272912000/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827661 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827636.372072:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a1c0 x1874670272912000/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827661 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827636.372078:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827636.372080:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827636.372082:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272912000:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787827636.372086:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272912128:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827636.372097:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827636.372102:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827636/real 1787827636]  req@ffff9ee00572a940 x1874670272912128/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827661 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827636.372110:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a940 x1874670272912128/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827661 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827636.372115:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827636.372117:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827636.372120:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272912128:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827636.372141:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272912256:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827636.372178:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827636.372193:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827636/real 1787827636]  req@ffff9ee005728780 x1874670272912256/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827661 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827636.372206:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728780 x1874670272912256/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827661 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827636.372213:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827636.372215:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827636.372218:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272912256:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827637.203512:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827637.395414:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787827638.227477:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827638.419419:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827639.251493:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827639.443418:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827640.275476:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827640.467421:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827641.299505:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827641.491413:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787827641.491465:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827641.491470:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787827641.491474:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827641.491483:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2805
00000100:00080000:3.0:1787827641.491495:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827641.491505:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787827641.491547:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057043c0 x1874670272912384/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827641.491578:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827641.491582:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787827641.491584:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827641.491587:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2805
00000100:00080000:3.0:1787827641.491591:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827641.491594:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827641.491606:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787827641.491628:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057052c0 x1874670272912512/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787827641.491629:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272912384:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787827641.491659:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827641.491662:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787827641.491665:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827641.491670:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2805
00000100:00080000:3.0:1787827641.491676:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827641.491682:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827641.491687:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827641.491702:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704b40 x1874670272912640/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827641.491710:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827641.491714:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787827641.491719:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:2.0:1787827641.491720:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787827641.491729:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2805
00000100:00080000:3.0:1787827641.491733:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1787827641.491779:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827641/real 1787827641]  req@ffff9ee0057043c0 x1874670272912384/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827666 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827641.491795:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057043c0 x1874670272912384/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827666 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827641.491803:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827641.491807:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827641.491810:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272912384:192.168.203.121@tcp:250:kworker.0
00000100:00100000:2.0:1787827641.491837:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272912512:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787827641.491860:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827641.491874:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827641/real 1787827641]  req@ffff9ee0057052c0 x1874670272912512/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827666 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827641.491888:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057052c0 x1874670272912512/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827666 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827641.491898:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827641.491901:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827641.491905:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272912512:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787827641.491912:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272912640:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787827641.491931:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827641.491939:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827641/real 1787827641]  req@ffff9ee005704b40 x1874670272912640/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827666 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827641.491947:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704b40 x1874670272912640/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827666 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827641.491952:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827641.491954:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827641.491956:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272912640:192.168.203.121@tcp:8:kworker.0
00000100:00080000:3.0:1787827641.492077:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827641.492085:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827641.492097:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707480 x1874670272912768/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787827641.492143:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272912768:192.168.203.121@tcp:8:kworker.0
00000100:00080000:3.0:1787827641.492147:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827641.492151:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787827641.492153:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827641.492160:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2805
00000100:00080000:3.0:1787827641.492173:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827641.492182:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000800:00000100:2.0:1787827641.492183:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000008:00100000:3.0:1787827641.492196:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787827641.492213:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057061c0 x1874670272912896/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787827641.492217:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827641/real 1787827641]  req@ffff9ee005707480 x1874670272912768/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827666 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827641.492235:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827641.492251:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787827641.492258:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827641.492264:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2805
00000100:00100000:2.0:1787827641.492269:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707480 x1874670272912768/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827666 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827641.492271:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827641.492282:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00080000:2.0:1787827641.492289:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000008:00100000:3.0:1787827641.492293:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:2.0:1787827641.492298:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827641.492304:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272912768:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787827641.492309:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705a40 x1874670272913024/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787827641.492349:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272912896:192.168.203.121@tcp:38:kworker.0
00000100:00080000:3.0:1787827641.492358:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827641.492361:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787827641.492365:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827641.492373:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2805
00000100:00080000:3.0:1787827641.492380:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827641.492389:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000800:00000100:2.0:1787827641.492390:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000008:00100000:3.0:1787827641.492402:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787827641.492419:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827641/real 1787827641]  req@ffff9ee0057061c0 x1874670272912896/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827666 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827641.492419:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704780 x1874670272913152/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787827641.492480:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057061c0 x1874670272912896/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827666 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827641.492489:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827641.492493:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827641.492496:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272912896:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787827641.492505:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272913024:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787827641.492517:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827641.492523:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827641/real 1787827641]  req@ffff9ee005705a40 x1874670272913024/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827666 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827641.492535:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705a40 x1874670272913024/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827666 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827641.492540:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827641.492542:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827641.492544:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272913024:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787827641.492548:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272913152:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787827641.492557:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827641.492563:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827641/real 1787827641]  req@ffff9ee005704780 x1874670272913152/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827666 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827641.492570:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704780 x1874670272913152/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827666 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827641.492575:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827641.492576:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827641.492578:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272913152:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827642.323572:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827642.515441:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787827643.347593:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827643.539402:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827644.371438:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827644.563416:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827645.395472:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827645.587380:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827646.419644:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1787827646.611465:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827646.611476:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787827646.611482:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827646.611493:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2810
00000100:00080000:3.0:1787827646.611505:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827646.611516:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787827646.611525:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00100000:3.0:1787827646.611564:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705e00 x1874670272913280/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827646.611589:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827646.611592:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787827646.611594:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827646.611597:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2810
00000100:00080000:3.0:1787827646.611600:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827646.611604:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827646.611614:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787827646.611624:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272913280:192.168.203.121@tcp:250:kworker.0
00000100:00100000:3.0:1787827646.611627:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707840 x1874670272913408/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827646.611646:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827646.611648:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787827646.611649:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827646.611653:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2810
00000100:00080000:3.0:1787827646.611655:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827646.611658:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827646.611664:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827646.611676:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704780 x1874670272913536/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827646.611685:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827646.611688:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787827646.611689:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827646.611691:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2810
00000100:00080000:3.0:1787827646.611695:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827646.611699:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827646.611716:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:2.0:1787827646.611725:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827646.611728:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705a40 x1874670272913664/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827646.611743:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827646.611746:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787827646.611748:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827646.611751:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2810
00000100:00080000:3.0:1787827646.611755:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827646.611759:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827646.611763:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787827646.611771:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827646/real 1787827646]  req@ffff9ee005705e00 x1874670272913280/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827671 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827646.611776:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057061c0 x1874670272913792/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827646.611784:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827646.611797:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787827646.611798:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827646.611812:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2810
00000100:00080000:3.0:1787827646.611822:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827646.611837:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827646.611846:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787827646.611851:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705e00 x1874670272913280/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827671 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827646.611861:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:3.0:1787827646.611863:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707480 x1874670272913920/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827646.611868:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827646.611878:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272913280:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787827646.611899:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827646.611901:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787827646.611903:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827646.611912:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2810
00000100:00100000:2.0:1787827646.611913:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272913408:192.168.203.121@tcp:38:kworker.0
00000100:00080000:3.0:1787827646.611921:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827646.611928:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827646.611933:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:2.0:1787827646.611944:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827646.611948:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704b40 x1874670272914048/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787827646.611960:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827646/real 1787827646]  req@ffff9ee005707840 x1874670272913408/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827671 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827646.611979:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707840 x1874670272913408/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827671 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827646.611989:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827646.611994:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827646.611998:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272913408:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787827646.612006:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272913536:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787827646.612027:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827646.612036:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827646/real 1787827646]  req@ffff9ee005704780 x1874670272913536/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827671 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827646.612044:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704780 x1874670272913536/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827671 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827646.612053:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827646.612056:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827646.612058:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272913536:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787827646.612062:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272913664:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787827646.612073:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827646.612078:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827646/real 1787827646]  req@ffff9ee005705a40 x1874670272913664/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827671 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827646.612085:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705a40 x1874670272913664/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827671 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827646.612090:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827646.612092:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827646.612094:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272913664:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787827646.612098:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272913792:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787827646.612108:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827646.612113:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827646/real 1787827646]  req@ffff9ee0057061c0 x1874670272913792/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827671 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827646.612121:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057061c0 x1874670272913792/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827671 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827646.612125:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827646.612127:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827646.612130:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272913792:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787827646.612134:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272913920:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787827646.612144:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827646.612150:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827646/real 1787827646]  req@ffff9ee005707480 x1874670272913920/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827671 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827646.612157:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707480 x1874670272913920/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827671 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827646.612162:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827646.612163:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827646.612165:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272913920:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787827646.612179:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272914048:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787827646.612189:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827646.612195:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827646/real 1787827646]  req@ffff9ee005704b40 x1874670272914048/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827671 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827646.612201:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704b40 x1874670272914048/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827671 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827646.612206:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827646.612208:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827646.612210:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272914048:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827647.443481:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827647.635404:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787827648.467503:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827648.659429:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827649.491529:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827649.683372:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827650.515514:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827650.707390:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827651.539457:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827651.731368:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787827651.731385:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827651.731390:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787827651.731394:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827651.731402:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2815
00000100:00080000:3.0:1787827651.731411:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827651.731417:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787827651.731447:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057052c0 x1874670272914176/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827651.731471:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827651.731474:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787827651.731475:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827651.731478:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2815
00000100:00080000:3.0:1787827651.731480:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827651.731482:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827651.731489:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787827651.731498:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057043c0 x1874670272914304/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827651.731507:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827651.731510:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787827651.731512:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1787827651.731514:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272914176:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787827651.731518:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2815
00000100:00080000:3.0:1787827651.731525:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827651.731527:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827651.731531:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827651.731540:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706580 x1874670272914432/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827651.731547:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827651.731550:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787827651.731551:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827651.731553:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2815
00000100:00080000:3.0:1787827651.731564:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827651.731566:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827651.731569:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827651.731577:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057070c0 x1874670272914560/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827651.731584:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827651.731586:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787827651.731588:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827651.731590:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2815
00000100:00080000:3.0:1787827651.731592:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827651.731595:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827651.731598:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787827651.731607:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707c00 x1874670272914688/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827651.731615:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1787827651.731616:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272914304:192.168.203.121@tcp:38:kworker.0
00000100:00080000:3.0:1787827651.731618:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787827651.731622:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827651.731627:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2815
00000100:00080000:3.0:1787827651.731630:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827651.731633:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827651.731637:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827651.731645:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704000 x1874670272914816/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787827651.731653:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272914432:192.168.203.121@tcp:8:kworker.0
00000100:00080000:3.0:1787827651.731653:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827651.731659:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787827651.731663:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827651.731681:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2815
00000100:00080000:3.0:1787827651.731684:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827651.731687:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827651.731692:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827651.731719:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706d00 x1874670272914944/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787827651.731729:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272914560:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787827651.731774:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272914688:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787827651.731794:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272914816:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787827651.731829:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272914944:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827652.563559:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827652.755418:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787827653.587541:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827653.779385:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827654.611520:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827654.803401:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000400:00000100:1.0:1787827654.803525:0:2354:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.203.121:988
00000400:00000100:1.0:1787827654.803562:0:2354:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.203.121@tcp at host 192.168.203.121 was unreachable: the network or that node may be down, or Lustre may be misconfigured.
00000800:00000100:1.0:1787827654.803580:0:2354:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:1.0:1787827654.803620:0:2354:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:1.0:1787827654.803630:0:2354:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:1.0:1787827654.803637:0:2354:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:1.0:1787827654.803663:0:2354:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000100:00100000:2.0:1787827654.803670:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827651/real 1787827654]  req@ffff9ee0057043c0 x1874670272914304/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827676 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000800:00000100:1.0:1787827654.803675:0:2354:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:1.0:1787827654.803690:0:2354:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000100:00100000:2.0:1787827654.803707:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057043c0 x1874670272914304/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827676 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827654.803719:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827654.803725:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827654.803730:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272914304:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787827654.803737:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827651/real 1787827654]  req@ffff9ee005706580 x1874670272914432/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827676 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827654.803750:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706580 x1874670272914432/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827676 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827654.803757:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827654.803761:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827654.803764:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272914432:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787827654.803770:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827651/real 1787827654]  req@ffff9ee0057070c0 x1874670272914560/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827676 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827654.803782:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057070c0 x1874670272914560/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827676 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827654.803789:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827654.803792:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827654.803795:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272914560:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787827654.803801:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827651/real 1787827654]  req@ffff9ee0057052c0 x1874670272914176/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827676 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827654.803814:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057052c0 x1874670272914176/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827676 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827654.803821:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827654.803824:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827654.803828:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272914176:192.168.203.121@tcp:250:kworker.0
00000100:00100000:2.0:1787827654.803852:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827651/real 1787827654]  req@ffff9ee005707c00 x1874670272914688/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827676 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827654.803863:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707c00 x1874670272914688/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827676 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827654.803870:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827654.803872:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827654.803875:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272914688:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787827654.803881:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827651/real 1787827654]  req@ffff9ee005704000 x1874670272914816/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827676 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827654.803891:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704000 x1874670272914816/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827676 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827654.803898:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827654.803901:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827654.803904:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272914816:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787827654.803909:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827651/real 1787827654]  req@ffff9ee005706d00 x1874670272914944/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827676 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827654.803919:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706d00 x1874670272914944/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827676 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827654.803927:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827654.803930:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827654.803933:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272914944:192.168.203.121@tcp:8:kworker.0
00010000:00010000:3.0:1787827655.635521:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827655.827463:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827656.659508:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1787827656.851432:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1787827656.851441:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787827656.851446:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787827656.851453:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827656.851466:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2820
00000100:00080000:3.0:1787827656.851480:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827656.851490:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787827656.851534:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705680 x1874670272915072/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827656.851564:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827656.851568:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787827656.851570:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827656.851574:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2820
00000100:00080000:3.0:1787827656.851578:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827656.851584:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827656.851596:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787827656.851608:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272915072:192.168.203.121@tcp:250:kworker.0
00000100:00100000:3.0:1787827656.851612:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706940 x1874670272915200/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827656.851644:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827656.851649:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787827656.851651:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827656.851657:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2820
00000100:00080000:3.0:1787827656.851661:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827656.851666:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827656.851672:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827656.851688:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706d00 x1874670272915328/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827656.851698:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827656.851702:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787827656.851704:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827656.851708:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2820
00000100:00080000:3.0:1787827656.851711:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827656.851717:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000800:00000100:2.0:1787827656.851719:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000008:00100000:3.0:1787827656.851723:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827656.851735:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704000 x1874670272915456/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827656.851744:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827656.851748:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787827656.851750:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827656.851755:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2820
00000100:00080000:3.0:1787827656.851758:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827656.851762:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827656.851767:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787827656.851797:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707c00 x1874670272915584/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787827656.851798:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827656/real 1787827656]  req@ffff9ee005705680 x1874670272915072/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827681 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827656.851824:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827656.851830:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787827656.851832:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827656.851840:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2820
00000100:00100000:2.0:1787827656.851841:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705680 x1874670272915072/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827681 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827656.851853:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827656.851858:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827656.851861:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00080000:2.0:1787827656.851868:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000008:00100000:3.0:1787827656.851872:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787827656.851876:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272915072:192.168.203.121@tcp:250:kworker.0
00000100:00100000:3.0:1787827656.851889:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057052c0 x1874670272915712/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827656.851900:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827656.851904:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787827656.851906:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827656.851913:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2820
00000100:00100000:2.0:1787827656.851914:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272915200:192.168.203.121@tcp:38:kworker.0
00000100:00080000:3.0:1787827656.851917:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827656.851926:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827656.851930:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827656.851944:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057070c0 x1874670272915840/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1787827656.851957:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827656.851980:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827656/real 1787827656]  req@ffff9ee005706940 x1874670272915200/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827681 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827656.851997:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706940 x1874670272915200/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827681 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827656.852006:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827656.852011:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827656.852014:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272915200:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787827656.852022:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272915328:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787827656.852047:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827656.852061:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827656/real 1787827656]  req@ffff9ee005706d00 x1874670272915328/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827681 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827656.852074:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706d00 x1874670272915328/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827681 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827656.852084:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827656.852088:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827656.852092:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272915328:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787827656.852099:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272915456:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787827656.852121:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827656.852133:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827656/real 1787827656]  req@ffff9ee005704000 x1874670272915456/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827681 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827656.852146:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704000 x1874670272915456/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827681 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827656.852155:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827656.852158:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827656.852161:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272915456:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787827656.852168:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272915584:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787827656.852190:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827656.852203:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827656/real 1787827656]  req@ffff9ee005707c00 x1874670272915584/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827681 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827656.852233:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707c00 x1874670272915584/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827681 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827656.852242:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827656.852245:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827656.852249:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272915584:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787827656.852255:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272915712:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787827656.852277:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827656.852291:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827656/real 1787827656]  req@ffff9ee0057052c0 x1874670272915712/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827681 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827656.852304:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057052c0 x1874670272915712/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827681 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827656.852311:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827656.852313:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827656.852344:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272915712:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787827656.852367:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272915840:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787827656.852392:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827656.852404:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827656/real 1787827656]  req@ffff9ee0057070c0 x1874670272915840/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827681 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827656.852416:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057070c0 x1874670272915840/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827681 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827656.852433:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827656.852438:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827656.852441:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272915840:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827657.683484:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827657.875476:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787827658.707511:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827658.899421:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827659.731471:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827659.923443:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827660.755478:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827660.947436:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827661.779544:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1787827661.971438:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1787827661.971440:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787827661.971450:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787827661.971456:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827661.971466:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2825
00000100:00080000:3.0:1787827661.971477:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827661.971484:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787827661.971528:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706580 x1874670272915968/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827661.971553:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827661.971556:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787827661.971557:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827661.971560:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2825
00000100:00080000:3.0:1787827661.971562:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827661.971565:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827661.971575:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787827661.971587:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272915968:192.168.203.121@tcp:250:kworker.0
00000100:00100000:3.0:1787827661.971607:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057043c0 x1874670272916096/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827661.971617:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827661.971620:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787827661.971622:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827661.971625:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2825
00000100:00080000:3.0:1787827661.971628:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827661.971631:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827661.971635:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827661.971647:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704b40 x1874670272916224/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827661.971659:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827661.971661:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787827661.971662:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827661.971664:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2825
00000100:00080000:3.0:1787827661.971666:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000800:00000100:2.0:1787827661.971673:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787827661.971674:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827661.971682:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827661.971692:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707480 x1874670272916352/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827661.971698:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827661.971701:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787827661.971702:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827661.971705:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2825
00000100:00080000:3.0:1787827661.971707:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827661.971711:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827661.971715:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787827661.971722:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827661/real 1787827661]  req@ffff9ee005706580 x1874670272915968/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827686 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827661.971725:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057061c0 x1874670272916480/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827661.971749:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1787827661.971754:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706580 x1874670272915968/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827686 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827661.971756:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787827661.971761:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827661.971770:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827661.971771:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2825
00000100:00080000:2.0:1787827661.971776:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:3.0:1787827661.971779:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1787827661.971780:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272915968:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787827661.971790:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827661.971797:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787827661.971809:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272916096:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787827661.971815:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705a40 x1874670272916608/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827661.971828:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827661.971831:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787827661.971834:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:2.0:1787827661.971835:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787827661.971843:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2825
00000100:00080000:3.0:1787827661.971847:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1787827661.971851:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827661/real 1787827661]  req@ffff9ee0057043c0 x1874670272916096/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827686 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827661.971854:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827661.971862:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827661.971877:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704780 x1874670272916736/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787827661.971880:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057043c0 x1874670272916096/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827686 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827661.971899:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827661.971902:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827661.971905:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272916096:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787827661.971910:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272916224:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787827661.971925:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827661.971931:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827661/real 1787827661]  req@ffff9ee005704b40 x1874670272916224/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827686 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827661.971939:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704b40 x1874670272916224/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827686 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827661.971944:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827661.971946:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827661.971948:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272916224:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787827661.971951:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272916352:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787827661.971962:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827661.971967:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827661/real 1787827661]  req@ffff9ee005707480 x1874670272916352/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827686 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827661.971975:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707480 x1874670272916352/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827686 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827661.971991:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827661.971994:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827661.971998:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272916352:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787827661.972004:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272916480:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787827661.972026:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827661.972037:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827661/real 1787827661]  req@ffff9ee0057061c0 x1874670272916480/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827686 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827661.972046:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057061c0 x1874670272916480/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827686 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827661.972051:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827661.972054:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827661.972056:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272916480:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787827661.972067:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272916608:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787827661.972081:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827661.972087:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827661/real 1787827661]  req@ffff9ee005705a40 x1874670272916608/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827686 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827661.972095:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705a40 x1874670272916608/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827686 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827661.972100:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827661.972102:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827661.972105:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272916608:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787827661.972109:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272916736:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787827661.972119:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827661.972125:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827661/real 1787827661]  req@ffff9ee005704780 x1874670272916736/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827686 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827661.972132:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704780 x1874670272916736/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827686 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827661.972137:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827661.972139:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827661.972140:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272916736:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827662.803503:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827662.995488:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787827663.827512:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827664.019461:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827664.851465:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827665.043413:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827665.875503:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827666.067426:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827666.899489:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1787827667.091399:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827667.091409:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787827667.091413:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1787827667.091416:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787827667.091423:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2830
00000100:00080000:3.0:1787827667.091434:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827667.091442:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787827667.091480:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707840 x1874670272916864/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827667.091508:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827667.091512:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787827667.091514:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827667.091518:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2830
00000100:00080000:3.0:1787827667.091523:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827667.091527:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827667.091538:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787827667.091552:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705e00 x1874670272916992/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787827667.091554:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272916864:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787827667.091582:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827667.091585:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787827667.091586:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827667.091589:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2830
00000100:00080000:3.0:1787827667.091593:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827667.091595:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827667.091600:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827667.091611:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704780 x1874670272917120/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827667.091618:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827667.091621:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787827667.091622:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827667.091625:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2830
00000100:00080000:3.0:1787827667.091627:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827667.091630:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827667.091633:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827667.091643:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705a40 x1874670272917248/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1787827667.091645:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787827667.091654:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827667.091657:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787827667.091658:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827667.091661:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2830
00000100:00080000:3.0:1787827667.091664:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827667.091668:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827667.091671:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787827667.091679:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057061c0 x1874670272917376/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827667.091686:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827667.091689:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787827667.091691:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1787827667.091694:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827667/real 1787827667]  req@ffff9ee005707840 x1874670272916864/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827692 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827667.091695:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2830
00000100:00080000:3.0:1787827667.091701:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827667.091706:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827667.091714:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827667.091725:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707480 x1874670272917504/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787827667.091730:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707840 x1874670272916864/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827692 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827667.091736:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827667.091744:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787827667.091747:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827667.091754:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2830
00000100:00080000:2.0:1787827667.091756:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827667.091757:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827667.091763:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00080000:2.0:1787827667.091767:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000008:00100000:3.0:1787827667.091769:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787827667.091774:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272916864:192.168.203.121@tcp:250:kworker.0
00000100:00100000:3.0:1787827667.091779:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704b40 x1874670272917632/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787827667.091811:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272916992:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787827667.091835:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827667.091847:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827667/real 1787827667]  req@ffff9ee005705e00 x1874670272916992/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827692 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827667.091860:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705e00 x1874670272916992/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827692 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827667.091878:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827667.091881:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827667.091885:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272916992:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787827667.091891:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272917120:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787827667.091912:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827667.091923:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827667/real 1787827667]  req@ffff9ee005704780 x1874670272917120/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827692 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827667.091934:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704780 x1874670272917120/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827692 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827667.091942:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827667.091946:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827667.091949:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272917120:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787827667.091955:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272917248:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787827667.091972:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827667.091981:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827667/real 1787827667]  req@ffff9ee005705a40 x1874670272917248/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827692 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827667.091993:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705a40 x1874670272917248/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827692 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827667.092001:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827667.092004:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827667.092007:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272917248:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787827667.092012:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272917376:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787827667.092028:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827667.092037:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827667/real 1787827667]  req@ffff9ee0057061c0 x1874670272917376/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827692 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827667.092049:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057061c0 x1874670272917376/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827692 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827667.092056:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827667.092059:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827667.092062:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272917376:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787827667.092077:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272917504:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787827667.092094:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827667.092104:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827667/real 1787827667]  req@ffff9ee005707480 x1874670272917504/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827692 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827667.092114:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707480 x1874670272917504/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827692 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827667.092128:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827667.092131:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827667.092134:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272917504:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787827667.092140:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272917632:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787827667.092156:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827667.092165:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827667/real 1787827667]  req@ffff9ee005704b40 x1874670272917632/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827692 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827667.092175:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704b40 x1874670272917632/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827692 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827667.092183:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827667.092186:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827667.092189:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272917632:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827667.923551:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827668.115427:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787827668.947505:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827669.139381:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827669.971504:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827670.163393:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827670.995504:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827671.187397:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827672.019513:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1787827672.211436:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1787827672.211443:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:1.0:1787827672.211446:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1787827672.211452:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827672.211462:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2835
00000100:00080000:1.0:1787827672.211472:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827672.211479:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787827672.211510:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a3480 x1874670272917760/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827672.211545:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827672.211548:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787827672.211549:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827672.211553:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2835
00000100:00080000:1.0:1787827672.211556:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827672.211561:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827672.211570:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787827672.211587:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a12c0 x1874670272917888/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787827672.211587:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272917760:192.168.203.121@tcp:250:kworker.0
00000100:00080000:1.0:1787827672.211613:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827672.211616:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787827672.211617:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827672.211623:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2835
00000100:00080000:1.0:1787827672.211625:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827672.211629:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827672.211633:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787827672.211641:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1a40 x1874670272918016/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827672.211649:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827672.211651:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787827672.211652:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827672.211655:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2835
00000100:00080000:1.0:1787827672.211657:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827672.211659:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827672.211662:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787827672.211667:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a3c00 x1874670272918144/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827672.211674:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827672.211676:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787827672.211678:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827672.211680:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2835
00000100:00080000:1.0:1787827672.211682:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827672.211685:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827672.211688:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000800:00000100:2.0:1787827672.211696:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827672.211701:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a2940 x1874670272918272/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827672.211709:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827672.211714:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787827672.211715:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827672.211719:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2835
00000100:00080000:1.0:1787827672.211723:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827672.211727:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827672.211730:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787827672.211741:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1680 x1874670272918400/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827672.211747:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827672.211750:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787827672.211751:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827672.211756:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2835
00000100:00080000:1.0:1787827672.211759:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827672.211763:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787827672.211767:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827672/real 1787827672]  req@ffff9ee0056a3480 x1874670272917760/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827697 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:1.0:1787827672.211770:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787827672.211786:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0f00 x1874670272918528/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787827672.211851:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a3480 x1874670272917760/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827697 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827672.211865:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827672.211870:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827672.211875:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272917760:192.168.203.121@tcp:250:kworker.0
00000100:00100000:2.0:1787827672.211907:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272917888:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787827672.211934:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827672.211946:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827672/real 1787827672]  req@ffff9ee0056a12c0 x1874670272917888/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827697 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827672.211955:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a12c0 x1874670272917888/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827697 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827672.211961:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827672.211964:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827672.211966:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272917888:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787827672.211983:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272918016:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787827672.212007:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827672.212020:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827672/real 1787827672]  req@ffff9ee0056a1a40 x1874670272918016/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827697 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827672.212032:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1a40 x1874670272918016/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827697 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827672.212043:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827672.212045:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827672.212048:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272918016:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787827672.212052:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272918144:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787827672.212068:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827672.212075:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827672/real 1787827672]  req@ffff9ee0056a3c00 x1874670272918144/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827697 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827672.212082:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a3c00 x1874670272918144/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827697 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827672.212088:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827672.212090:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827672.212092:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272918144:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787827672.212096:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272918272:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787827672.212106:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827672.212112:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827672/real 1787827672]  req@ffff9ee0056a2940 x1874670272918272/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827697 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827672.212119:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a2940 x1874670272918272/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827697 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827672.212124:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827672.212126:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827672.212129:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272918272:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787827672.212133:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272918400:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787827672.212144:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827672.212149:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827672/real 1787827672]  req@ffff9ee0056a1680 x1874670272918400/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827697 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827672.212156:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1680 x1874670272918400/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827697 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827672.212162:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827672.212164:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827672.212166:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272918400:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787827672.212169:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272918528:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787827672.212179:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827672.212184:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827672/real 1787827672]  req@ffff9ee0056a0f00 x1874670272918528/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827697 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827672.212191:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0f00 x1874670272918528/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827697 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827672.212196:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827672.212197:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827672.212199:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272918528:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827673.043453:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827673.235388:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787827674.067539:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827674.259427:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827675.091495:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827675.283423:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827676.115461:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827676.307466:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827677.139558:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1787827677.331479:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827677.331501:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00100000:2.0:1787827677.331509:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787827677.331509:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827677.331529:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2841
00000100:00080000:3.0:1787827677.331542:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827677.331549:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787827677.331581:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057043c0 x1874670272918656/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827677.331608:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827677.331611:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787827677.331612:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827677.331616:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2841
00000100:00080000:3.0:1787827677.331620:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827677.331624:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827677.331632:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787827677.331646:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706580 x1874670272918784/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787827677.331657:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272918656:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787827677.331660:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827677.331672:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787827677.331676:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827677.331681:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2841
00000100:00080000:3.0:1787827677.331690:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827677.331694:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827677.331699:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827677.331714:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057070c0 x1874670272918912/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827677.331722:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827677.331724:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787827677.331725:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827677.331729:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2841
00000100:00080000:3.0:1787827677.331732:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827677.331735:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827677.331738:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:2.0:1787827677.331785:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827677.331809:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057052c0 x1874670272919040/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827677.331819:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827677.331821:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787827677.331823:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827677.331827:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2841
00000100:00080000:3.0:1787827677.331833:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827677.331840:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787827677.331842:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827677/real 1787827677]  req@ffff9ee0057043c0 x1874670272918656/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827702 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:3.0:1787827677.331852:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787827677.331874:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707c00 x1874670272919168/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787827677.331883:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057043c0 x1874670272918656/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827702 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827677.331897:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827677.331919:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827677.331924:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827677.331927:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272918656:192.168.203.121@tcp:250:kworker.0
00000100:00100000:2.0:1787827677.331959:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272918784:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787827677.331995:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827677.332024:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827677/real 1787827677]  req@ffff9ee005706580 x1874670272918784/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827702 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827677.332037:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787827677.332043:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1787827677.332057:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706580 x1874670272918784/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827702 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827677.332058:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2841
00000100:00080000:3.0:1787827677.332073:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827677.332074:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827677.332086:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00080000:3.0:1787827677.332092:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787827677.332096:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272918784:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787827677.332110:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272918912:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787827677.332131:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827677.332140:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827677/real 1787827677]  req@ffff9ee0057070c0 x1874670272918912/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827702 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827677.332150:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057070c0 x1874670272918912/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827702 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827677.332157:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827677.332160:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827677.332165:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272918912:192.168.203.121@tcp:8:kworker.0
00000008:00100000:3.0:1787827677.332175:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787827677.332178:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272919040:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787827677.332195:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704000 x1874670272919296/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1787827677.332206:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827677.332223:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827677/real 1787827677]  req@ffff9ee0057052c0 x1874670272919040/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827702 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827677.332240:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827677.332250:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:2.0:1787827677.332254:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057052c0 x1874670272919040/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827702 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827677.332254:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827677.332280:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827677.332286:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2841
00000100:00080000:2.0:1787827677.332292:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827677.332299:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272919040:192.168.203.121@tcp:8:kworker.0
00000100:00080000:3.0:1787827677.332302:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1787827677.332307:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272919168:192.168.203.121@tcp:38:kworker.0
00000100:00080000:3.0:1787827677.332314:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827677.332323:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:2.0:1787827677.332369:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827677.332385:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827677/real 1787827677]  req@ffff9ee005707c00 x1874670272919168/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827702 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827677.332398:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707c00 x1874670272919168/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827702 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827677.332406:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:3.0:1787827677.332409:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706d00 x1874670272919424/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827677.332412:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827677.332427:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272919168:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787827677.332477:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272919296:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787827677.332517:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827677.332528:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827677/real 1787827677]  req@ffff9ee005704000 x1874670272919296/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827702 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827677.332538:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704000 x1874670272919296/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827702 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827677.332545:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827677.332548:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827677.332550:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272919296:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787827677.332555:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272919424:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787827677.332568:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827677.332575:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827677/real 1787827677]  req@ffff9ee005706d00 x1874670272919424/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827702 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827677.332584:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706d00 x1874670272919424/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827702 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827677.332595:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827677.332598:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827677.332601:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272919424:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827678.163656:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827678.355401:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787827679.187639:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827679.379400:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827680.211486:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827680.403444:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827681.235598:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827681.427413:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827682.259617:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827682.451422:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787827682.451493:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827682.451503:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787827682.451508:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827682.451520:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2846
00000100:00080000:3.0:1787827682.451532:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827682.451541:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787827682.451583:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706940 x1874670272919552/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827682.451618:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827682.451623:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787827682.451625:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827682.451632:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2846
00000100:00080000:3.0:1787827682.451637:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827682.451643:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827682.451656:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787827682.451669:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272919552:192.168.203.121@tcp:250:kworker.0
00000100:00100000:3.0:1787827682.451676:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705680 x1874670272919680/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827682.451693:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827682.451697:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787827682.451700:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827682.451704:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2846
00000100:00080000:3.0:1787827682.451708:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827682.451712:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827682.451718:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827682.451735:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706d00 x1874670272919808/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827682.451748:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827682.451752:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787827682.451754:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827682.451758:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2846
00000100:00080000:3.0:1787827682.451764:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000800:00000100:2.0:1787827682.451773:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787827682.451774:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827682.451793:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827682.451804:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704000 x1874670272919936/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827682.451816:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827682.451819:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787827682.451822:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827682.451827:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2846
00000100:00080000:3.0:1787827682.451832:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827682.451837:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827682.451842:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787827682.451857:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707c00 x1874670272920064/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827682.451874:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1787827682.451881:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827682/real 1787827682]  req@ffff9ee005706940 x1874670272919552/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827707 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827682.451884:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787827682.451893:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827682.451911:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2846
00000100:00080000:3.0:1787827682.451921:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1787827682.451927:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706940 x1874670272919552/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827707 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827682.451936:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00080000:2.0:1787827682.451957:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000008:00100000:3.0:1787827682.451957:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:2.0:1787827682.451971:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827682.451978:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272919552:192.168.203.121@tcp:250:kworker.0
00000100:00100000:3.0:1787827682.451986:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057052c0 x1874670272920192/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827682.452001:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827682.452005:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787827682.452008:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1787827682.452016:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272919680:192.168.203.121@tcp:38:kworker.0
00000100:00080000:3.0:1787827682.452017:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2846
00000100:00080000:3.0:1787827682.452029:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827682.452036:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827682.452043:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827682.452060:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057070c0 x1874670272920320/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1787827682.452083:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827682.452116:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827682/real 1787827682]  req@ffff9ee005705680 x1874670272919680/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827707 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827682.452148:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705680 x1874670272919680/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827707 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827682.452159:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827682.452163:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827682.452168:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272919680:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787827682.452175:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272919808:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787827682.452204:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827682.452217:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827682/real 1787827682]  req@ffff9ee005706d00 x1874670272919808/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827707 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827682.452231:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706d00 x1874670272919808/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827707 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827682.452240:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827682.452243:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827682.452247:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272919808:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787827682.452254:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272919936:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787827682.452285:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827682.452306:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827682/real 1787827682]  req@ffff9ee005704000 x1874670272919936/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827707 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827682.452369:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704000 x1874670272919936/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827707 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827682.452387:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827682.452391:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827682.452395:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272919936:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787827682.452402:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272920064:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787827682.452431:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827682.452444:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827682/real 1787827682]  req@ffff9ee005707c00 x1874670272920064/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827707 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827682.452483:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707c00 x1874670272920064/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827707 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827682.452494:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827682.452498:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827682.452501:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272920064:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787827682.452509:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272920192:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787827682.452534:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827682.452546:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827682/real 1787827682]  req@ffff9ee0057052c0 x1874670272920192/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827707 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827682.452560:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057052c0 x1874670272920192/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827707 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827682.452568:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827682.452572:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827682.452576:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272920192:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787827682.452600:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272920320:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787827682.452619:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827682.452631:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827682/real 1787827682]  req@ffff9ee0057070c0 x1874670272920320/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827707 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827682.452644:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057070c0 x1874670272920320/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827707 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827682.452652:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827682.452656:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827682.452659:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272920320:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827683.283499:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827683.475414:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787827684.307482:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827684.499393:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827685.331503:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827685.523378:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827686.355536:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827686.547374:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827687.379566:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827687.571434:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787827687.571459:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827687.571472:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787827687.571477:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827687.571491:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2851
00000100:00080000:3.0:1787827687.571504:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827687.571515:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787827687.571554:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706580 x1874670272920448/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827687.571596:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827687.571600:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787827687.571602:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827687.571605:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2851
00000100:00080000:3.0:1787827687.571609:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827687.571613:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827687.571623:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787827687.571641:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057043c0 x1874670272920576/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787827687.571667:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272920448:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787827687.571669:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827687.571679:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787827687.571682:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827687.571689:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2851
00000100:00080000:3.0:1787827687.571695:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827687.571701:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827687.571718:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827687.571737:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704b40 x1874670272920704/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1787827687.571749:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787827687.571750:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827687.571757:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787827687.571759:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827687.571765:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2851
00000100:00080000:3.0:1787827687.571770:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827687.571784:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827687.571789:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827687.571819:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707480 x1874670272920832/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787827687.571826:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827687/real 1787827687]  req@ffff9ee005706580 x1874670272920448/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827712 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827687.571848:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827687.571859:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787827687.571864:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827687.571869:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2851
00000100:00080000:3.0:1787827687.571874:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827687.571880:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787827687.571882:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706580 x1874670272920448/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827712 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:3.0:1787827687.571885:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787827687.571901:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057061c0 x1874670272920960/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827687.571918:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827687.571923:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827687.571930:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787827687.571931:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:3.0:1787827687.571933:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1787827687.571960:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272920448:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787827687.571960:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2851
00000100:00080000:3.0:1787827687.571967:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827687.571973:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827687.571977:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827687.571986:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705a40 x1874670272921088/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787827687.571995:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272920576:192.168.203.121@tcp:38:kworker.0
00000100:00080000:3.0:1787827687.571997:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827687.572005:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787827687.572006:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827687.572011:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2851
00000100:00080000:3.0:1787827687.572014:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827687.572018:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827687.572023:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:2.0:1787827687.572033:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827687.572037:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704780 x1874670272921216/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787827687.572052:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827687/real 1787827687]  req@ffff9ee0057043c0 x1874670272920576/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827712 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827687.572087:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057043c0 x1874670272920576/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827712 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827687.572096:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827687.572099:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827687.572103:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272920576:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787827687.572109:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272920704:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787827687.572128:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827687.572138:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827687/real 1787827687]  req@ffff9ee005704b40 x1874670272920704/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827712 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827687.572148:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704b40 x1874670272920704/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827712 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827687.572155:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827687.572157:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827687.572160:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272920704:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787827687.572165:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272920832:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787827687.572179:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827687.572187:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827687/real 1787827687]  req@ffff9ee005707480 x1874670272920832/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827712 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827687.572197:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707480 x1874670272920832/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827712 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827687.572206:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827687.572210:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827687.572215:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272920832:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787827687.572224:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272920960:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787827687.572251:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827687.572267:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827687/real 1787827687]  req@ffff9ee0057061c0 x1874670272920960/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827712 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827687.572285:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057061c0 x1874670272920960/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827712 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827687.572295:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827687.572298:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827687.572301:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272920960:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787827687.572318:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272921088:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787827687.572341:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827687.572355:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827687/real 1787827687]  req@ffff9ee005705a40 x1874670272921088/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827712 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827687.572398:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705a40 x1874670272921088/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827712 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827687.572406:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827687.572408:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827687.572411:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272921088:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787827687.572453:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272921216:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787827687.572474:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827687.572484:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827687/real 1787827687]  req@ffff9ee005704780 x1874670272921216/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827712 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827687.572494:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704780 x1874670272921216/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827712 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827687.572506:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827687.572509:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827687.572512:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272921216:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827688.403530:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827688.595397:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787827689.427491:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827689.619500:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827690.451529:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827690.643432:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827691.475530:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827691.667504:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827692.499510:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827692.691412:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:0.0:1787827692.691442:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827692.691449:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1787827692.691453:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827692.691461:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2856
00000100:00080000:0.0:1787827692.691472:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827692.691478:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787827692.691523:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9680 x1874670272921344/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827692.691546:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827692.691549:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787827692.691551:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827692.691554:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2856
00000100:00080000:0.0:1787827692.691556:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827692.691560:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827692.691568:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787827692.691577:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8b40 x1874670272921472/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787827692.691585:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272921344:192.168.203.121@tcp:250:kworker.0
00000100:00080000:0.0:1787827692.691590:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827692.691594:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787827692.691596:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827692.691600:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2856
00000100:00080000:0.0:1787827692.691603:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827692.691606:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827692.691609:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787827692.691637:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9e00 x1874670272921600/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827692.691650:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827692.691654:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787827692.691656:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827692.691660:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2856
00000100:00080000:0.0:1787827692.691664:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827692.691668:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827692.691674:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787827692.691688:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8780 x1874670272921728/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1787827692.691690:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:0.0:1787827692.691702:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827692.691716:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787827692.691718:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827692.691723:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2856
00000100:00080000:0.0:1787827692.691731:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827692.691734:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827692.691739:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787827692.691750:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ead00 x1874670272921856/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827692.691760:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827692.691765:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00100000:2.0:1787827692.691766:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827692/real 1787827692]  req@ffff9ee0056e9680 x1874670272921344/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827717 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827692.691767:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827692.691778:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2856
00000100:00080000:0.0:1787827692.691786:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827692.691796:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827692.691803:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787827692.691809:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9680 x1874670272921344/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827717 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827692.691820:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ea580 x1874670272921984/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827692.691828:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827692.691837:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827692.691840:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:0.0:1787827692.691845:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787827692.691862:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1787827692.691862:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272921344:192.168.203.121@tcp:250:kworker.0
00000100:00080000:0.0:1787827692.691874:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2856
00000100:00080000:0.0:1787827692.691878:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827692.691881:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827692.691885:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787827692.691893:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9a40 x1874670272922112/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787827692.691911:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272921472:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787827692.691952:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827692.691965:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827692/real 1787827692]  req@ffff9ee0056e8b40 x1874670272921472/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827717 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827692.691979:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8b40 x1874670272921472/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827717 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827692.691987:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827692.691999:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827692.692003:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272921472:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787827692.692009:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272921600:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787827692.692028:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827692.692038:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827692/real 1787827692]  req@ffff9ee0056e9e00 x1874670272921600/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827717 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827692.692059:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9e00 x1874670272921600/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827717 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827692.692073:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827692.692076:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827692.692079:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272921600:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787827692.692084:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272921728:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787827692.692098:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827692.692121:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827692/real 1787827692]  req@ffff9ee0056e8780 x1874670272921728/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827717 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827692.692139:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8780 x1874670272921728/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827717 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827692.692169:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827692.692175:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827692.692182:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272921728:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787827692.692193:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272921856:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787827692.692243:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827692.692253:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827692/real 1787827692]  req@ffff9ee0056ead00 x1874670272921856/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827717 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827692.692262:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ead00 x1874670272921856/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827717 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827692.692268:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827692.692270:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827692.692273:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272921856:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787827692.692278:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272921984:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787827692.692302:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827692.692308:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827692/real 1787827692]  req@ffff9ee0056ea580 x1874670272921984/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827717 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827692.692337:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ea580 x1874670272921984/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827717 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827692.692343:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827692.692345:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827692.692348:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272921984:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787827692.692352:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272922112:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787827692.692367:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827692.692374:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827692/real 1787827692]  req@ffff9ee0056e9a40 x1874670272922112/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827717 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827692.692399:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9a40 x1874670272922112/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827717 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827692.692405:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827692.692408:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827692.692410:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272922112:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827693.523603:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827693.715437:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787827694.547567:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827694.739361:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827695.571534:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827695.763387:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827696.595581:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827696.787481:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827697.619659:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1787827697.811423:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827697.811431:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787827697.811436:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827697.811444:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2861
00000100:00080000:3.0:1787827697.811454:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1787827697.811460:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787827697.811460:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787827697.811493:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705e00 x1874670272922240/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827697.811512:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827697.811515:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787827697.811516:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827697.811519:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2861
00000100:00080000:3.0:1787827697.811521:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827697.811523:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827697.811541:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787827697.811550:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707840 x1874670272922368/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787827697.811559:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272922240:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787827697.811560:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827697.811565:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787827697.811568:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827697.811573:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2861
00000100:00080000:3.0:1787827697.811574:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827697.811577:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827697.811580:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827697.811589:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704780 x1874670272922496/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827697.811595:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827697.811598:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787827697.811599:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827697.811601:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2861
00000100:00080000:3.0:1787827697.811603:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827697.811605:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827697.811608:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827697.811614:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705a40 x1874670272922624/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827697.811620:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827697.811622:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787827697.811623:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827697.811626:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2861
00000100:00080000:3.0:1787827697.811628:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827697.811631:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827697.811634:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000800:00000100:2.0:1787827697.811637:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827697.811643:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057061c0 x1874670272922752/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827697.811663:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827697.811665:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787827697.811667:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827697.811670:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2861
00000100:00080000:3.0:1787827697.811673:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827697.811675:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827697.811678:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827697.811685:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707480 x1874670272922880/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827697.811690:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827697.811693:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787827697.811694:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827697.811697:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2861
00000100:00080000:3.0:1787827697.811699:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827697.811701:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827697.811705:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787827697.811707:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827697/real 1787827697]  req@ffff9ee005705e00 x1874670272922240/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827722 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827697.811725:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704b40 x1874670272923008/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787827697.811757:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705e00 x1874670272922240/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827722 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827697.811770:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827697.811786:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827697.811791:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272922240:192.168.203.121@tcp:250:kworker.0
00000100:00100000:2.0:1787827697.811814:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272922368:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787827697.811841:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827697.811856:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827697/real 1787827697]  req@ffff9ee005707840 x1874670272922368/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827722 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827697.811871:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707840 x1874670272922368/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827722 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827697.811881:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827697.811885:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827697.811889:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272922368:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787827697.811896:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272922496:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787827697.811919:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827697.811932:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827697/real 1787827697]  req@ffff9ee005704780 x1874670272922496/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827722 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827697.811947:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704780 x1874670272922496/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827722 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827697.811956:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827697.811959:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827697.811963:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272922496:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787827697.811970:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272922624:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787827697.811992:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827697.812003:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827697/real 1787827697]  req@ffff9ee005705a40 x1874670272922624/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827722 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827697.812017:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705a40 x1874670272922624/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827722 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827697.812047:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827697.812051:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827697.812055:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272922624:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787827697.812061:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272922752:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787827697.812085:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827697.812109:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827697/real 1787827697]  req@ffff9ee0057061c0 x1874670272922752/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827722 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827697.812123:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057061c0 x1874670272922752/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827722 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827697.812149:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827697.812153:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827697.812157:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272922752:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787827697.812174:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272922880:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787827697.812195:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827697.812208:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827697/real 1787827697]  req@ffff9ee005707480 x1874670272922880/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827722 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827697.812220:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707480 x1874670272922880/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827722 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827697.812229:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827697.812233:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827697.812236:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272922880:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787827697.812243:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272923008:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787827697.812264:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827697.812276:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827697/real 1787827697]  req@ffff9ee005704b40 x1874670272923008/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827722 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827697.812290:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704b40 x1874670272923008/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827722 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827697.812298:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827697.812302:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827697.812306:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272923008:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827698.643733:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827698.835408:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787827699.667546:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827699.859421:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827700.691601:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827700.883468:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827701.715584:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827701.907416:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827702.739548:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1787827702.931495:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1787827702.931501:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787827702.931520:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787827702.931544:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827702.931556:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2866
00000100:00080000:3.0:1787827702.931568:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827702.931576:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787827702.931651:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057043c0 x1874670272923136/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827702.931696:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827702.931700:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787827702.931701:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827702.931705:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2866
00000100:00080000:3.0:1787827702.931709:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827702.931713:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827702.931740:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787827702.931748:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272923136:192.168.203.121@tcp:250:kworker.0
00000100:00100000:3.0:1787827702.931765:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706580 x1874670272923264/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827702.931779:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827702.931783:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787827702.931786:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827702.931808:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2866
00000100:00080000:3.0:1787827702.931814:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827702.931819:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827702.931825:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:2.0:1787827702.931832:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827702.931845:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057070c0 x1874670272923392/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827702.931876:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827702.931879:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787827702.931881:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827702.931891:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2866
00000100:00100000:2.0:1787827702.931895:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827702/real 1787827702]  req@ffff9ee0057043c0 x1874670272923136/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827727 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827702.931897:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827702.931911:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827702.931942:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787827702.931944:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057043c0 x1874670272923136/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827727 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827702.931963:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:3.0:1787827702.931965:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057052c0 x1874670272923520/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827702.931972:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827702.931999:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272923136:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787827702.932015:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827702.932019:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787827702.932021:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827702.932027:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2866
00000100:00080000:3.0:1787827702.932031:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827702.932034:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827702.932039:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787827702.932047:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272923264:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787827702.932068:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707c00 x1874670272923648/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827702.932080:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827702.932083:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787827702.932085:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827702.932088:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2866
00000800:00000100:2.0:1787827702.932093:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787827702.932094:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827702.932101:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827702.932105:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827702.932118:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704000 x1874670272923776/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787827702.932127:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827702/real 1787827702]  req@ffff9ee005706580 x1874670272923264/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827727 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827702.932129:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827702.932139:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787827702.932159:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827702.932165:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2866
00000100:00080000:3.0:1787827702.932168:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827702.932171:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827702.932176:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787827702.932178:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706580 x1874670272923264/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827727 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827702.932187:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706d00 x1874670272923904/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827702.932222:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827702.932238:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827702.932244:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272923264:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787827702.932255:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272923392:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787827702.932283:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827702.932292:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827702/real 1787827702]  req@ffff9ee0057070c0 x1874670272923392/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827727 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827702.932301:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057070c0 x1874670272923392/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827727 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827702.932307:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827702.932360:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827702.932374:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272923392:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787827702.932379:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272923520:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787827702.932397:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827702.932405:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827702/real 1787827702]  req@ffff9ee0057052c0 x1874670272923520/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827727 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827702.932413:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057052c0 x1874670272923520/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827727 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827702.932419:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827702.932421:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827702.932423:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272923520:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787827702.932436:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272923648:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787827702.932448:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827702.932454:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827702/real 1787827702]  req@ffff9ee005707c00 x1874670272923648/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827727 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827702.932462:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707c00 x1874670272923648/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827727 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827702.932467:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827702.932469:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827702.932471:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272923648:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787827702.932484:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272923776:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787827702.932495:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827702.932500:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827702/real 1787827702]  req@ffff9ee005704000 x1874670272923776/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827727 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827702.932508:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704000 x1874670272923776/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827727 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827702.932513:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827702.932514:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827702.932516:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272923776:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787827702.932520:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272923904:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787827702.932530:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827702.932535:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827702/real 1787827702]  req@ffff9ee005706d00 x1874670272923904/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827727 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827702.932558:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706d00 x1874670272923904/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827727 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827702.932563:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827702.932565:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827702.932567:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272923904:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827703.763628:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827703.955459:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787827704.787667:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827704.979483:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827705.811478:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827706.003417:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827706.835550:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827707.027455:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827707.859495:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1787827708.051401:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827708.051422:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1787827708.051428:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1787827708.051441:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:0.0:1787827708.051445:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2871
00000100:00080000:0.0:1787827708.051466:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827708.051476:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787827708.051522:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb0c0 x1874670272924032/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827708.051560:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827708.051563:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787827708.051565:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827708.051568:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2871
00000100:00080000:0.0:1787827708.051571:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827708.051574:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827708.051585:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787827708.051598:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ea940 x1874670272924160/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787827708.051607:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272924032:192.168.203.121@tcp:250:kworker.0
00000100:00080000:0.0:1787827708.051618:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827708.051625:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787827708.051627:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827708.051633:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2871
00000100:00080000:0.0:1787827708.051638:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827708.051644:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827708.051650:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787827708.051670:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9a40 x1874670272924288/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827708.051685:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827708.051688:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787827708.051689:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827708.051692:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2871
00000100:00080000:0.0:1787827708.051697:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827708.051704:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000800:00000100:2.0:1787827708.051710:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000008:00100000:0.0:1787827708.051712:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787827708.051725:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ea580 x1874670272924416/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827708.051734:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827708.051737:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787827708.051738:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827708.051742:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2871
00000100:00080000:0.0:1787827708.051745:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827708.051748:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827708.051755:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787827708.051770:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ead00 x1874670272924544/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787827708.051770:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827708/real 1787827708]  req@ffff9ee0056eb0c0 x1874670272924032/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827733 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827708.051827:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827708.051843:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787827708.051847:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827708.051857:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2871
00000100:00100000:2.0:1787827708.051859:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb0c0 x1874670272924032/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827733 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827708.051867:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827708.051887:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00080000:2.0:1787827708.051887:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827708.051901:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000008:00100000:0.0:1787827708.051906:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787827708.051910:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272924032:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787827708.051927:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8780 x1874670272924672/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827708.051944:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1787827708.051946:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272924160:192.168.203.121@tcp:38:kworker.0
00000100:00080000:0.0:1787827708.051951:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787827708.051956:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827708.051978:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2871
00000100:00080000:0.0:1787827708.051982:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827708.051987:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827708.051992:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:2.0:1787827708.052002:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827708.052004:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9e00 x1874670272924800/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787827708.052021:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827708/real 1787827708]  req@ffff9ee0056ea940 x1874670272924160/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827733 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827708.052039:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ea940 x1874670272924160/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827733 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827708.052048:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827708.052051:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827708.052054:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272924160:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787827708.052061:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272924288:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787827708.052077:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827708.052086:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827708/real 1787827708]  req@ffff9ee0056e9a40 x1874670272924288/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827733 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827708.052096:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9a40 x1874670272924288/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827733 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827708.052103:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827708.052105:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827708.052108:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272924288:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787827708.052113:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272924416:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787827708.052126:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827708.052134:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827708/real 1787827708]  req@ffff9ee0056ea580 x1874670272924416/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827733 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827708.052150:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ea580 x1874670272924416/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827733 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827708.052157:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827708.052159:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827708.052162:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272924416:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787827708.052167:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272924544:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787827708.052180:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827708.052187:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827708/real 1787827708]  req@ffff9ee0056ead00 x1874670272924544/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827733 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827708.052197:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ead00 x1874670272924544/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827733 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827708.052204:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827708.052207:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827708.052209:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272924544:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787827708.052224:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272924672:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787827708.052238:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827708.052245:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827708/real 1787827708]  req@ffff9ee0056e8780 x1874670272924672/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827733 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827708.052255:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8780 x1874670272924672/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827733 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827708.052267:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827708.052270:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827708.052289:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272924672:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787827708.052297:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272924800:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787827708.052360:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827708.052372:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827708/real 1787827708]  req@ffff9ee0056e9e00 x1874670272924800/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827733 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827708.052382:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9e00 x1874670272924800/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827733 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827708.052390:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827708.052393:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827708.052395:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272924800:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827708.883505:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827709.075429:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787827709.907488:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827710.099377:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827710.931542:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827711.123416:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827711.955504:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827712.147392:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827712.979540:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1787827713.171445:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827713.171455:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787827713.171461:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1787827713.171464:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787827713.171474:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2876
00000100:00080000:3.0:1787827713.171489:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827713.171498:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787827713.171536:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705680 x1874670272924928/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827713.171566:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827713.171571:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787827713.171574:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827713.171580:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2876
00000100:00080000:3.0:1787827713.171586:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827713.171593:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827713.171604:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787827713.171620:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272924928:192.168.203.121@tcp:250:kworker.0
00000100:00100000:3.0:1787827713.171627:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706940 x1874670272925056/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827713.171644:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827713.171650:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787827713.171655:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827713.171662:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2876
00000100:00080000:3.0:1787827713.171667:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827713.171674:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827713.171681:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:2.0:1787827713.171720:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827713.171774:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827713/real 1787827713]  req@ffff9ee005705680 x1874670272924928/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827738 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827713.171776:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706d00 x1874670272925184/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787827713.171822:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705680 x1874670272924928/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827738 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827713.171835:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827713.171840:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827713.171844:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272924928:192.168.203.121@tcp:250:kworker.0
00000100:00100000:2.0:1787827713.171871:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272925056:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787827713.171895:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827713.171922:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827713/real 1787827713]  req@ffff9ee005706940 x1874670272925056/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827738 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827713.171924:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1787827713.171944:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706940 x1874670272925056/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827738 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827713.171956:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827713.171960:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827713.171965:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272925056:192.168.203.121@tcp:38:kworker.0
00000100:00080000:3.0:1787827713.171977:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787827713.171982:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1787827713.171984:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272925184:192.168.203.121@tcp:8:kworker.0
00000100:00080000:3.0:1787827713.171994:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2876
00000100:00080000:3.0:1787827713.172004:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827713.172014:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827713.172021:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:2.0:1787827713.172028:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827713.172070:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827713/real 1787827713]  req@ffff9ee005706d00 x1874670272925184/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827738 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827713.172070:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704000 x1874670272925312/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787827713.172153:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706d00 x1874670272925184/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827738 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827713.172156:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827713.172178:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787827713.172185:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827713.172201:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2876
00000100:00080000:2.0:1787827713.172209:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827713.172214:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827713.172216:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00080000:3.0:1787827713.172232:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787827713.172251:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272925184:192.168.203.121@tcp:8:kworker.0
00000008:00100000:3.0:1787827713.172257:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787827713.172278:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272925312:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787827713.172297:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707c00 x1874670272925440/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827713.172315:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827713.172319:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787827713.172323:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:2.0:1787827713.172352:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787827713.172366:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2876
00000100:00100000:2.0:1787827713.172377:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827713/real 1787827713]  req@ffff9ee005704000 x1874670272925312/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827738 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827713.172377:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827713.172389:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827713.172401:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787827713.172413:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704000 x1874670272925312/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827738 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827713.172422:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057052c0 x1874670272925568/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827713.172449:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827713.172457:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827713.172458:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827713.172471:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272925312:192.168.203.121@tcp:8:kworker.0
00000100:00080000:3.0:1787827713.172477:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787827713.172482:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827713.172490:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2876
00000100:00080000:3.0:1787827713.172494:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1787827713.172498:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272925440:192.168.203.121@tcp:38:kworker.0
00000100:00080000:3.0:1787827713.172507:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827713.172514:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:2.0:1787827713.172534:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827713.172534:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057070c0 x1874670272925696/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787827713.172550:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827713/real 1787827713]  req@ffff9ee005707c00 x1874670272925440/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827738 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827713.172570:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707c00 x1874670272925440/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827738 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827713.172578:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827713.172583:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827713.172587:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272925440:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787827713.172594:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272925568:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787827713.172609:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827713.172617:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827713/real 1787827713]  req@ffff9ee0057052c0 x1874670272925568/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827738 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827713.172627:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057052c0 x1874670272925568/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827738 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827713.172634:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827713.172636:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827713.172639:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272925568:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787827713.172649:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272925696:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787827713.172662:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827713.172670:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827713/real 1787827713]  req@ffff9ee0057070c0 x1874670272925696/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827738 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827713.172679:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057070c0 x1874670272925696/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827738 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827713.172686:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827713.172688:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827713.172691:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272925696:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827714.003597:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827714.195481:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787827715.027546:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827715.219424:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827716.051474:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827716.243417:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827717.075500:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827717.267376:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827718.099457:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1787827718.291429:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827718.291440:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787827718.291454:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827718.291466:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2882
00000100:00100000:2.0:1787827718.291467:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787827718.291480:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827718.291489:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787827718.291526:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706580 x1874670272925824/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827718.291556:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827718.291559:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787827718.291561:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827718.291565:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2882
00000100:00080000:3.0:1787827718.291568:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827718.291572:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827718.291592:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787827718.291606:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272925824:192.168.203.121@tcp:250:kworker.0
00000100:00100000:3.0:1787827718.291612:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057043c0 x1874670272925952/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827718.291632:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827718.291638:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787827718.291641:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827718.291657:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2882
00000100:00080000:3.0:1787827718.291676:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827718.291684:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827718.291690:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827718.291707:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704b40 x1874670272926080/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827718.291730:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827718.291734:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787827718.291736:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827718.291741:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2882
00000100:00080000:3.0:1787827718.291747:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1787827718.291749:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272925952:192.168.203.121@tcp:38:kworker.0
00000100:00080000:3.0:1787827718.291756:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827718.291763:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827718.291778:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707480 x1874670272926208/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827718.291797:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827718.291801:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787827718.291805:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1787827718.291806:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272926080:192.168.203.121@tcp:8:kworker.0
00000100:00080000:3.0:1787827718.291817:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2882
00000100:00080000:3.0:1787827718.291824:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827718.291828:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827718.291835:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787827718.291846:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272926208:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787827718.291852:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057061c0 x1874670272926336/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827718.291864:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827718.291868:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787827718.291870:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827718.291874:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2882
00000100:00080000:3.0:1787827718.291879:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827718.291882:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787827718.291888:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272926336:192.168.203.121@tcp:38:kworker.0
00000008:00100000:3.0:1787827718.291890:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827718.291909:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705a40 x1874670272926464/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827718.291924:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827718.291927:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787827718.291930:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1787827718.291933:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272926464:192.168.203.121@tcp:8:kworker.0
00000100:00080000:3.0:1787827718.291938:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2882
00000100:00080000:3.0:1787827718.291950:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827718.291956:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827718.291965:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827718.291983:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704780 x1874670272926592/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787827718.292047:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272926592:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827719.123493:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827719.315384:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787827720.147497:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827720.339430:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827721.171473:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827721.363454:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000400:00000100:1.0:1787827721.363813:0:2352:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.203.121:988
00000400:00000100:1.0:1787827721.363884:0:2352:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.203.121@tcp at host 192.168.203.121 was unreachable: the network or that node may be down, or Lustre may be misconfigured.
00000800:00000100:1.0:1787827721.363914:0:2352:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:1.0:1787827721.363972:0:2352:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:1.0:1787827721.363984:0:2352:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:1.0:1787827721.363993:0:2352:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:1.0:1787827721.364002:0:2352:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:1.0:1787827721.364017:0:2352:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:1.0:1787827721.364030:0:2352:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000100:00100000:2.0:1787827721.364052:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827718/real 1787827721]  req@ffff9ee0057061c0 x1874670272926336/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827743 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827721.364090:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057061c0 x1874670272926336/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827743 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827721.364104:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827721.364110:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827721.364116:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272926336:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787827721.364126:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827718/real 1787827721]  req@ffff9ee005707480 x1874670272926208/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827743 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827721.364152:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707480 x1874670272926208/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827743 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827721.364162:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827721.364166:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827721.364171:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272926208:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787827721.364208:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827718/real 1787827721]  req@ffff9ee0057043c0 x1874670272925952/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827743 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827721.364224:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057043c0 x1874670272925952/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827743 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827721.364233:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827721.364237:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827721.364241:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272925952:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787827721.364249:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827718/real 1787827721]  req@ffff9ee005704b40 x1874670272926080/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827743 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827721.364263:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704b40 x1874670272926080/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827743 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827721.364278:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827721.364283:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827721.364287:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272926080:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787827721.364306:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827718/real 1787827721]  req@ffff9ee005706580 x1874670272925824/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827743 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827721.364347:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706580 x1874670272925824/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827743 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827721.364369:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827721.364373:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827721.364379:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272925824:192.168.203.121@tcp:250:kworker.0
00000100:00100000:2.0:1787827721.364413:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827718/real 1787827721]  req@ffff9ee005704780 x1874670272926592/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827743 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827721.364427:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704780 x1874670272926592/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827743 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827721.364436:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827721.364439:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827721.364443:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272926592:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787827721.364450:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827718/real 1787827721]  req@ffff9ee005705a40 x1874670272926464/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827743 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827721.364463:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705a40 x1874670272926464/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827743 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827721.364473:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827721.364478:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827721.364484:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272926464:192.168.203.121@tcp:8:kworker.0
00010000:00010000:3.0:1787827722.195566:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827722.387409:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827723.219497:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827723.411389:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787827723.411416:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827723.411425:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787827723.411430:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827723.411442:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2887
00000100:00080000:3.0:1787827723.411455:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827723.411464:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787827723.411498:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707840 x1874670272926720/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827723.411526:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827723.411529:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787827723.411531:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827723.411536:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2887
00000100:00080000:3.0:1787827723.411540:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827723.411544:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827723.411553:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787827723.411562:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272926720:192.168.203.121@tcp:250:kworker.0
00000100:00100000:3.0:1787827723.411567:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705e00 x1874670272926848/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827723.411578:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827723.411581:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787827723.411583:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827723.411588:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2887
00000100:00080000:3.0:1787827723.411593:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827723.411598:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827723.411605:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827723.411622:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705a40 x1874670272926976/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1787827723.411636:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787827723.411636:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827723.411644:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787827723.411647:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827723.411654:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2887
00000100:00080000:3.0:1787827723.411660:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827723.411678:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827723.411685:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787827723.411688:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827723/real 1787827723]  req@ffff9ee005707840 x1874670272926720/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827748 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827723.411704:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704780 x1874670272927104/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827723.411715:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1787827723.411720:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707840 x1874670272926720/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827748 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827723.411721:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787827723.411727:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827723.411739:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2887
00000100:00080000:3.0:1787827723.411747:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827723.411748:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827723.411757:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00080000:2.0:1787827723.411758:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000008:00100000:3.0:1787827723.411769:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787827723.411770:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272926720:192.168.203.121@tcp:250:kworker.0
00000100:00100000:3.0:1787827723.411793:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706580 x1874670272927232/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827723.411808:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1787827723.411809:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272926848:192.168.203.121@tcp:38:kworker.0
00000100:00080000:3.0:1787827723.411817:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787827723.411822:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827723.411827:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2887
00000100:00080000:3.0:1787827723.411834:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827723.411839:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827723.411846:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:2.0:1787827723.411856:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827723.411863:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704b40 x1874670272927360/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827723.411875:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1787827723.411882:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827723/real 1787827723]  req@ffff9ee005705e00 x1874670272926848/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827748 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827723.411883:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787827723.411887:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827723.411899:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2887
00000100:00080000:3.0:1787827723.411907:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827723.411915:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787827723.411920:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705e00 x1874670272926848/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827748 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:3.0:1787827723.411924:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:2.0:1787827723.411941:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:3.0:1787827723.411946:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057043c0 x1874670272927488/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827723.411952:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827723.411964:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272926848:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787827723.411981:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272926976:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787827723.412014:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827723.412030:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827723/real 1787827723]  req@ffff9ee005705a40 x1874670272926976/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827748 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827723.412047:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705a40 x1874670272926976/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827748 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827723.412056:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827723.412060:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827723.412063:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272926976:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787827723.412071:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272927104:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787827723.412097:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827723.412111:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827723/real 1787827723]  req@ffff9ee005704780 x1874670272927104/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827748 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827723.412124:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704780 x1874670272927104/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827748 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827723.412133:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827723.412138:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827723.412141:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272927104:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787827723.412163:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272927232:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787827723.412207:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827723.412223:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827723/real 1787827723]  req@ffff9ee005706580 x1874670272927232/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827748 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827723.412248:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706580 x1874670272927232/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827748 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827723.412260:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827723.412264:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827723.412269:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272927232:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787827723.412277:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272927360:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787827723.412303:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827723.412350:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827723/real 1787827723]  req@ffff9ee005704b40 x1874670272927360/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827748 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827723.412367:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704b40 x1874670272927360/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827748 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827723.412378:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827723.412382:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827723.412387:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272927360:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787827723.412395:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272927488:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787827723.412422:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827723.412436:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827723/real 1787827723]  req@ffff9ee0057043c0 x1874670272927488/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827748 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827723.412449:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057043c0 x1874670272927488/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827748 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827723.412466:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827723.412470:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827723.412474:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272927488:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827724.243502:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827724.435403:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787827725.267500:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827725.459371:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827726.291537:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827726.483475:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827727.315506:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827727.507379:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827728.339489:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827728.531420:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:0.0:1787827728.531425:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827728.531432:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1787827728.531436:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827728.531444:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2892
00000100:00080000:0.0:1787827728.531453:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827728.531459:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787827728.531493:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8b40 x1874670272927616/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827728.531527:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827728.531534:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787827728.531536:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827728.531541:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2892
00000100:00080000:0.0:1787827728.531545:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827728.531551:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827728.531561:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787827728.531567:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272927616:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787827728.531579:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9680 x1874670272927744/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827728.531592:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827728.531594:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787827728.531596:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827728.531600:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2892
00000100:00080000:0.0:1787827728.531603:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827728.531606:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827728.531610:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787827728.531620:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e92c0 x1874670272927872/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827728.531627:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827728.531629:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787827728.531631:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827728.531633:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2892
00000100:00080000:0.0:1787827728.531635:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000800:00000100:2.0:1787827728.531640:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:0.0:1787827728.531641:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827728.531647:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787827728.531654:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb840 x1874670272928000/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827728.531661:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827728.531664:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787827728.531665:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827728.531668:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2892
00000100:00080000:0.0:1787827728.531670:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827728.531673:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827728.531676:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787827728.531694:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb480 x1874670272928128/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787827728.531701:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827728/real 1787827728]  req@ffff9ee0056e8b40 x1874670272927616/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827753 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827728.531703:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827728.531711:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787827728.531713:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827728.531722:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2892
00000100:00080000:0.0:1787827728.531727:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827728.531729:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827728.531733:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787827728.531740:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8b40 x1874670272927616/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827753 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827728.531741:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8000 x1874670272928256/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827728.531760:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827728.531768:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787827728.531770:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827728.531773:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827728.531774:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2892
00000100:00080000:0.0:1787827728.531780:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827728.531793:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00080000:2.0:1787827728.531794:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000008:00100000:0.0:1787827728.531797:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787827728.531804:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272927616:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787827728.531807:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e83c0 x1874670272928384/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787827728.531838:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272927744:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787827728.531878:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827728.531893:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827728/real 1787827728]  req@ffff9ee0056e9680 x1874670272927744/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827753 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827728.531916:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9680 x1874670272927744/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827753 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827728.531926:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827728.531930:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827728.531934:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272927744:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787827728.531941:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272927872:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787827728.531965:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827728.531977:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827728/real 1787827728]  req@ffff9ee0056e92c0 x1874670272927872/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827753 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827728.531997:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e92c0 x1874670272927872/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827753 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827728.532006:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827728.532010:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827728.532014:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272927872:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787827728.532021:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272928000:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787827728.532043:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827728.532055:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827728/real 1787827728]  req@ffff9ee0056eb840 x1874670272928000/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827753 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827728.532068:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb840 x1874670272928000/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827753 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827728.532084:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827728.532088:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827728.532092:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272928000:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787827728.532098:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272928128:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787827728.532120:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827728.532146:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827728/real 1787827728]  req@ffff9ee0056eb480 x1874670272928128/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827753 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827728.532161:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb480 x1874670272928128/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827753 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827728.532172:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827728.532175:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827728.532179:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272928128:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787827728.532196:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272928256:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787827728.532219:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827728.532231:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827728/real 1787827728]  req@ffff9ee0056e8000 x1874670272928256/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827753 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827728.532245:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8000 x1874670272928256/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827753 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827728.532253:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827728.532257:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827728.532261:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272928256:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787827728.532268:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272928384:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787827728.532290:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827728.532312:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827728/real 1787827728]  req@ffff9ee0056e83c0 x1874670272928384/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827753 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827728.532348:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e83c0 x1874670272928384/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827753 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827728.532357:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827728.532361:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827728.532364:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272928384:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827729.363462:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827729.555359:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787827730.387523:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827730.579417:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827731.411424:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827731.603387:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827732.435538:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827732.627404:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827733.459513:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1787827733.651484:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1787827733.651495:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787827733.651496:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787827733.651502:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827733.651516:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2897
00000100:00080000:3.0:1787827733.651544:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827733.651555:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787827733.651616:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707480 x1874670272928512/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827733.651641:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827733.651644:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787827733.651646:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827733.651649:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2897
00000100:00080000:3.0:1787827733.651653:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827733.651657:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827733.651669:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787827733.651678:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272928512:192.168.203.121@tcp:250:kworker.0
00000100:00100000:3.0:1787827733.651682:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057061c0 x1874670272928640/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827733.651701:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827733.651703:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787827733.651705:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827733.651711:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2897
00000100:00080000:3.0:1787827733.651715:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827733.651718:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827733.651722:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827733.651733:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057070c0 x1874670272928768/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827733.651740:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827733.651743:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787827733.651744:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827733.651747:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2897
00000100:00080000:3.0:1787827733.651749:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827733.651752:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827733.651756:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:2.0:1787827733.651759:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827733.651768:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057052c0 x1874670272928896/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827733.651778:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827733.651780:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787827733.651782:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827733.651786:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2897
00000100:00080000:3.0:1787827733.651789:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827733.651794:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827733.651799:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787827733.651805:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827733/real 1787827733]  req@ffff9ee005707480 x1874670272928512/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827758 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827733.651812:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707c00 x1874670272929024/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827733.651835:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1787827733.651839:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707480 x1874670272928512/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827758 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827733.651840:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787827733.651845:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827733.651858:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2897
00000100:00080000:3.0:1787827733.651867:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827733.651870:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827733.651875:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827733.651881:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:2.0:1787827733.651882:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827733.651896:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272928512:192.168.203.121@tcp:250:kworker.0
00000100:00100000:3.0:1787827733.651903:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704000 x1874670272929152/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827733.651912:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827733.651914:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787827733.651916:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827733.651919:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2897
00000100:00080000:3.0:1787827733.651923:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1787827733.651926:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272928640:192.168.203.121@tcp:38:kworker.0
00000100:00080000:3.0:1787827733.651927:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827733.651941:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827733.651957:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706d00 x1874670272929280/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1787827733.651965:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827733.651983:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827733/real 1787827733]  req@ffff9ee0057061c0 x1874670272928640/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827758 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827733.651993:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057061c0 x1874670272928640/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827758 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827733.651999:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827733.652002:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827733.652004:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272928640:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787827733.652009:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272928768:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787827733.652020:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827733.652025:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827733/real 1787827733]  req@ffff9ee0057070c0 x1874670272928768/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827758 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827733.652033:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057070c0 x1874670272928768/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827758 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827733.652038:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827733.652040:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827733.652042:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272928768:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787827733.652045:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272928896:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787827733.652055:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827733.652061:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827733/real 1787827733]  req@ffff9ee0057052c0 x1874670272928896/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827758 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827733.652068:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057052c0 x1874670272928896/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827758 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827733.652073:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827733.652074:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827733.652076:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272928896:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787827733.652080:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272929024:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787827733.652089:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827733.652094:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827733/real 1787827733]  req@ffff9ee005707c00 x1874670272929024/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827758 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827733.652118:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707c00 x1874670272929024/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827758 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827733.652124:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827733.652126:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827733.652128:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272929024:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787827733.652149:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272929152:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787827733.652175:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827733.652188:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827733/real 1787827733]  req@ffff9ee005704000 x1874670272929152/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827758 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827733.652209:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704000 x1874670272929152/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827758 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827733.652218:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827733.652222:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827733.652225:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272929152:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787827733.652246:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272929280:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787827733.652281:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827733.652291:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827733/real 1787827733]  req@ffff9ee005706d00 x1874670272929280/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827758 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827733.652301:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706d00 x1874670272929280/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827758 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827733.652308:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827733.652311:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827733.652314:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272929280:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827734.483609:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827734.675407:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787827735.507457:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827735.699383:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827736.531468:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827736.723377:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827737.555524:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827737.747420:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827738.579568:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827738.771439:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:1.0:1787827738.771517:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827738.771528:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1787827738.771534:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827738.771548:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2902
00000100:00080000:1.0:1787827738.771562:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827738.771574:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787827738.771637:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a21c0 x1874670272929408/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827738.771680:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827738.771684:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787827738.771686:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827738.771691:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2902
00000100:00080000:1.0:1787827738.771697:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827738.771703:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827738.771718:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787827738.771743:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272929408:192.168.203.121@tcp:250:kworker.0
00000100:00100000:1.0:1787827738.771744:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0f00 x1874670272929536/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827738.771781:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827738.771793:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787827738.771795:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827738.771800:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2902
00000100:00080000:1.0:1787827738.771803:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827738.771808:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827738.771814:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787827738.771825:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1680 x1874670272929664/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827738.771836:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827738.771842:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787827738.771845:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827738.771851:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2902
00000100:00080000:1.0:1787827738.771860:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000800:00000100:2.0:1787827738.771886:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:1.0:1787827738.771896:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827738.771911:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787827738.771939:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a2940 x1874670272929792/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787827738.771963:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827738/real 1787827738]  req@ffff9ee0056a21c0 x1874670272929408/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827763 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827738.771964:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827738.771982:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787827738.771989:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827738.772011:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2902
00000100:00080000:1.0:1787827738.772021:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827738.772030:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787827738.772036:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a21c0 x1874670272929408/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827763 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:1.0:1787827738.772043:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00080000:2.0:1787827738.772088:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827738.772097:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827738.772115:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272929408:192.168.203.121@tcp:250:kworker.0
00000100:00100000:1.0:1787827738.772123:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a3c00 x1874670272929920/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827738.772137:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827738.772141:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787827738.772144:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827738.772150:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2902
00000100:00080000:1.0:1787827738.772159:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1787827738.772159:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272929536:192.168.203.121@tcp:38:kworker.0
00000100:00080000:1.0:1787827738.772188:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827738.772196:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:2.0:1787827738.772218:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827738.772230:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1a40 x1874670272930048/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787827738.772244:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827738/real 1787827738]  req@ffff9ee0056a0f00 x1874670272929536/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827763 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827738.772269:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827738.772278:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:2.0:1787827738.772281:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0f00 x1874670272929536/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827763 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827738.772284:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827738.772310:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2902
00000100:00080000:2.0:1787827738.772352:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827738.772360:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827738.772365:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272929536:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787827738.772377:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272929664:192.168.203.121@tcp:8:kworker.0
00000100:00080000:1.0:1787827738.772403:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827738.772414:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000800:00000100:2.0:1787827738.772419:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000008:00100000:1.0:1787827738.772450:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787827738.772465:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827738/real 1787827738]  req@ffff9ee0056a1680 x1874670272929664/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827763 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827738.772483:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a12c0 x1874670272930176/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787827738.772559:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1680 x1874670272929664/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827763 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827738.772575:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827738.772599:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827738.772604:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272929664:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787827738.772615:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272929792:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787827738.772644:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827738.772660:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827738/real 1787827738]  req@ffff9ee0056a2940 x1874670272929792/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827763 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827738.772678:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a2940 x1874670272929792/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827763 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827738.772691:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827738.772695:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827738.772700:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272929792:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787827738.772710:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272929920:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787827738.772751:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827738.772764:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827738/real 1787827738]  req@ffff9ee0056a3c00 x1874670272929920/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827763 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827738.772780:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a3c00 x1874670272929920/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827763 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827738.772798:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827738.772802:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827738.772806:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272929920:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787827738.772831:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272930048:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787827738.772855:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827738.772868:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827738/real 1787827738]  req@ffff9ee0056a1a40 x1874670272930048/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827763 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827738.772883:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1a40 x1874670272930048/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827763 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827738.772894:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827738.772898:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827738.772902:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272930048:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787827738.772910:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272930176:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787827738.772933:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827738.772964:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827738/real 1787827738]  req@ffff9ee0056a12c0 x1874670272930176/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827763 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827738.772984:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a12c0 x1874670272930176/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827763 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827738.772998:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827738.773003:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827738.773010:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272930176:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827739.603509:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827739.795413:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787827740.627481:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827740.819374:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827741.651509:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827741.843431:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827742.675492:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827742.867405:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827743.699590:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1787827743.891409:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827743.891418:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00100000:2.0:1787827743.891419:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:1.0:1787827743.891423:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827743.891434:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2907
00000100:00080000:1.0:1787827743.891443:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827743.891450:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787827743.891482:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a3480 x1874670272930304/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827743.891506:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827743.891509:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787827743.891510:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827743.891513:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2907
00000100:00080000:1.0:1787827743.891515:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827743.891519:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827743.891528:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787827743.891537:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272930304:192.168.203.121@tcp:250:kworker.0
00000100:00100000:1.0:1787827743.891539:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0b40 x1874670272930432/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827743.891551:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827743.891553:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787827743.891554:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827743.891557:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2907
00000100:00080000:1.0:1787827743.891560:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827743.891563:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827743.891566:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787827743.891575:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a2580 x1874670272930560/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827743.891587:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827743.891589:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787827743.891591:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827743.891593:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2907
00000100:00080000:1.0:1787827743.891596:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000800:00000100:2.0:1787827743.891600:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:1.0:1787827743.891601:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827743.891608:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787827743.891615:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a03c0 x1874670272930688/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827743.891639:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827743.891642:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787827743.891644:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827743.891648:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2907
00000100:00080000:1.0:1787827743.891651:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827743.891654:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827743.891659:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787827743.891671:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1e00 x1874670272930816/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787827743.891678:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827743/real 1787827743]  req@ffff9ee0056a3480 x1874670272930304/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827768 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827743.891682:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827743.891691:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787827743.891696:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827743.891713:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2907
00000100:00080000:1.0:1787827743.891718:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1787827743.891720:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a3480 x1874670272930304/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827768 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827743.891725:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827743.891735:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:2.0:1787827743.891742:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827743.891749:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827743.891768:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0000 x1874670272930944/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787827743.891773:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272930304:192.168.203.121@tcp:250:kworker.0
00000100:00080000:1.0:1787827743.891785:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827743.891788:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787827743.891789:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827743.891793:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2907
00000100:00080000:1.0:1787827743.891795:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827743.891798:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827743.891802:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787827743.891804:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272930432:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787827743.891813:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0780 x1874670272931072/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1787827743.891832:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827743.891846:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827743/real 1787827743]  req@ffff9ee0056a0b40 x1874670272930432/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827768 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827743.891875:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0b40 x1874670272930432/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827768 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827743.891883:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827743.891887:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827743.891890:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272930432:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787827743.891895:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272930560:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787827743.891913:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827743.891922:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827743/real 1787827743]  req@ffff9ee0056a2580 x1874670272930560/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827768 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827743.891932:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a2580 x1874670272930560/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827768 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827743.891939:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827743.891941:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827743.891944:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272930560:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787827743.891948:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272930688:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787827743.891961:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827743.891968:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827743/real 1787827743]  req@ffff9ee0056a03c0 x1874670272930688/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827768 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827743.891990:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a03c0 x1874670272930688/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827768 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827743.892001:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827743.892004:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827743.892007:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272930688:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787827743.892012:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272930816:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787827743.892063:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827743.892072:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827743/real 1787827743]  req@ffff9ee0056a1e00 x1874670272930816/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827768 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827743.892081:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1e00 x1874670272930816/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827768 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827743.892087:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827743.892100:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827743.892104:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272930816:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787827743.892128:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272930944:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787827743.892152:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827743.892168:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827743/real 1787827743]  req@ffff9ee0056a0000 x1874670272930944/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827768 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827743.892185:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0000 x1874670272930944/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827768 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827743.892195:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827743.892199:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827743.892202:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272930944:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787827743.892227:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272931072:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787827743.892254:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827743.892270:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827743/real 1787827743]  req@ffff9ee0056a0780 x1874670272931072/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827768 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827743.892297:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0780 x1874670272931072/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827768 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827743.892304:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827743.892306:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827743.892309:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272931072:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827744.723492:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827744.915390:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787827745.747518:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827745.939415:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827746.771482:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827746.963394:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827747.795514:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827747.987440:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827748.819451:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1787827749.011393:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1787827749.011395:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:1.0:1787827749.011403:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1787827749.011408:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827749.011416:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2912
00000100:00080000:1.0:1787827749.011425:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827749.011431:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787827749.011462:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a30c0 x1874670272931200/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827749.011487:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827749.011492:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787827749.011493:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827749.011496:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2912
00000100:00080000:1.0:1787827749.011499:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827749.011502:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827749.011510:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787827749.011522:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272931200:192.168.203.121@tcp:250:kworker.0
00000100:00100000:1.0:1787827749.011524:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0780 x1874670272931328/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827749.011537:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827749.011539:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787827749.011541:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827749.011544:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2912
00000100:00080000:1.0:1787827749.011547:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827749.011549:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827749.011553:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787827749.011562:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0000 x1874670272931456/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827749.011568:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827749.011571:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787827749.011573:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827749.011577:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2912
00000100:00080000:1.0:1787827749.011580:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827749.011585:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000800:00000100:3.0:1787827749.011585:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000008:00100000:1.0:1787827749.011593:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787827749.011601:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1e00 x1874670272931584/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827749.011608:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827749.011610:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787827749.011611:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827749.011615:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2912
00000100:00080000:1.0:1787827749.011618:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827749.011620:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827749.011623:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787827749.011625:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827749/real 1787827749]  req@ffff9ee0056a30c0 x1874670272931200/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827774 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827749.011633:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a03c0 x1874670272931712/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827749.011641:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827749.011646:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00100000:3.0:1787827749.011646:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a30c0 x1874670272931200/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827774 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827749.011650:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827749.011657:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2912
00000100:00080000:1.0:1787827749.011662:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827749.011666:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00080000:3.0:1787827749.011667:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000008:00100000:1.0:1787827749.011669:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:3.0:1787827749.011673:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827749.011678:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272931200:192.168.203.121@tcp:250:kworker.0
00000100:00100000:1.0:1787827749.011681:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a2580 x1874670272931840/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827749.011689:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827749.011691:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787827749.011693:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827749.011695:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2912
00000100:00080000:1.0:1787827749.011697:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827749.011700:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827749.011702:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787827749.011707:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0b40 x1874670272931968/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787827749.011812:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272931328:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787827749.011938:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827749.011950:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827749/real 1787827749]  req@ffff9ee0056a0780 x1874670272931328/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827774 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827749.011961:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0780 x1874670272931328/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827774 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827749.011969:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827749.011972:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827749.011975:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272931328:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787827749.011980:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272931456:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827749.012067:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827749.012076:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827749/real 1787827749]  req@ffff9ee0056a0000 x1874670272931456/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827774 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827749.012084:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0000 x1874670272931456/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827774 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827749.012089:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827749.012091:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827749.012094:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272931456:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787827749.012098:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272931584:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827749.012108:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827749.012114:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827749/real 1787827749]  req@ffff9ee0056a1e00 x1874670272931584/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827774 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827749.012121:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1e00 x1874670272931584/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827774 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827749.012126:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827749.012128:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827749.012130:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272931584:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787827749.012134:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272931712:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787827749.012144:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827749.012149:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827749/real 1787827749]  req@ffff9ee0056a03c0 x1874670272931712/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827774 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827749.012156:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a03c0 x1874670272931712/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827774 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827749.012161:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827749.012163:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827749.012165:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272931712:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787827749.012168:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272931840:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827749.012177:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827749.012182:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827749/real 1787827749]  req@ffff9ee0056a2580 x1874670272931840/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827774 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827749.012188:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a2580 x1874670272931840/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827774 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827749.012193:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827749.012195:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827749.012197:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272931840:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787827749.012201:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272931968:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827749.012213:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827749.012223:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827749/real 1787827749]  req@ffff9ee0056a0b40 x1874670272931968/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827774 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827749.012236:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0b40 x1874670272931968/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827774 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827749.012244:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827749.012248:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827749.012251:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272931968:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827749.843493:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827750.035413:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787827750.867512:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827751.059422:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827751.891516:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827752.083396:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827752.915491:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827753.107366:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827753.939491:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827754.131406:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787827754.131427:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827754.131436:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787827754.131441:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827754.131451:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2917
00000100:00080000:3.0:1787827754.131463:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827754.131470:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787827754.131518:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706940 x1874670272932096/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827754.131555:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827754.131563:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787827754.131566:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827754.131571:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2917
00000100:00080000:3.0:1787827754.131576:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1787827754.131584:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272932096:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787827754.131585:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827754.131607:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787827754.131629:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705680 x1874670272932224/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827754.131640:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827754.131643:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787827754.131645:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827754.131647:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2917
00000100:00080000:3.0:1787827754.131653:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827754.131659:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000800:00000100:2.0:1787827754.131665:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000008:00100000:3.0:1787827754.131671:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827754.131696:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706d00 x1874670272932352/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787827754.131704:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827754/real 1787827754]  req@ffff9ee005706940 x1874670272932096/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827779 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827754.131728:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827754.131735:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787827754.131737:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1787827754.131745:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706940 x1874670272932096/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827779 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827754.131745:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2917
00000100:00080000:3.0:1787827754.131753:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827754.131772:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827754.131780:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00080000:2.0:1787827754.131786:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827754.131795:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272932096:192.168.203.121@tcp:250:kworker.0
00000008:00100000:3.0:1787827754.131800:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787827754.131819:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272932224:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787827754.131822:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704000 x1874670272932480/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827754.131839:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:2.0:1787827754.131858:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787827754.131864:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787827754.131868:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827754.131874:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2917
00000100:00100000:2.0:1787827754.131880:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827754/real 1787827754]  req@ffff9ee005705680 x1874670272932224/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827779 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827754.131883:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827754.131897:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787827754.131905:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705680 x1874670272932224/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827779 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:3.0:1787827754.131906:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00080000:2.0:1787827754.131923:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:3.0:1787827754.131927:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707c00 x1874670272932608/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827754.131929:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827754.131948:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272932224:192.168.203.121@tcp:38:kworker.0
00000100:00080000:3.0:1787827754.131948:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827754.131974:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787827754.131977:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827754.131983:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2917
00000100:00100000:2.0:1787827754.131984:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272932352:192.168.203.121@tcp:8:kworker.0
00000100:00080000:3.0:1787827754.131987:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827754.131995:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827754.132017:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827754.132029:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057052c0 x1874670272932736/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1787827754.132035:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787827754.132052:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1787827754.132056:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827754/real 1787827754]  req@ffff9ee005706d00 x1874670272932352/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827779 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827754.132057:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787827754.132061:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827754.132077:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2917
00000100:00080000:3.0:1787827754.132090:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1787827754.132096:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706d00 x1874670272932352/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827779 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827754.132101:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00080000:2.0:1787827754.132115:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000008:00100000:3.0:1787827754.132118:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:2.0:1787827754.132124:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827754.132132:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272932352:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787827754.132142:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057070c0 x1874670272932864/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787827754.132168:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272932480:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787827754.132200:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827754.132209:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827754/real 1787827754]  req@ffff9ee005704000 x1874670272932480/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827779 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827754.132218:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704000 x1874670272932480/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827779 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827754.132223:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827754.132226:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827754.132228:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272932480:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787827754.132232:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272932608:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787827754.132243:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827754.132248:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827754/real 1787827754]  req@ffff9ee005707c00 x1874670272932608/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827779 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827754.132256:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707c00 x1874670272932608/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827779 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827754.132261:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827754.132263:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827754.132264:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272932608:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787827754.132268:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272932736:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787827754.132278:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827754.132283:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827754/real 1787827754]  req@ffff9ee0057052c0 x1874670272932736/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827779 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827754.132295:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057052c0 x1874670272932736/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827779 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827754.132300:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827754.132302:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827754.132303:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272932736:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787827754.132314:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272932864:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787827754.132366:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827754.132378:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827754/real 1787827754]  req@ffff9ee0057070c0 x1874670272932864/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827779 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827754.132391:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057070c0 x1874670272932864/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827779 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827754.132399:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827754.132402:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827754.132406:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272932864:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827754.963543:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827755.155393:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787827755.987552:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827756.179390:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827757.011474:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827757.203436:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827758.035552:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827758.227378:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827759.059515:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827759.251432:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787827759.251447:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827759.251460:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787827759.251466:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827759.251479:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2922
00000100:00080000:3.0:1787827759.251494:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827759.251503:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787827759.251553:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057061c0 x1874670272932992/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827759.251591:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827759.251595:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787827759.251598:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827759.251602:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2922
00000100:00080000:3.0:1787827759.251607:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827759.251613:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827759.251626:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787827759.251637:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272932992:192.168.203.121@tcp:250:kworker.0
00000100:00100000:3.0:1787827759.251644:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707480 x1874670272933120/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827759.251660:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827759.251665:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787827759.251669:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827759.251674:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2922
00000100:00080000:3.0:1787827759.251678:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827759.251684:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827759.251690:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827759.251707:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057043c0 x1874670272933248/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827759.251721:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:2.0:1787827759.251728:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787827759.251731:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787827759.251735:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827759.251742:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2922
00000100:00080000:3.0:1787827759.251749:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827759.251754:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827759.251760:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827759.251785:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704b40 x1874670272933376/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787827759.251786:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827759/real 1787827759]  req@ffff9ee0057061c0 x1874670272932992/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827784 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827759.251845:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827759.251850:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00100000:2.0:1787827759.251854:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057061c0 x1874670272932992/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827784 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827759.251855:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827759.251870:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2922
00000100:00080000:3.0:1787827759.251881:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827759.251890:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827759.251892:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00080000:2.0:1787827759.251903:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000008:00100000:3.0:1787827759.251905:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787827759.251911:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272932992:192.168.203.121@tcp:250:kworker.0
00000100:00100000:3.0:1787827759.251940:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706580 x1874670272933504/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827759.251954:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827759.251958:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00100000:2.0:1787827759.251963:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272933120:192.168.203.121@tcp:38:kworker.0
00000100:00080000:3.0:1787827759.251964:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827759.251977:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2922
00000100:00080000:3.0:1787827759.251983:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827759.251989:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827759.251995:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:2.0:1787827759.252009:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827759.252015:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704780 x1874670272933632/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827759.252030:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1787827759.252034:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827759/real 1787827759]  req@ffff9ee005707480 x1874670272933120/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827784 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827759.252037:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787827759.252041:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827759.252054:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2922
00000100:00080000:3.0:1787827759.252070:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1787827759.252078:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707480 x1874670272933120/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827784 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827759.252080:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827759.252094:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:2.0:1787827759.252101:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827759.252111:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827759.252114:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705a40 x1874670272933760/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787827759.252121:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272933120:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787827759.252147:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272933248:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787827759.252178:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827759.252193:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827759/real 1787827759]  req@ffff9ee0057043c0 x1874670272933248/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827784 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827759.252207:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057043c0 x1874670272933248/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827784 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827759.252222:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827759.252226:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827759.252230:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272933248:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787827759.252237:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272933376:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787827759.252257:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827759.252267:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827759/real 1787827759]  req@ffff9ee005704b40 x1874670272933376/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827784 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827759.252279:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704b40 x1874670272933376/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827784 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827759.252287:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827759.252291:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827759.252294:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272933376:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787827759.252300:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272933504:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787827759.252343:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827759.252356:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827759/real 1787827759]  req@ffff9ee005706580 x1874670272933504/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827784 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827759.252368:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706580 x1874670272933504/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827784 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827759.252376:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827759.252379:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827759.252382:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272933504:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787827759.252400:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272933632:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787827759.252420:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827759.252430:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827759/real 1787827759]  req@ffff9ee005704780 x1874670272933632/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827784 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827759.252442:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704780 x1874670272933632/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827784 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827759.252450:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827759.252453:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827759.252457:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272933632:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787827759.252463:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272933760:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787827759.252480:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827759.252491:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827759/real 1787827759]  req@ffff9ee005705a40 x1874670272933760/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827784 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827759.252504:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705a40 x1874670272933760/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827784 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827759.252512:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827759.252516:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827759.252520:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272933760:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827760.083446:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827760.275367:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787827761.107560:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827761.299435:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827762.131525:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827762.323377:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827763.155516:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827763.347406:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827764.179501:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827764.371386:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:0.0:1787827764.371421:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827764.371427:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1787827764.371430:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827764.371438:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2928
00000100:00080000:0.0:1787827764.371447:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827764.371453:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787827764.371485:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ebc00 x1874670272933888/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827764.371507:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827764.371509:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787827764.371511:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827764.371513:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2928
00000100:00080000:0.0:1787827764.371516:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827764.371519:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827764.371527:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787827764.371538:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272933888:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787827764.371539:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8f00 x1874670272934016/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827764.371551:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827764.371553:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787827764.371555:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827764.371564:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2928
00000100:00080000:0.0:1787827764.371566:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827764.371569:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827764.371573:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787827764.371583:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e83c0 x1874670272934144/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827764.371590:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827764.371592:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787827764.371594:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:2.0:1787827764.371598:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:0.0:1787827764.371601:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2928
00000100:00080000:0.0:1787827764.371605:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827764.371608:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827764.371612:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787827764.371620:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8000 x1874670272934272/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827764.371626:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827764.371629:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787827764.371630:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827764.371636:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2928
00000100:00100000:2.0:1787827764.371636:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827764/real 1787827764]  req@ffff9ee0056ebc00 x1874670272933888/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827789 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827764.371638:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827764.371645:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827764.371653:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787827764.371661:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ebc00 x1874670272933888/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827789 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827764.371664:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb480 x1874670272934400/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827764.371692:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827764.371695:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827764.371696:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787827764.371699:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827764.371705:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2928
00000100:00080000:2.0:1787827764.371706:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:0.0:1787827764.371707:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827764.371713:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787827764.371717:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272933888:192.168.203.121@tcp:250:kworker.0
00000008:00100000:0.0:1787827764.371718:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787827764.371730:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb840 x1874670272934528/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827764.371737:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827764.371739:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787827764.371740:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827764.371743:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2928
00000100:00100000:2.0:1787827764.371746:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272934016:192.168.203.121@tcp:38:kworker.0
00000100:00080000:0.0:1787827764.371748:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827764.371754:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827764.371758:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787827764.371767:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e92c0 x1874670272934656/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1787827764.371776:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827764.371789:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827764/real 1787827764]  req@ffff9ee0056e8f00 x1874670272934016/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827789 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827764.371799:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8f00 x1874670272934016/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827789 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827764.371805:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827764.371807:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827764.371810:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272934016:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787827764.371814:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272934144:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787827764.371827:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827764.371833:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827764/real 1787827764]  req@ffff9ee0056e83c0 x1874670272934144/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827789 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827764.371840:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e83c0 x1874670272934144/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827789 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827764.371845:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827764.371847:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827764.371849:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272934144:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787827764.371852:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272934272:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787827764.371862:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827764.371867:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827764/real 1787827764]  req@ffff9ee0056e8000 x1874670272934272/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827789 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827764.371874:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8000 x1874670272934272/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827789 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827764.371879:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827764.371881:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827764.371900:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272934272:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787827764.371905:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272934400:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787827764.371919:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827764.371926:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827764/real 1787827764]  req@ffff9ee0056eb480 x1874670272934400/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827789 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827764.371947:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb480 x1874670272934400/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827789 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827764.371952:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827764.371954:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827764.371956:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272934400:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787827764.371959:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272934528:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787827764.371969:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827764.371974:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827764/real 1787827764]  req@ffff9ee0056eb840 x1874670272934528/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827789 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827764.371981:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb840 x1874670272934528/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827789 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827764.371986:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827764.371988:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827764.371990:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272934528:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787827764.372001:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272934656:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787827764.372011:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827764.372017:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827764/real 1787827764]  req@ffff9ee0056e92c0 x1874670272934656/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827789 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827764.372024:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e92c0 x1874670272934656/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827789 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827764.372034:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827764.372036:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827764.372038:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272934656:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827765.203648:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827765.395416:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787827766.227454:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827766.419387:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827767.251546:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827767.443385:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827768.275506:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827768.467380:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827769.299503:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827769.491447:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:0.0:1787827769.491466:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827769.491477:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1787827769.491483:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827769.491496:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2933
00000100:00080000:0.0:1787827769.491510:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827769.491518:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787827769.491563:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9680 x1874670272934784/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827769.491587:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827769.491591:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787827769.491592:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827769.491595:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2933
00000100:00080000:0.0:1787827769.491599:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827769.491603:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827769.491614:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787827769.491623:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272934784:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787827769.491625:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8b40 x1874670272934912/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827769.491644:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827769.491647:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787827769.491649:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827769.491654:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2933
00000100:00080000:0.0:1787827769.491657:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827769.491661:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827769.491665:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787827769.491677:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9e00 x1874670272935040/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827769.491685:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827769.491688:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787827769.491689:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827769.491691:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2933
00000100:00080000:0.0:1787827769.491693:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827769.491695:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827769.491699:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:2.0:1787827769.491704:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827769.491709:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8780 x1874670272935168/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827769.491719:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827769.491722:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787827769.491723:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827769.491727:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2933
00000100:00080000:0.0:1787827769.491731:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827769.491735:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827769.491755:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787827769.491756:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827769/real 1787827769]  req@ffff9ee0056e9680 x1874670272934784/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827794 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827769.491773:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ead00 x1874670272935296/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787827769.491780:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9680 x1874670272934784/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827794 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827769.491805:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827769.491814:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787827769.491817:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827769.491818:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827769.491839:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:0.0:1787827769.491841:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2933
00000100:00100000:2.0:1787827769.491857:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272934784:192.168.203.121@tcp:250:kworker.0
00000100:00080000:0.0:1787827769.491864:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827769.491873:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827769.491882:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787827769.491887:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272934912:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787827769.491902:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ea580 x1874670272935424/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1787827769.491915:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:0.0:1787827769.491917:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827769.491922:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787827769.491924:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827769.491931:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2933
00000100:00100000:2.0:1787827769.491932:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827769/real 1787827769]  req@ffff9ee0056e8b40 x1874670272934912/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827794 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827769.491940:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827769.491953:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827769.491970:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787827769.491976:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8b40 x1874670272934912/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827794 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827769.491986:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9a40 x1874670272935552/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827769.491987:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827769.492003:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827769.492011:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272934912:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787827769.492032:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272935040:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787827769.492069:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827769.492090:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827769/real 1787827769]  req@ffff9ee0056e9e00 x1874670272935040/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827794 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827769.492114:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9e00 x1874670272935040/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827794 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827769.492123:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827769.492128:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827769.492135:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272935040:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787827769.492144:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272935168:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787827769.492167:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827769.492178:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827769/real 1787827769]  req@ffff9ee0056e8780 x1874670272935168/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827794 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827769.492191:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8780 x1874670272935168/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827794 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827769.492215:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827769.492218:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827769.492220:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272935168:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787827769.492225:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272935296:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787827769.492240:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827769.492247:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827769/real 1787827769]  req@ffff9ee0056ead00 x1874670272935296/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827794 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827769.492254:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ead00 x1874670272935296/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827794 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827769.492260:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827769.492262:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827769.492264:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272935296:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787827769.492276:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272935424:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787827769.492286:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827769.492299:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827769/real 1787827769]  req@ffff9ee0056ea580 x1874670272935424/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827794 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827769.492306:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ea580 x1874670272935424/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827794 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827769.492311:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827769.492313:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827769.492335:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272935424:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787827769.492340:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272935552:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787827769.492351:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827769.492358:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827769/real 1787827769]  req@ffff9ee0056e9a40 x1874670272935552/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827794 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827769.492365:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9a40 x1874670272935552/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827794 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827769.492371:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827769.492373:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827769.492374:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272935552:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827770.323443:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827770.515379:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787827771.347502:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827771.539416:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827772.371530:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827772.563406:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827773.395490:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827773.587452:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827774.419545:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827774.611384:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:1.0:1787827774.611441:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827774.611446:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1787827774.611450:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827774.611457:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2938
00000100:00080000:1.0:1787827774.611466:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827774.611471:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787827774.611502:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a3480 x1874670272935680/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827774.611523:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827774.611526:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787827774.611527:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827774.611530:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2938
00000100:00080000:1.0:1787827774.611533:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827774.611536:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827774.611544:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787827774.611553:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272935680:192.168.203.121@tcp:250:kworker.0
00000100:00100000:1.0:1787827774.611554:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a12c0 x1874670272935808/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827774.611572:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827774.611575:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787827774.611576:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827774.611578:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2938
00000100:00080000:1.0:1787827774.611581:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827774.611583:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827774.611587:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787827774.611596:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1a40 x1874670272935936/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827774.611602:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827774.611605:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787827774.611606:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827774.611608:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2938
00000100:00080000:1.0:1787827774.611611:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827774.611616:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000800:00000100:2.0:1787827774.611616:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000008:00100000:1.0:1787827774.611623:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787827774.611630:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a3c00 x1874670272936064/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827774.611637:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827774.611640:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787827774.611641:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827774.611643:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2938
00000100:00080000:1.0:1787827774.611646:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827774.611649:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827774.611652:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787827774.611658:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a2940 x1874670272936192/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827774.611664:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827774.611668:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00100000:2.0:1787827774.611669:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827774/real 1787827774]  req@ffff9ee0056a3480 x1874670272935680/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827799 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827774.611670:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827774.611679:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2938
00000100:00080000:1.0:1787827774.611684:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827774.611687:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827774.611690:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787827774.611695:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a3480 x1874670272935680/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827799 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827774.611702:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1680 x1874670272936320/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827774.611708:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827774.611711:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827774.611715:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:1.0:1787827774.611717:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787827774.611720:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1787827774.611721:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272935680:192.168.203.121@tcp:250:kworker.0
00000100:00080000:1.0:1787827774.611725:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2938
00000100:00080000:1.0:1787827774.611729:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827774.611732:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827774.611735:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787827774.611742:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0f00 x1874670272936448/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787827774.611746:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272935808:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787827774.611775:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827774.611786:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827774/real 1787827774]  req@ffff9ee0056a12c0 x1874670272935808/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827799 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827774.611794:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a12c0 x1874670272935808/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827799 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827774.611800:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827774.611802:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827774.611804:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272935808:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787827774.611808:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272935936:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787827774.611835:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827774.611843:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827774/real 1787827774]  req@ffff9ee0056a1a40 x1874670272935936/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827799 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827774.611851:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1a40 x1874670272935936/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827799 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827774.611856:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827774.611858:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827774.611860:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272935936:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787827774.611864:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272936064:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787827774.611874:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827774.611879:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827774/real 1787827774]  req@ffff9ee0056a3c00 x1874670272936064/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827799 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827774.611886:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a3c00 x1874670272936064/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827799 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827774.611891:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827774.611893:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827774.611895:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272936064:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787827774.611898:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272936192:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787827774.611907:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827774.611912:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827774/real 1787827774]  req@ffff9ee0056a2940 x1874670272936192/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827799 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827774.611919:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a2940 x1874670272936192/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827799 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827774.611924:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827774.611926:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827774.611928:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272936192:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787827774.611931:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272936320:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787827774.611940:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827774.611946:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827774/real 1787827774]  req@ffff9ee0056a1680 x1874670272936320/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827799 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827774.611957:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1680 x1874670272936320/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827799 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827774.611962:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827774.611963:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827774.611965:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272936320:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787827774.611977:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272936448:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787827774.611987:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827774.611993:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827774/real 1787827774]  req@ffff9ee0056a0f00 x1874670272936448/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827799 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827774.611999:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0f00 x1874670272936448/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827799 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827774.612004:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827774.612013:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827774.612015:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272936448:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827775.443470:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827775.635451:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787827776.467449:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827776.659422:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827777.491499:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827777.683392:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827778.515510:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827778.707374:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827779.539526:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827779.731462:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:1.0:1787827779.731464:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827779.731476:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1787827779.731482:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827779.731493:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2943
00000100:00080000:1.0:1787827779.731505:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827779.731513:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787827779.731583:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a21c0 x1874670272936576/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827779.731657:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827779.731665:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787827779.731670:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827779.731678:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2943
00000100:00080000:1.0:1787827779.731686:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827779.731694:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827779.731725:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787827779.731748:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272936576:192.168.203.121@tcp:250:kworker.0
00000100:00100000:1.0:1787827779.731750:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0f00 x1874670272936704/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827779.731810:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827779.731815:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787827779.731819:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827779.731824:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2943
00000100:00080000:1.0:1787827779.731829:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827779.731835:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827779.731843:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787827779.731861:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1680 x1874670272936832/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827779.731874:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827779.731878:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787827779.731881:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:2.0:1787827779.731891:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:1.0:1787827779.731897:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2943
00000100:00080000:1.0:1787827779.731904:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827779.731909:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827779.731914:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787827779.731927:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a2940 x1874670272936960/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827779.731938:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827779.731941:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787827779.731944:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827779.731949:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2943
00000100:00080000:1.0:1787827779.731953:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827779.731958:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827779.731964:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787827779.731978:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a3c00 x1874670272937088/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787827779.731985:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827779/real 1787827779]  req@ffff9ee0056a21c0 x1874670272936576/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827804 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827779.731995:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827779.732026:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787827779.732034:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827779.732043:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2943
00000100:00080000:1.0:1787827779.732049:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1787827779.732055:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a21c0 x1874670272936576/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827804 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827779.732057:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827779.732069:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:2.0:1787827779.732083:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827779.732100:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827779.732103:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1a40 x1874670272937216/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787827779.732110:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272936576:192.168.203.121@tcp:250:kworker.0
00000100:00080000:1.0:1787827779.732132:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827779.732136:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787827779.732139:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827779.732144:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2943
00000100:00080000:1.0:1787827779.732148:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827779.732157:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787827779.732157:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272936704:192.168.203.121@tcp:38:kworker.0
00000008:00100000:1.0:1787827779.732172:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787827779.732190:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a12c0 x1874670272937344/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1787827779.732210:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827779.732238:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827779/real 1787827779]  req@ffff9ee0056a0f00 x1874670272936704/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827804 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827779.732253:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0f00 x1874670272936704/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827804 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827779.732263:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827779.732267:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827779.732270:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272936704:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787827779.732277:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272936832:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787827779.732306:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827779.732316:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827779/real 1787827779]  req@ffff9ee0056a1680 x1874670272936832/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827804 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827779.732374:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1680 x1874670272936832/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827804 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827779.732402:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827779.732408:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827779.732414:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272936832:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787827779.732424:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272936960:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787827779.732451:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827779.732464:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827779/real 1787827779]  req@ffff9ee0056a2940 x1874670272936960/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827804 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827779.732476:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a2940 x1874670272936960/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827804 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827779.732485:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827779.732488:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827779.732492:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272936960:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787827779.732498:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272937088:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787827779.732514:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827779.732523:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827779/real 1787827779]  req@ffff9ee0056a3c00 x1874670272937088/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827804 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827779.732535:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a3c00 x1874670272937088/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827804 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827779.732543:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827779.732546:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827779.732550:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272937088:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787827779.732555:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272937216:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787827779.732570:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827779.732579:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827779/real 1787827779]  req@ffff9ee0056a1a40 x1874670272937216/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827804 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827779.732591:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1a40 x1874670272937216/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827804 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827779.732598:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827779.732601:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827779.732622:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272937216:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787827779.732661:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272937344:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787827779.732708:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827779.732747:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827779/real 1787827779]  req@ffff9ee0056a12c0 x1874670272937344/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827804 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827779.732769:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a12c0 x1874670272937344/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827804 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827779.732811:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827779.732817:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827779.732823:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272937344:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827780.563526:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827780.755478:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787827781.587540:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827781.779402:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827782.611541:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827782.803411:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827783.635482:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827783.827378:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827784.659505:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1787827784.851400:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827784.851409:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1787827784.851413:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827784.851421:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2948
00000100:00080000:1.0:1787827784.851430:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827784.851438:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787827784.851461:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00100000:1.0:1787827784.851470:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a3480 x1874670272937472/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827784.851498:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827784.851503:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787827784.851505:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827784.851511:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2948
00000100:00080000:1.0:1787827784.851515:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827784.851521:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787827784.851521:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272937472:192.168.203.121@tcp:250:kworker.0
00000008:00100000:1.0:1787827784.851535:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787827784.851549:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0b40 x1874670272937600/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827784.851558:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827784.851561:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787827784.851562:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827784.851565:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2948
00000100:00080000:1.0:1787827784.851568:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827784.851571:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827784.851574:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787827784.851582:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a2580 x1874670272937728/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827784.851589:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827784.851591:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787827784.851593:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827784.851595:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2948
00000100:00080000:1.0:1787827784.851599:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827784.851602:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827784.851606:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787827784.851618:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a03c0 x1874670272937856/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787827784.851619:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272937600:192.168.203.121@tcp:38:kworker.0
00000100:00080000:1.0:1787827784.851635:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827784.851638:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787827784.851639:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827784.851643:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2948
00000100:00080000:1.0:1787827784.851650:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827784.851653:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827784.851657:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787827784.851661:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272937728:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827784.851667:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1e00 x1874670272937984/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827784.851675:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827784.851678:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787827784.851679:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827784.851683:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2948
00000100:00080000:1.0:1787827784.851686:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1787827784.851687:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272937856:192.168.203.121@tcp:8:kworker.0
00000100:00080000:1.0:1787827784.851691:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827784.851696:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787827784.851707:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0000 x1874670272938112/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787827784.851715:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272937984:192.168.203.121@tcp:38:kworker.0
00000100:00080000:1.0:1787827784.851726:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827784.851728:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787827784.851730:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827784.851734:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2948
00000100:00080000:1.0:1787827784.851738:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827784.851755:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827784.851760:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787827784.851775:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0780 x1874670272938240/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787827784.851775:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272938112:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787827784.851812:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272938240:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827785.683546:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827785.875409:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787827786.707515:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827786.899406:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827787.731572:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827787.923436:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000400:00000100:1.0:1787827787.923610:0:2355:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.203.121:988
00000400:00000100:1.0:1787827787.923650:0:2355:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.203.121@tcp at host 192.168.203.121 was unreachable: the network or that node may be down, or Lustre may be misconfigured.
00000800:00000100:1.0:1787827787.923668:0:2355:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:1.0:1787827787.923711:0:2355:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:1.0:1787827787.923734:0:2355:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:1.0:1787827787.923744:0:2355:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:1.0:1787827787.923755:0:2355:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:1.0:1787827787.923765:0:2355:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000100:00100000:2.0:1787827787.923771:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827784/real 1787827787]  req@ffff9ee0056a03c0 x1874670272937856/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827809 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000800:00000100:1.0:1787827787.923777:0:2355:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000100:00100000:2.0:1787827787.923807:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a03c0 x1874670272937856/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827809 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827787.923820:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827787.923826:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827787.923830:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272937856:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787827787.923838:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827784/real 1787827787]  req@ffff9ee0056a1e00 x1874670272937984/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827809 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827787.923851:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1e00 x1874670272937984/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827809 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827787.923860:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827787.923863:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827787.923867:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272937984:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787827787.923874:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827784/real 1787827787]  req@ffff9ee0056a0b40 x1874670272937600/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827809 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827787.923887:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0b40 x1874670272937600/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827809 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827787.923896:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827787.923899:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827787.923901:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272937600:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787827787.923908:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827784/real 1787827787]  req@ffff9ee0056a2580 x1874670272937728/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827809 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827787.923921:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a2580 x1874670272937728/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827809 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827787.923928:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827787.923931:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827787.923934:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272937728:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787827787.923941:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827784/real 1787827787]  req@ffff9ee0056a3480 x1874670272937472/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827809 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827787.923953:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a3480 x1874670272937472/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827809 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827787.923962:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827787.923965:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827787.923968:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272937472:192.168.203.121@tcp:250:kworker.0
00000100:00100000:2.0:1787827787.923997:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827784/real 1787827787]  req@ffff9ee0056a0780 x1874670272938240/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827809 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827787.924009:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0780 x1874670272938240/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827809 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827787.924017:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827787.924021:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827787.924025:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272938240:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787827787.924031:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827784/real 1787827787]  req@ffff9ee0056a0000 x1874670272938112/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827809 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827787.924040:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0000 x1874670272938112/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827809 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827787.924047:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827787.924049:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827787.924052:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272938112:192.168.203.121@tcp:8:kworker.0
00010000:00010000:3.0:1787827788.755537:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827788.947445:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827789.779547:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827789.971403:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:1.0:1787827789.971432:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827789.971441:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1787827789.971445:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827789.971457:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2953
00000100:00080000:1.0:1787827789.971469:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827789.971477:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787827789.971518:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a30c0 x1874670272938368/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827789.971546:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827789.971550:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787827789.971552:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827789.971558:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2953
00000100:00080000:1.0:1787827789.971563:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827789.971569:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827789.971582:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787827789.971584:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272938368:192.168.203.121@tcp:250:kworker.0
00000100:00100000:1.0:1787827789.971615:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0000 x1874670272938496/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827789.971630:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827789.971635:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787827789.971637:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827789.971642:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2953
00000100:00080000:1.0:1787827789.971649:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827789.971654:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000800:00000100:2.0:1787827789.971661:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000008:00100000:1.0:1787827789.971662:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787827789.971682:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0780 x1874670272938624/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827789.971695:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827789.971698:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787827789.971700:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827789.971721:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2953
00000100:00080000:1.0:1787827789.971726:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827789.971731:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827789.971738:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787827789.971754:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827789/real 1787827789]  req@ffff9ee0056a30c0 x1874670272938368/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827814 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827789.971758:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a3480 x1874670272938752/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827789.971828:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827789.971836:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787827789.971839:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1787827789.971844:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a30c0 x1874670272938368/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827814 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827789.971850:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2953
00000100:00080000:1.0:1787827789.971859:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827789.971869:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00080000:2.0:1787827789.971873:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000008:00100000:1.0:1787827789.971877:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00080000:2.0:1787827789.971887:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827789.971895:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272938368:192.168.203.121@tcp:250:kworker.0
00000100:00100000:1.0:1787827789.971909:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a2580 x1874670272938880/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827789.971922:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827789.971926:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787827789.971928:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827789.971933:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2953
00000100:00080000:1.0:1787827789.971939:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827789.971943:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827789.971949:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787827789.971957:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272938496:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787827789.971966:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0b40 x1874670272939008/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827789.971982:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827789.971986:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787827789.971989:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827789.971994:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2953
00000800:00000100:2.0:1787827789.972006:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:1.0:1787827789.972009:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827789.972017:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827789.972023:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787827789.972034:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827789/real 1787827789]  req@ffff9ee0056a0000 x1874670272938496/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827814 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827789.972044:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1e00 x1874670272939136/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787827789.972066:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0000 x1874670272938496/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827814 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827789.972081:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827789.972085:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827789.972091:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272938496:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787827789.972108:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272938624:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787827789.972139:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827789.972153:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827789/real 1787827789]  req@ffff9ee0056a0780 x1874670272938624/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827814 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827789.972166:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0780 x1874670272938624/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827814 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827789.972186:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827789.972191:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827789.972194:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272938624:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787827789.972202:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272938752:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787827789.972225:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827789.972237:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827789/real 1787827789]  req@ffff9ee0056a3480 x1874670272938752/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827814 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827789.972248:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a3480 x1874670272938752/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827814 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827789.972256:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827789.972259:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827789.972262:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272938752:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787827789.972269:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272938880:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787827789.972290:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827789.972302:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827789/real 1787827789]  req@ffff9ee0056a2580 x1874670272938880/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827814 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827789.972347:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a2580 x1874670272938880/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827814 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827789.972356:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827789.972361:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827789.972365:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272938880:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787827789.972388:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272939008:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787827789.972412:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827789.972426:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827789/real 1787827789]  req@ffff9ee0056a0b40 x1874670272939008/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827814 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827789.972439:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0b40 x1874670272939008/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827814 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827789.972448:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827789.972452:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827789.972455:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272939008:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787827789.972462:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272939136:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787827789.972483:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827789.972495:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827789/real 1787827789]  req@ffff9ee0056a1e00 x1874670272939136/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827814 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827789.972509:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1e00 x1874670272939136/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827814 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827789.972517:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827789.972520:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827789.972524:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272939136:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827790.803548:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827790.995429:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787827791.827525:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827792.019389:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827792.851549:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827793.043500:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827793.875522:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827794.067548:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827794.899664:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827795.091447:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:1.0:1787827795.091513:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827795.091522:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1787827795.091529:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827795.091542:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2958
00000100:00080000:1.0:1787827795.091576:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827795.091587:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787827795.091704:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a03c0 x1874670272939264/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827795.091762:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827795.091767:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787827795.091769:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827795.091775:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2958
00000100:00080000:1.0:1787827795.091780:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827795.091785:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827795.091801:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787827795.091821:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272939264:192.168.203.121@tcp:250:kworker.0
00000100:00100000:1.0:1787827795.091824:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a12c0 x1874670272939392/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827795.091862:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827795.091866:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787827795.091868:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827795.091874:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2958
00000100:00080000:1.0:1787827795.091878:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827795.091882:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827795.091887:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787827795.091920:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1a40 x1874670272939520/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827795.091931:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827795.091935:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787827795.091936:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827795.091941:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2958
00000100:00080000:1.0:1787827795.091948:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827795.091952:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827795.091958:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:2.0:1787827795.091967:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827795.091976:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a3c00 x1874670272939648/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827795.091989:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827795.091993:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787827795.091997:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827795.092003:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2958
00000100:00080000:1.0:1787827795.092007:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827795.092012:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827795.092018:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787827795.092030:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a2940 x1874670272939776/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827795.092042:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827795.092046:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787827795.092054:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1787827795.092055:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827795/real 1787827795]  req@ffff9ee0056a03c0 x1874670272939264/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827820 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827795.092065:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2958
00000100:00080000:1.0:1787827795.092074:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827795.092083:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827795.092092:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787827795.092112:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a03c0 x1874670272939264/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827820 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827795.092126:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1680 x1874670272939904/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827795.092132:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827795.092147:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827795.092167:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272939264:192.168.203.121@tcp:250:kworker.0
00000100:00080000:1.0:1787827795.092173:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827795.092183:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787827795.092188:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827795.092199:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2958
00000100:00080000:1.0:1787827795.092208:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1787827795.092213:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272939392:192.168.203.121@tcp:38:kworker.0
00000100:00080000:1.0:1787827795.092222:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827795.092233:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:2.0:1787827795.092259:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827795.092261:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0f00 x1874670272940032/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787827795.092284:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827795/real 1787827795]  req@ffff9ee0056a12c0 x1874670272939392/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827820 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827795.092303:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a12c0 x1874670272939392/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827820 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827795.092346:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827795.092351:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827795.092355:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272939392:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787827795.092363:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272939520:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787827795.092389:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827795.092403:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827795/real 1787827795]  req@ffff9ee0056a1a40 x1874670272939520/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827820 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827795.092428:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1a40 x1874670272939520/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827820 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827795.092437:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827795.092441:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827795.092445:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272939520:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787827795.092454:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272939648:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787827795.092501:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827795.092518:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827795/real 1787827795]  req@ffff9ee0056a3c00 x1874670272939648/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827820 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827795.092538:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a3c00 x1874670272939648/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827820 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827795.092552:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827795.092576:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827795.092582:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272939648:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787827795.092590:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272939776:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787827795.092618:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827795.092650:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827795/real 1787827795]  req@ffff9ee0056a2940 x1874670272939776/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827820 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827795.092737:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a2940 x1874670272939776/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827820 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827795.092747:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827795.092751:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827795.092755:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272939776:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787827795.092763:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272939904:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787827795.092788:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827795.092801:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827795/real 1787827795]  req@ffff9ee0056a1680 x1874670272939904/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827820 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827795.092814:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1680 x1874670272939904/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827820 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827795.092823:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827795.092827:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827795.092847:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272939904:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787827795.092870:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272940032:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787827795.092888:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827795.092916:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827795/real 1787827795]  req@ffff9ee0056a0f00 x1874670272940032/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827820 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827795.092930:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0f00 x1874670272940032/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827820 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827795.092947:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827795.092950:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827795.092954:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272940032:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827795.923524:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827796.115520:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787827796.947498:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827797.139385:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827797.971538:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827798.163502:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827798.995451:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827799.187392:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827800.019518:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1787827800.211411:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827800.211420:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1787827800.211424:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827800.211438:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2963
00000100:00100000:3.0:1787827800.211440:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:0.0:1787827800.211450:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827800.211465:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787827800.211503:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ea940 x1874670272940160/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827800.211527:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827800.211531:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787827800.211532:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827800.211535:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2963
00000100:00080000:0.0:1787827800.211538:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827800.211540:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827800.211549:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787827800.211563:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb0c0 x1874670272940288/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827800.211570:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827800.211573:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787827800.211574:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827800.211577:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2963
00000100:00080000:0.0:1787827800.211579:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827800.211582:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827800.211586:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787827800.211595:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9a40 x1874670272940416/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827800.211609:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1787827800.211611:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272940160:192.168.203.121@tcp:250:kworker.0
00000100:00080000:0.0:1787827800.211612:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787827800.211616:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827800.211623:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2963
00000100:00080000:0.0:1787827800.211626:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827800.211628:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827800.211631:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787827800.211651:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ea580 x1874670272940544/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827800.211658:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827800.211661:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787827800.211663:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827800.211666:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2963
00000100:00080000:0.0:1787827800.211669:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827800.211672:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827800.211676:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787827800.211684:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ead00 x1874670272940672/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827800.211692:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:2.0:1787827800.211696:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:0.0:1787827800.211698:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787827800.211702:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827800.211705:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2963
00000100:00080000:0.0:1787827800.211709:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827800.211712:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827800.211716:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787827800.211726:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8780 x1874670272940800/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827800.211732:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827800.211735:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787827800.211737:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1787827800.211741:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827800/real 1787827800]  req@ffff9ee0056ea940 x1874670272940160/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827825 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827800.211742:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2963
00000100:00080000:0.0:1787827800.211748:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827800.211754:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827800.211762:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787827800.211772:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ea940 x1874670272940160/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827825 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827800.211773:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9e00 x1874670272940928/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827800.211804:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827800.211809:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827800.211813:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272940160:192.168.203.121@tcp:250:kworker.0
00000100:00100000:2.0:1787827800.211821:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272940288:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787827800.211848:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827800.211857:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827800/real 1787827800]  req@ffff9ee0056eb0c0 x1874670272940288/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827825 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827800.211866:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb0c0 x1874670272940288/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827825 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827800.211872:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827800.211874:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827800.211878:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272940288:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787827800.211896:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272940416:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787827800.211909:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827800.211916:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827800/real 1787827800]  req@ffff9ee0056e9a40 x1874670272940416/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827825 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827800.211924:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9a40 x1874670272940416/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827825 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827800.211929:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827800.211931:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827800.211933:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272940416:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787827800.211937:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272940544:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787827800.211947:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827800.211953:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827800/real 1787827800]  req@ffff9ee0056ea580 x1874670272940544/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827825 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827800.211961:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ea580 x1874670272940544/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827825 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827800.211966:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827800.211968:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827800.211970:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272940544:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787827800.211973:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272940672:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787827800.211983:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827800.211989:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827800/real 1787827800]  req@ffff9ee0056ead00 x1874670272940672/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827825 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827800.211997:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ead00 x1874670272940672/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827825 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827800.212002:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827800.212004:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827800.212006:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272940672:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787827800.212009:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272940800:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787827800.212019:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827800.212025:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827800/real 1787827800]  req@ffff9ee0056e8780 x1874670272940800/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827825 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827800.212032:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8780 x1874670272940800/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827825 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827800.212038:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827800.212040:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827800.212042:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272940800:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787827800.212045:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272940928:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787827800.212055:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827800.212060:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827800/real 1787827800]  req@ffff9ee0056e9e00 x1874670272940928/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827825 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827800.212067:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9e00 x1874670272940928/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827825 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827800.212073:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827800.212075:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827800.212078:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272940928:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827801.043466:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827801.235476:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787827802.067574:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827802.259414:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827803.091501:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827803.283399:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827804.115640:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827804.307475:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827805.139672:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827805.331534:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:2.0:1787827805.331595:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827805.331662:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787827805.331669:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827805.331703:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2969
00000100:00080000:2.0:1787827805.331722:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827805.331734:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787827805.331798:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572bc00 x1874670272941056/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827805.331849:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827805.331855:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787827805.331858:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827805.331863:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2969
00000100:00080000:2.0:1787827805.331872:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827805.331894:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827805.331932:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787827805.331950:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272941056:192.168.203.121@tcp:250:kworker.0
00000100:00100000:2.0:1787827805.331967:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729680 x1874670272941184/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827805.331998:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827805.332007:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787827805.332011:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827805.332021:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2969
00000100:00080000:2.0:1787827805.332045:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000800:00000100:3.0:1787827805.332057:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:2.0:1787827805.332061:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827805.332079:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787827805.332111:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057292c0 x1874670272941312/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787827805.332123:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827805/real 1787827805]  req@ffff9ee00572bc00 x1874670272941056/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827830 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827805.332179:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1787827805.332186:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572bc00 x1874670272941056/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827830 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827805.332195:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787827805.332211:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827805.332230:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827805.332231:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2969
00000100:00080000:2.0:1787827805.332257:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827805.332276:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:2.0:1787827805.332287:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787827805.332297:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272941056:192.168.203.121@tcp:250:kworker.0
00000008:00100000:2.0:1787827805.332307:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827805.332377:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272941184:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787827805.332388:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572bc00 x1874670272941440/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827805.332409:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827805.332415:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787827805.332418:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:3.0:1787827805.332430:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:2.0:1787827805.332437:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2969
00000100:00080000:2.0:1787827805.332446:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827805.332458:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787827805.332463:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827805/real 1787827805]  req@ffff9ee005729680 x1874670272941184/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827830 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:2.0:1787827805.332469:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787827805.332506:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728780 x1874670272941568/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787827805.332507:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729680 x1874670272941184/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827830 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827805.332627:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827805.332629:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827805.332655:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00080000:2.0:1787827805.332663:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00100000:3.0:1787827805.332673:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272941184:192.168.203.121@tcp:38:kworker.0
00000100:00080000:2.0:1787827805.332674:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827805.332699:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2969
00000100:00100000:3.0:1787827805.332708:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057292c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272941312:192.168.203.121@tcp:8:kworker.0
00000100:00080000:2.0:1787827805.332714:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827805.332726:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827805.332736:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:3.0:1787827805.332746:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827805.332761:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a940 x1874670272941696/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787827805.332774:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827805/real 1787827805]  req@ffff9ee0057292c0 x1874670272941312/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827830 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827805.332795:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827805.332829:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787827805.332835:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1787827805.332842:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057292c0 x1874670272941312/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827830 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827805.332843:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2969
00000100:00080000:2.0:1787827805.332867:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827805.332901:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827805.332908:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00080000:3.0:1787827805.332912:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827805.332932:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057292c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272941312:192.168.203.121@tcp:8:kworker.0
00000008:00100000:2.0:1787827805.332937:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827805.332960:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272941440:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787827805.332974:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a1c0 x1874670272941824/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1787827805.333011:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827805.333033:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827805/real 1787827805]  req@ffff9ee00572bc00 x1874670272941440/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827830 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827805.333053:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572bc00 x1874670272941440/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827830 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827805.333063:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827805.333068:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827805.333072:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272941440:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787827805.333080:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272941568:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787827805.333099:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827805.333110:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827805/real 1787827805]  req@ffff9ee005728780 x1874670272941568/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827830 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827805.333124:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728780 x1874670272941568/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827830 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827805.333134:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827805.333137:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827805.333141:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272941568:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787827805.333148:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272941696:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827805.333166:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827805.333178:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827805/real 1787827805]  req@ffff9ee00572a940 x1874670272941696/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827830 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827805.333192:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a940 x1874670272941696/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827830 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827805.333201:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827805.333204:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827805.333208:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272941696:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787827805.333227:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272941824:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827805.333246:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827805.333257:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827805/real 1787827805]  req@ffff9ee00572a1c0 x1874670272941824/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827830 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827805.333270:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a1c0 x1874670272941824/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827830 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827805.333287:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827805.333291:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827805.333295:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272941824:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827806.163685:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827806.355534:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787827807.187573:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827807.379450:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827808.211612:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827808.403550:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827809.235529:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827809.427425:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827810.259492:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827810.451490:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:2.0:1787827810.451545:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827810.451558:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787827810.451592:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827810.451631:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2974
00000100:00080000:2.0:1787827810.451644:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827810.451653:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787827810.451718:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728f00 x1874670272941952/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827810.451761:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827810.451766:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787827810.451769:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827810.451774:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2974
00000100:00080000:2.0:1787827810.451778:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827810.451783:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827810.451795:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787827810.451810:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b840 x1874670272942080/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827810.451838:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827810.451842:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787827810.451844:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827810.451847:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2974
00000100:00080000:2.0:1787827810.451850:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827810.451853:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827810.451859:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827810.451865:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272941952:192.168.203.121@tcp:250:kworker.0
00000100:00100000:2.0:1787827810.451872:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057283c0 x1874670272942208/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827810.451883:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827810.451886:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787827810.451888:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827810.451890:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2974
00000100:00080000:2.0:1787827810.451893:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827810.451897:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827810.451900:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787827810.451910:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729e00 x1874670272942336/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827810.451917:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827810.451921:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787827810.451922:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827810.451926:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2974
00000100:00080000:2.0:1787827810.451929:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827810.451931:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827810.451936:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000800:00000100:3.0:1787827810.451938:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827810.451949:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728000 x1874670272942464/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827810.451965:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827810.451968:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787827810.451970:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827810.451973:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2974
00000100:00080000:2.0:1787827810.451977:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827810.451980:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827810.451984:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827810.451995:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827810/real 1787827810]  req@ffff9ee005728f00 x1874670272941952/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827835 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827810.451997:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a580 x1874670272942592/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827810.452026:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827810.452032:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787827810.452034:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827810.452038:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2974
00000100:00080000:2.0:1787827810.452041:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1787827810.452047:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728f00 x1874670272941952/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827835 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827810.452048:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827810.452056:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787827810.452069:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728b40 x1874670272942720/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827810.452074:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827810.452084:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827810.452092:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272941952:192.168.203.121@tcp:250:kworker.0
00000100:00100000:3.0:1787827810.452105:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272942080:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787827810.452138:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827810.452156:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827810/real 1787827810]  req@ffff9ee00572b840 x1874670272942080/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827835 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827810.452174:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b840 x1874670272942080/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827835 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827810.452186:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827810.452191:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827810.452196:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272942080:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787827810.452228:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272942208:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827810.452256:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827810.452293:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827810/real 1787827810]  req@ffff9ee0057283c0 x1874670272942208/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827835 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827810.452318:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057283c0 x1874670272942208/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827835 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827810.452392:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827810.452401:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827810.452409:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272942208:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787827810.452426:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272942336:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827810.452468:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827810.452491:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827810/real 1787827810]  req@ffff9ee005729e00 x1874670272942336/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827835 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827810.452518:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729e00 x1874670272942336/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827835 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827810.452605:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827810.452613:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827810.452622:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272942336:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787827810.452635:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272942464:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787827810.452676:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827810.452700:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827810/real 1787827810]  req@ffff9ee005728000 x1874670272942464/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827835 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827810.452725:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728000 x1874670272942464/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827835 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827810.452743:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827810.452749:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827810.452756:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272942464:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787827810.452769:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272942592:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827810.452811:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827810.452846:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827810/real 1787827810]  req@ffff9ee00572a580 x1874670272942592/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827835 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827810.452862:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a580 x1874670272942592/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827835 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827810.452872:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827810.452877:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827810.452882:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272942592:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787827810.452890:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272942720:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827810.452915:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827810.452929:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827810/real 1787827810]  req@ffff9ee005728b40 x1874670272942720/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827835 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827810.452945:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728b40 x1874670272942720/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827835 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827810.452956:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827810.452960:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827810.452966:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272942720:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827811.283494:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827811.475416:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787827812.307529:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827812.499430:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827813.331580:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827813.523460:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827814.355594:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827814.547473:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827815.379631:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827815.571616:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:1.0:1787827815.571645:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827815.571661:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1787827815.571668:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827815.571684:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2979
00000100:00080000:1.0:1787827815.571705:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827815.571718:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787827815.571773:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a21c0 x1874670272942848/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827815.571818:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827815.571825:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787827815.571829:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827815.571836:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2979
00000100:00080000:1.0:1787827815.571845:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827815.571854:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827815.571872:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787827815.571894:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272942848:192.168.203.121@tcp:250:kworker.0
00000100:00100000:1.0:1787827815.571907:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0f00 x1874670272942976/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827815.571937:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827815.571948:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787827815.571951:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827815.571961:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2979
00000100:00080000:1.0:1787827815.571971:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827815.571993:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827815.572004:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787827815.572028:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1680 x1874670272943104/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1787827815.572052:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:1.0:1787827815.572072:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827815.572081:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787827815.572085:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827815.572096:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2979
00000100:00080000:1.0:1787827815.572107:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827815.572118:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787827815.572126:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827815/real 1787827815]  req@ffff9ee0056a21c0 x1874670272942848/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827840 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:1.0:1787827815.572134:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827815.572178:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a21c0 x1874670272942848/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827840 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827815.572184:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a2940 x1874670272943232/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827815.572270:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827815.572280:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787827815.572282:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827815.572288:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827815.572296:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827815.572315:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272942848:192.168.203.121@tcp:250:kworker.0
00000100:00080000:1.0:1787827815.572377:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2979
00000100:00080000:1.0:1787827815.572389:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827815.572402:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787827815.572405:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272942976:192.168.203.121@tcp:38:kworker.0
00000008:00100000:1.0:1787827815.572420:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787827815.572459:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a3c00 x1874670272943360/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1787827815.572471:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827815.572499:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827815/real 1787827815]  req@ffff9ee0056a0f00 x1874670272942976/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827840 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827815.572500:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827815.572558:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787827815.572566:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827815.572581:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2979
00000100:00100000:3.0:1787827815.572585:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0f00 x1874670272942976/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827840 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827815.572594:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827815.572614:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00080000:3.0:1787827815.572619:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827815.572629:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000008:00100000:1.0:1787827815.572632:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827815.572637:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272942976:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787827815.572658:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272943104:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827815.572676:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1a40 x1874670272943488/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1787827815.572702:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:1.0:1787827815.572714:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827815.572725:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:3.0:1787827815.572728:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827815/real 1787827815]  req@ffff9ee0056a1680 x1874670272943104/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827840 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827815.572733:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827815.572756:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2979
00000100:00080000:1.0:1787827815.572774:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827815.572791:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787827815.572795:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1680 x1874670272943104/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827840 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:1.0:1787827815.572805:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:3.0:1787827815.572830:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827815.572837:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827815.572843:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272943104:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827815.572853:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a12c0 x1874670272943616/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787827815.572866:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272943232:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827815.572920:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827815.572936:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827815/real 1787827815]  req@ffff9ee0056a2940 x1874670272943232/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827840 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827815.572950:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a2940 x1874670272943232/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827840 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827815.572958:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827815.572962:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827815.572966:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272943232:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787827815.572988:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272943360:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787827815.573006:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827815.573016:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827815/real 1787827815]  req@ffff9ee0056a3c00 x1874670272943360/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827840 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827815.573027:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a3c00 x1874670272943360/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827840 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827815.573036:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827815.573039:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827815.573041:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272943360:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787827815.573047:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272943488:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827815.573064:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827815.573074:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827815/real 1787827815]  req@ffff9ee0056a1a40 x1874670272943488/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827840 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827815.573086:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1a40 x1874670272943488/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827840 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827815.573094:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827815.573097:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827815.573100:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272943488:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787827815.573105:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272943616:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827815.573120:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827815.573128:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827815/real 1787827815]  req@ffff9ee0056a12c0 x1874670272943616/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827840 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827815.573138:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a12c0 x1874670272943616/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827840 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827815.573145:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827815.573149:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827815.573151:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272943616:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827816.403667:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827816.595454:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787827817.427609:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827817.619437:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827818.451595:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827818.643425:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827819.475578:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827819.667413:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827820.499571:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827820.691441:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:1.0:1787827820.691458:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827820.691475:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1787827820.691481:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827820.691512:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2984
00000100:00080000:1.0:1787827820.691526:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827820.691536:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787827820.691600:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a03c0 x1874670272943744/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827820.691645:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827820.691650:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787827820.691653:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827820.691658:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2984
00000100:00080000:1.0:1787827820.691663:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827820.691669:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827820.691683:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787827820.691710:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1e00 x1874670272943872/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787827820.691725:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272943744:192.168.203.121@tcp:250:kworker.0
00000100:00080000:1.0:1787827820.691732:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827820.691744:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787827820.691748:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827820.691756:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2984
00000100:00080000:1.0:1787827820.691774:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827820.691781:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827820.691790:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787827820.691807:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0b40 x1874670272944000/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827820.691825:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827820.691830:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787827820.691832:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827820.691837:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2984
00000100:00080000:1.0:1787827820.691843:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827820.691847:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827820.691853:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787827820.691868:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a2580 x1874670272944128/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827820.691881:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827820.691885:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787827820.691888:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827820.691898:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2984
00000800:00000100:0.0:1787827820.691900:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:1.0:1787827820.691916:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827820.691922:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827820.691929:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787827820.691949:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a3480 x1874670272944256/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827820.691965:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827820.691971:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787827820.691974:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827820.691985:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2984
00000100:00100000:0.0:1787827820.691986:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827820/real 1787827820]  req@ffff9ee0056a03c0 x1874670272943744/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827845 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827820.691990:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827820.692006:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827820.692020:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787827820.692033:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a03c0 x1874670272943744/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827845 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827820.692050:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0780 x1874670272944384/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827820.692091:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827820.692107:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:1.0:1787827820.692114:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1787827820.692120:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272943744:192.168.203.121@tcp:250:kworker.0
00000100:00080000:1.0:1787827820.692123:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787827820.692132:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827820.692141:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2984
00000100:00080000:1.0:1787827820.692147:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827820.692152:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827820.692158:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787827820.692166:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272943872:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787827820.692183:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0000 x1874670272944512/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1787827820.692209:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827820.692234:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827820/real 1787827820]  req@ffff9ee0056a1e00 x1874670272943872/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827845 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827820.692254:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1e00 x1874670272943872/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827845 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827820.692266:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827820.692271:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827820.692276:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272943872:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787827820.692284:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272944000:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787827820.692312:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827820.692393:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827820/real 1787827820]  req@ffff9ee0056a0b40 x1874670272944000/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827845 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827820.692416:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0b40 x1874670272944000/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827845 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827820.692428:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827820.692433:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827820.692438:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272944000:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787827820.692447:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272944128:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787827820.692529:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827820.692552:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827820/real 1787827820]  req@ffff9ee0056a2580 x1874670272944128/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827845 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827820.692584:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a2580 x1874670272944128/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827845 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827820.692601:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827820.692609:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827820.692616:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272944128:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787827820.692629:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272944256:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787827820.692670:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827820.692686:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827820/real 1787827820]  req@ffff9ee0056a3480 x1874670272944256/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827845 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827820.692702:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a3480 x1874670272944256/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827845 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827820.692715:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827820.692721:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827820.692728:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272944256:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787827820.692741:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272944384:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787827820.692780:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827820.692803:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827820/real 1787827820]  req@ffff9ee0056a0780 x1874670272944384/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827845 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827820.692825:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0780 x1874670272944384/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827845 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827820.692836:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827820.692840:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827820.692844:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272944384:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787827820.692873:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272944512:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787827820.692901:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827820.692914:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827820/real 1787827820]  req@ffff9ee0056a0000 x1874670272944512/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827845 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827820.692928:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0000 x1874670272944512/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827845 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827820.692938:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827820.692942:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827820.692945:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272944512:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827821.523607:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827821.715450:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787827822.547549:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827822.739392:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827823.571636:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827823.763494:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827824.595576:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827824.787487:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827825.619590:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827825.811482:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:1.0:1787827825.811542:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827825.811557:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1787827825.811568:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827825.811590:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2989
00000100:00080000:1.0:1787827825.811611:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827825.811627:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787827825.811704:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a30c0 x1874670272944640/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827825.811749:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827825.811755:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787827825.811757:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827825.811763:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2989
00000100:00080000:1.0:1787827825.811768:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827825.811774:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827825.811791:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787827825.811814:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0000 x1874670272944768/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827825.811829:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827825.811833:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787827825.811836:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827825.811841:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2989
00000100:00080000:1.0:1787827825.811845:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827825.811853:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787827825.811858:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272944640:192.168.203.121@tcp:250:kworker.0
00000008:00100000:1.0:1787827825.811860:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787827825.811880:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0780 x1874670272944896/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827825.811894:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827825.811898:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787827825.811901:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827825.811906:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2989
00000100:00080000:1.0:1787827825.811910:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827825.811914:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827825.811921:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787827825.811936:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a3480 x1874670272945024/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827825.811948:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827825.811952:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787827825.811956:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827825.811961:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2989
00000100:00080000:1.0:1787827825.811966:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827825.811971:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827825.811977:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000800:00000100:0.0:1787827825.811979:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827825.811998:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a2580 x1874670272945152/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827825.812013:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827825.812018:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787827825.812020:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827825.812026:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2989
00000100:00080000:1.0:1787827825.812031:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827825.812037:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827825.812044:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787827825.812054:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827825/real 1787827825]  req@ffff9ee0056a30c0 x1874670272944640/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827850 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827825.812063:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0b40 x1874670272945280/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827825.812113:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827825.812119:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:0.0:1787827825.812126:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a30c0 x1874670272944640/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827850 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827825.812127:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827825.812143:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2989
00000100:00080000:1.0:1787827825.812153:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827825.812163:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00080000:0.0:1787827825.812165:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000008:00100000:1.0:1787827825.812169:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:0.0:1787827825.812177:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827825.812186:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272944640:192.168.203.121@tcp:250:kworker.0
00000100:00100000:1.0:1787827825.812194:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1e00 x1874670272945408/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787827825.812206:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272944768:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787827825.812252:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827825.812269:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827825/real 1787827825]  req@ffff9ee0056a0000 x1874670272944768/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827850 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827825.812285:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0000 x1874670272944768/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827850 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827825.812295:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827825.812299:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827825.812303:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272944768:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787827825.812406:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272944896:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787827825.812435:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827825.812494:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827825/real 1787827825]  req@ffff9ee0056a0780 x1874670272944896/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827850 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827825.812531:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0780 x1874670272944896/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827850 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827825.812548:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827825.812555:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827825.812561:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272944896:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787827825.812576:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272945024:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787827825.812608:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827825.812622:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827825/real 1787827825]  req@ffff9ee0056a3480 x1874670272945024/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827850 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827825.812637:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a3480 x1874670272945024/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827850 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827825.812648:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827825.812652:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827825.812656:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272945024:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787827825.812663:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272945152:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787827825.812682:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827825.812693:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827825/real 1787827825]  req@ffff9ee0056a2580 x1874670272945152/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827850 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827825.812706:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a2580 x1874670272945152/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827850 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827825.812716:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827825.812720:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827825.812723:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272945152:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787827825.812730:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272945280:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787827825.812749:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827825.812760:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827825/real 1787827825]  req@ffff9ee0056a0b40 x1874670272945280/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827850 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827825.812775:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0b40 x1874670272945280/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827850 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827825.812785:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827825.812788:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827825.812792:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272945280:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787827825.812798:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272945408:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787827825.812817:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827825.812828:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827825/real 1787827825]  req@ffff9ee0056a1e00 x1874670272945408/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827850 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827825.812840:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1e00 x1874670272945408/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827850 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827825.812850:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827825.812854:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827825.812858:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272945408:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827826.643552:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827826.835479:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787827827.667597:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827827.859519:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827828.691554:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827828.883501:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827829.715477:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827829.907402:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827830.739618:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1787827830.931471:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827830.931484:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00100000:3.0:1787827830.931489:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:1.0:1787827830.931490:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827830.931509:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2994
00000100:00080000:1.0:1787827830.931524:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827830.931535:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787827830.931582:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a03c0 x1874670272945536/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827830.931620:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827830.931625:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787827830.931627:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827830.931632:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2994
00000100:00080000:1.0:1787827830.931636:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827830.931640:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827830.931653:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787827830.931668:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a12c0 x1874670272945664/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827830.931685:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1787827830.931692:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272945536:192.168.203.121@tcp:250:kworker.0
00000100:00080000:1.0:1787827830.931693:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787827830.931700:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827830.931712:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2994
00000100:00080000:1.0:1787827830.931716:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827830.931722:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827830.931728:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787827830.931744:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1a40 x1874670272945792/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827830.931757:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827830.931763:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787827830.931767:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827830.931775:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2994
00000100:00080000:1.0:1787827830.931783:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000800:00000100:0.0:1787827830.931792:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:1.0:1787827830.931800:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827830.931814:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787827830.931842:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a3c00 x1874670272945920/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787827830.931860:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827830/real 1787827830]  req@ffff9ee0056a03c0 x1874670272945536/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827855 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827830.931870:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827830.931884:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787827830.931890:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827830.931905:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2994
00000100:00100000:0.0:1787827830.931920:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a03c0 x1874670272945536/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827855 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827830.931923:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827830.931942:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827830.931953:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00080000:0.0:1787827830.931974:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827830.931984:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827830.931986:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a2940 x1874670272946048/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787827830.931993:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272945536:192.168.203.121@tcp:250:kworker.0
00000100:00080000:1.0:1787827830.932022:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827830.932030:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787827830.932035:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1787827830.932043:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272945664:192.168.203.121@tcp:38:kworker.0
00000100:00080000:1.0:1787827830.932049:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2994
00000100:00080000:1.0:1787827830.932072:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827830.932080:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827830.932090:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:0.0:1787827830.932110:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827830.932120:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1680 x1874670272946176/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787827830.932144:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827830/real 1787827830]  req@ffff9ee0056a12c0 x1874670272945664/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827855 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827830.932145:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827830.932166:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787827830.932174:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1787827830.932185:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a12c0 x1874670272945664/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827855 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827830.932190:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2994
00000100:00080000:1.0:1787827830.932207:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827830.932210:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827830.932221:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00080000:0.0:1787827830.932222:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827830.932237:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272945664:192.168.203.121@tcp:38:kworker.0
00000008:00100000:1.0:1787827830.932239:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787827830.932250:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272945792:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827830.932266:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0f00 x1874670272946304/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1787827830.932292:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827830.932311:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827830/real 1787827830]  req@ffff9ee0056a1a40 x1874670272945792/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827855 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827830.932372:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1a40 x1874670272945792/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827855 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827830.932383:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827830.932387:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827830.932391:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272945792:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787827830.932400:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272945920:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787827830.932459:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827830.932477:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827830/real 1787827830]  req@ffff9ee0056a3c00 x1874670272945920/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827855 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827830.932492:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a3c00 x1874670272945920/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827855 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827830.932503:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827830.932507:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827830.932511:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272945920:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787827830.932519:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272946048:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787827830.932542:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827830.932553:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827830/real 1787827830]  req@ffff9ee0056a2940 x1874670272946048/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827855 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827830.932567:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a2940 x1874670272946048/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827855 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827830.932577:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827830.932580:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827830.932583:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272946048:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787827830.932610:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272946176:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787827830.932630:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827830.932642:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827830/real 1787827830]  req@ffff9ee0056a1680 x1874670272946176/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827855 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827830.932657:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1680 x1874670272946176/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827855 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827830.932666:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827830.932669:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827830.932673:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272946176:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787827830.932679:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272946304:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787827830.932697:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827830.932708:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827830/real 1787827830]  req@ffff9ee0056a0f00 x1874670272946304/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827855 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827830.932721:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0f00 x1874670272946304/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827855 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827830.932730:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827830.932734:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827830.932737:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272946304:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827831.763603:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827831.955462:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787827832.787508:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827832.979438:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827833.811597:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827834.003490:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827834.835562:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827835.027430:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827835.859547:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827836.051427:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:0.0:1787827836.051497:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827836.051504:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1787827836.051509:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827836.051533:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 2999
00000100:00080000:0.0:1787827836.051543:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827836.051549:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787827836.051583:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8b40 x1874670272946432/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827836.051608:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827836.051611:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787827836.051613:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827836.051616:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2999
00000100:00080000:0.0:1787827836.051619:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827836.051621:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827836.051631:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787827836.051640:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9680 x1874670272946560/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827836.051650:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1787827836.051653:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272946432:192.168.203.121@tcp:250:kworker.0
00000100:00080000:0.0:1787827836.051654:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787827836.051658:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827836.051666:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2999
00000100:00080000:0.0:1787827836.051668:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827836.051671:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827836.051675:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787827836.051686:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e92c0 x1874670272946688/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827836.051694:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827836.051697:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787827836.051698:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827836.051702:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 2999
00000100:00080000:0.0:1787827836.051705:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827836.051708:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827836.051712:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787827836.051724:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb840 x1874670272946816/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1787827836.051724:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:0.0:1787827836.051736:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827836.051739:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787827836.051741:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827836.051745:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2999
00000100:00080000:0.0:1787827836.051748:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827836.051750:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827836.051754:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787827836.051764:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb480 x1874670272946944/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787827836.051769:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827836/real 1787827836]  req@ffff9ee0056e8b40 x1874670272946432/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827861 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827836.051778:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827836.051787:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787827836.051790:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827836.051794:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2999
00000100:00080000:0.0:1787827836.051796:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827836.051798:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827836.051801:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787827836.051811:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8000 x1874670272947072/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787827836.051819:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8b40 x1874670272946432/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827861 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827836.051822:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827836.051830:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787827836.051833:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827836.051838:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 2999
00000100:00080000:0.0:1787827836.051840:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827836.051846:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827836.051853:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:3.0:1787827836.051855:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:0.0:1787827836.051861:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e83c0 x1874670272947200/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827836.051864:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827836.051873:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272946432:192.168.203.121@tcp:250:kworker.0
00000100:00100000:3.0:1787827836.051901:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272946560:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787827836.051924:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827836.051935:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827836/real 1787827836]  req@ffff9ee0056e9680 x1874670272946560/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827861 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827836.051945:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9680 x1874670272946560/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827861 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827836.051951:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827836.051954:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827836.051957:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272946560:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787827836.051961:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272946688:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827836.051975:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827836.051981:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827836/real 1787827836]  req@ffff9ee0056e92c0 x1874670272946688/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827861 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827836.051990:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e92c0 x1874670272946688/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827861 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827836.051996:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827836.051998:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827836.052000:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272946688:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787827836.052004:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272946816:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827836.052016:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827836.052022:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827836/real 1787827836]  req@ffff9ee0056eb840 x1874670272946816/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827861 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827836.052030:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb840 x1874670272946816/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827861 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827836.052036:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827836.052038:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827836.052040:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272946816:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787827836.052045:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272946944:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787827836.052056:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827836.052062:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827836/real 1787827836]  req@ffff9ee0056eb480 x1874670272946944/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827861 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827836.052070:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb480 x1874670272946944/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827861 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827836.052076:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827836.052078:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827836.052080:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272946944:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787827836.052084:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272947072:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827836.052095:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827836.052101:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827836/real 1787827836]  req@ffff9ee0056e8000 x1874670272947072/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827861 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827836.052114:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8000 x1874670272947072/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827861 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827836.052120:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827836.052122:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827836.052124:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272947072:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787827836.052128:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272947200:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827836.052138:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827836.052144:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827836/real 1787827836]  req@ffff9ee0056e83c0 x1874670272947200/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827861 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827836.052152:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e83c0 x1874670272947200/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827861 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827836.052157:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827836.052159:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827836.052161:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272947200:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827836.883487:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827837.075447:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787827837.907595:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827838.099409:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827838.931516:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827839.123438:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827839.955528:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827840.147452:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827840.979505:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1787827841.171403:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827841.171411:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00100000:3.0:1787827841.171413:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:0.0:1787827841.171415:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827841.171425:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3004
00000100:00080000:0.0:1787827841.171435:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827841.171441:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787827841.171473:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8f00 x1874670272947328/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827841.171495:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827841.171497:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787827841.171499:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827841.171501:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3004
00000100:00080000:0.0:1787827841.171504:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827841.171507:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827841.171515:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787827841.171528:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ebc00 x1874670272947456/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787827841.171528:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272947328:192.168.203.121@tcp:250:kworker.0
00000100:00080000:0.0:1787827841.171542:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827841.171545:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787827841.171546:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827841.171548:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3004
00000100:00080000:0.0:1787827841.171551:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827841.171553:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827841.171556:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787827841.171565:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e83c0 x1874670272947584/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827841.171571:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827841.171573:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787827841.171574:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827841.171576:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3004
00000100:00080000:0.0:1787827841.171586:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827841.171590:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000800:00000100:3.0:1787827841.171595:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000008:00100000:0.0:1787827841.171597:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787827841.171608:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8000 x1874670272947712/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827841.171614:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827841.171617:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787827841.171619:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827841.171622:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3004
00000100:00080000:0.0:1787827841.171626:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827841.171632:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787827841.171633:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827841/real 1787827841]  req@ffff9ee0056e8f00 x1874670272947328/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827866 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:0.0:1787827841.171635:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787827841.171647:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb480 x1874670272947840/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787827841.171654:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8f00 x1874670272947328/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827866 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827841.171656:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827841.171663:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787827841.171667:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827841.171674:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3004
00000100:00080000:0.0:1787827841.171677:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827841.171679:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827841.171680:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827841.171687:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:3.0:1787827841.171691:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827841.171696:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb840 x1874670272947968/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787827841.171702:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272947328:192.168.203.121@tcp:250:kworker.0
00000100:00080000:0.0:1787827841.171705:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827841.171711:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787827841.171713:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827841.171716:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3004
00000100:00080000:0.0:1787827841.171718:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827841.171721:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827841.171724:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787827841.171731:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e92c0 x1874670272948096/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787827841.171734:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272947456:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787827841.171765:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827841.171775:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827841/real 1787827841]  req@ffff9ee0056ebc00 x1874670272947456/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827866 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827841.171784:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ebc00 x1874670272947456/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827866 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827841.171789:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827841.171792:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827841.171794:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272947456:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787827841.171798:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272947584:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827841.171810:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827841.171816:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827841/real 1787827841]  req@ffff9ee0056e83c0 x1874670272947584/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827866 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827841.171828:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e83c0 x1874670272947584/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827866 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827841.171833:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827841.171835:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827841.171837:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272947584:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787827841.171840:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272947712:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827841.171849:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827841.171855:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827841/real 1787827841]  req@ffff9ee0056e8000 x1874670272947712/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827866 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827841.171862:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8000 x1874670272947712/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827866 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827841.171867:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827841.171868:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827841.171870:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272947712:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787827841.171874:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272947840:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787827841.171883:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827841.171888:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827841/real 1787827841]  req@ffff9ee0056eb480 x1874670272947840/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827866 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827841.171894:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb480 x1874670272947840/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827866 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827841.171903:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827841.171905:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827841.171907:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272947840:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787827841.171910:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272947968:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827841.171919:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827841.171924:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827841/real 1787827841]  req@ffff9ee0056eb840 x1874670272947968/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827866 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827841.171931:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb840 x1874670272947968/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827866 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827841.171935:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827841.171937:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827841.171939:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272947968:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787827841.171950:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272948096:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827841.171960:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827841.171966:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827841/real 1787827841]  req@ffff9ee0056e92c0 x1874670272948096/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827866 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827841.171973:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e92c0 x1874670272948096/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827866 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827841.171978:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827841.171979:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827841.171982:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272948096:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827842.003458:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827842.195507:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787827843.027504:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827843.219402:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827844.051474:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827844.243485:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827845.075511:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827845.267517:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827846.099582:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1787827846.291504:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1787827846.291509:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:2.0:1787827846.291518:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787827846.291527:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827846.291543:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3010
00000100:00080000:2.0:1787827846.291559:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827846.291569:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787827846.291617:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b0c0 x1874670272948224/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827846.291657:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827846.291662:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787827846.291665:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827846.291670:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3010
00000100:00080000:2.0:1787827846.291675:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827846.291680:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827846.291692:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787827846.291707:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729a40 x1874670272948352/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787827846.291722:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272948224:192.168.203.121@tcp:250:kworker.0
00000100:00080000:2.0:1787827846.291727:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827846.291774:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787827846.291776:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827846.291784:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3010
00000100:00080000:2.0:1787827846.291788:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827846.291793:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827846.291801:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787827846.291820:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572ad00 x1874670272948480/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827846.291849:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827846.291854:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787827846.291857:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827846.291862:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3010
00000800:00000100:3.0:1787827846.291873:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:2.0:1787827846.291874:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827846.291885:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827846.291892:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787827846.291907:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b480 x1874670272948608/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827846.291918:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827846.291923:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787827846.291927:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827846.291933:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3010
00000100:00080000:2.0:1787827846.291937:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827846.291942:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827846.291950:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787827846.291958:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827846/real 1787827846]  req@ffff9ee00572b0c0 x1874670272948224/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827871 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827846.291968:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728b40 x1874670272948736/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827846.291997:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1787827846.292000:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b0c0 x1874670272948224/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827871 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827846.292008:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787827846.292024:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827846.292045:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:2.0:1787827846.292046:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1787827846.292060:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272948224:192.168.203.121@tcp:250:kworker.0
00000100:00080000:2.0:1787827846.292062:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3010
00000100:00080000:2.0:1787827846.292081:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827846.292088:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827846.292114:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827846.292123:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272948352:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787827846.292131:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a580 x1874670272948864/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827846.292148:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827846.292152:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787827846.292154:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827846.292162:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3010
00000100:00080000:2.0:1787827846.292172:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000800:00000100:3.0:1787827846.292173:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:2.0:1787827846.292183:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827846.292189:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787827846.292219:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728000 x1874670272948992/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787827846.292221:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827846/real 1787827846]  req@ffff9ee005729a40 x1874670272948352/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827871 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827846.292296:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729a40 x1874670272948352/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827871 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827846.292356:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827846.292370:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827846.292375:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272948352:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787827846.292383:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272948480:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827846.292406:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827846.292416:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827846/real 1787827846]  req@ffff9ee00572ad00 x1874670272948480/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827871 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827846.292424:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572ad00 x1874670272948480/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827871 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827846.292441:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827846.292444:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827846.292446:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272948480:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787827846.292450:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272948608:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827846.292462:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827846.292468:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827846/real 1787827846]  req@ffff9ee00572b480 x1874670272948608/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827871 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827846.292475:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b480 x1874670272948608/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827871 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827846.292481:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827846.292482:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827846.292485:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272948608:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787827846.292490:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272948736:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787827846.292501:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827846.292507:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827846/real 1787827846]  req@ffff9ee005728b40 x1874670272948736/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827871 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827846.292515:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728b40 x1874670272948736/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827871 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827846.292520:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827846.292522:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827846.292524:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272948736:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787827846.292541:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272948864:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827846.292553:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827846.292559:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827846/real 1787827846]  req@ffff9ee00572a580 x1874670272948864/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827871 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827846.292565:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a580 x1874670272948864/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827871 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827846.292571:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827846.292573:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827846.292575:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272948864:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787827846.292579:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272948992:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827846.292589:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827846.292595:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827846/real 1787827846]  req@ffff9ee005728000 x1874670272948992/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827871 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827846.292603:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728000 x1874670272948992/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827871 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827846.292608:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827846.292610:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827846.292611:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272948992:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827847.123506:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827847.315407:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787827848.147500:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827848.339398:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827849.171557:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827849.363444:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827850.195542:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827850.387389:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827851.219494:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1787827851.411415:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827851.411428:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787827851.411433:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827851.411450:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3015
00000100:00100000:3.0:1787827851.411450:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:2.0:1787827851.411477:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827851.411490:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787827851.411540:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729e00 x1874670272949120/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827851.411569:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827851.411573:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787827851.411574:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827851.411578:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3015
00000100:00080000:2.0:1787827851.411581:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827851.411584:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827851.411595:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787827851.411607:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057283c0 x1874670272949248/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827851.411616:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827851.411620:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787827851.411621:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1787827851.411631:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272949120:192.168.203.121@tcp:250:kworker.0
00000100:00080000:2.0:1787827851.411632:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3015
00000100:00080000:2.0:1787827851.411645:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827851.411652:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827851.411656:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787827851.411667:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b840 x1874670272949376/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827851.411674:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827851.411677:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787827851.411679:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827851.411683:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3015
00000100:00080000:2.0:1787827851.411686:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827851.411690:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827851.411693:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787827851.411702:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728f00 x1874670272949504/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827851.411711:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827851.411714:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787827851.411722:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827851.411726:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3015
00000100:00080000:2.0:1787827851.411730:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827851.411733:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827851.411736:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787827851.411746:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a1c0 x1874670272949632/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827851.411752:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827851.411756:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787827851.411757:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827851.411764:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3015
00000100:00080000:2.0:1787827851.411767:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827851.411774:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827851.411779:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787827851.411794:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a940 x1874670272949760/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787827851.411808:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272949248:192.168.203.121@tcp:38:kworker.0
00000100:00080000:2.0:1787827851.411810:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827851.411826:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787827851.411832:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827851.411839:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3015
00000100:00080000:2.0:1787827851.411848:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827851.411856:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827851.411864:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787827851.411883:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728780 x1874670272949888/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787827851.411897:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272949376:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787827851.411957:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272949504:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787827851.411986:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272949632:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787827851.412011:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272949760:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787827851.412033:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272949888:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827852.243577:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827852.435446:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787827853.267533:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827853.459399:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827854.291468:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827854.483388:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000400:00000100:1.0:1787827854.483560:0:2353:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.203.121:988
00000400:00000100:1.0:1787827854.483592:0:2353:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.203.121@tcp at host 192.168.203.121 was unreachable: the network or that node may be down, or Lustre may be misconfigured.
00000800:00000100:1.0:1787827854.483606:0:2353:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:1.0:1787827854.483646:0:2353:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:1.0:1787827854.483655:0:2353:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:1.0:1787827854.483664:0:2353:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:1.0:1787827854.483674:0:2353:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000100:00100000:3.0:1787827854.483677:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827851/real 1787827854]  req@ffff9ee0057283c0 x1874670272949248/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827876 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000800:00000100:1.0:1787827854.483684:0:2353:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:1.0:1787827854.483694:0:2353:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000100:00100000:3.0:1787827854.483708:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057283c0 x1874670272949248/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827876 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827854.483722:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827854.483728:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827854.483732:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272949248:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787827854.483740:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827851/real 1787827854]  req@ffff9ee00572b840 x1874670272949376/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827876 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827854.483753:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b840 x1874670272949376/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827876 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827854.483761:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827854.483765:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827854.483769:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272949376:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787827854.483775:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827851/real 1787827854]  req@ffff9ee005728f00 x1874670272949504/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827876 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827854.483787:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728f00 x1874670272949504/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827876 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827854.483803:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827854.483805:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827854.483808:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272949504:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787827854.483813:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827851/real 1787827854]  req@ffff9ee00572a1c0 x1874670272949632/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827876 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827854.483826:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a1c0 x1874670272949632/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827876 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827854.483841:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827854.483845:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827854.483848:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272949632:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787827854.483855:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827851/real 1787827854]  req@ffff9ee005729e00 x1874670272949120/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827876 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827854.483867:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729e00 x1874670272949120/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827876 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827854.483875:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827854.483879:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827854.483882:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272949120:192.168.203.121@tcp:250:kworker.0
00000100:00100000:3.0:1787827854.483910:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827851/real 1787827854]  req@ffff9ee00572a940 x1874670272949760/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827876 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827854.483921:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a940 x1874670272949760/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827876 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827854.483936:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827854.483940:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827854.483942:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272949760:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787827854.483948:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827851/real 1787827854]  req@ffff9ee005728780 x1874670272949888/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827876 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827854.483959:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728780 x1874670272949888/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827876 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827854.483967:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827854.483970:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827854.483973:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272949888:192.168.203.121@tcp:8:kworker.0
00010000:00010000:3.0:1787827855.315470:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827855.507403:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827856.339475:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827856.531438:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787827856.531495:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827856.531500:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787827856.531504:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827856.531516:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3020
00000100:00080000:3.0:1787827856.531529:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827856.531538:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787827856.531587:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705e00 x1874670272950016/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827856.531623:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827856.531628:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787827856.531631:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827856.531636:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3020
00000100:00080000:3.0:1787827856.531643:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827856.531650:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827856.531663:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787827856.531681:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272950016:192.168.203.121@tcp:250:kworker.0
00000100:00100000:3.0:1787827856.531684:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707840 x1874670272950144/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827856.531714:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827856.531718:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787827856.531721:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827856.531727:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3020
00000100:00080000:3.0:1787827856.531735:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827856.531743:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827856.531754:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827856.531784:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705a40 x1874670272950272/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827856.531795:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827856.531799:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787827856.531801:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827856.531806:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3020
00000100:00080000:3.0:1787827856.531823:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000800:00000100:1.0:1787827856.531833:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787827856.531834:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827856.531848:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827856.531869:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704780 x1874670272950400/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827856.531883:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827856.531887:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00100000:1.0:1787827856.531915:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827856/real 1787827856]  req@ffff9ee005705e00 x1874670272950016/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827881 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827856.531921:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827856.531940:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3020
00000100:00080000:3.0:1787827856.531951:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1787827856.531960:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705e00 x1874670272950016/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827881 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827856.531971:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827856.531988:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00080000:1.0:1787827856.532001:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827856.532012:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827856.532018:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706580 x1874670272950528/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827856.532035:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827856.532044:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00100000:1.0:1787827856.532047:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272950016:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787827856.532050:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827856.532068:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3020
00000100:00080000:3.0:1787827856.532077:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827856.532085:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827856.532092:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787827856.532102:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272950144:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787827856.532116:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704b40 x1874670272950656/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827856.532137:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827856.532142:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787827856.532146:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:1.0:1787827856.532155:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787827856.532164:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3020
00000100:00080000:3.0:1787827856.532177:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827856.532186:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787827856.532196:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827856/real 1787827856]  req@ffff9ee005707840 x1874670272950144/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827881 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827856.532217:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707840 x1874670272950144/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827881 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827856.532229:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827856.532234:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827856.532238:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272950144:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787827856.532267:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272950272:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827856.532314:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827856.532375:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827856/real 1787827856]  req@ffff9ee005705a40 x1874670272950272/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827881 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827856.532395:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705a40 x1874670272950272/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827881 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827856.532406:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827856.532410:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827856.532414:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272950272:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827856.532423:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272950400:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827856.532452:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827856.532467:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827856/real 1787827856]  req@ffff9ee005704780 x1874670272950400/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827881 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827856.532489:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704780 x1874670272950400/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827881 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827856.532504:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827856.532508:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827856.532512:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272950400:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827856.532520:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272950528:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787827856.532545:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827856.532575:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827856/real 1787827856]  req@ffff9ee005706580 x1874670272950528/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827881 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827856.532591:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706580 x1874670272950528/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827881 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827856.532601:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827856.532606:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827856.532611:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272950528:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787827856.532656:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272950656:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827856.532687:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827856.532715:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827856/real 1787827856]  req@ffff9ee005704b40 x1874670272950656/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827881 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827856.532734:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704b40 x1874670272950656/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827881 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827856.532745:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827856.532750:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827856.532754:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272950656:192.168.203.121@tcp:8:kworker.0
00000008:00100000:3.0:1787827856.532839:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827856.532882:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057043c0 x1874670272950784/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787827856.532963:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272950784:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827856.533010:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827856.533030:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827856/real 1787827856]  req@ffff9ee0057043c0 x1874670272950784/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827881 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827856.533046:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057043c0 x1874670272950784/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827881 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827856.533058:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827856.533062:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827856.533067:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272950784:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827857.363525:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827857.555400:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787827858.387602:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827858.579428:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827859.411460:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827859.603425:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827860.435516:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827860.627491:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827861.459534:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827861.651416:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:0.0:1787827861.651425:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827861.651432:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1787827861.651437:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827861.651448:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3025
00000100:00080000:0.0:1787827861.651460:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827861.651467:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787827861.651500:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9680 x1874670272950912/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827861.651521:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827861.651523:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787827861.651525:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827861.651528:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3025
00000100:00080000:0.0:1787827861.651531:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827861.651535:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827861.651543:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787827861.651555:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8b40 x1874670272951040/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787827861.651555:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272950912:192.168.203.121@tcp:250:kworker.0
00000100:00080000:0.0:1787827861.651563:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827861.651566:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787827861.651567:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827861.651569:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3025
00000100:00080000:0.0:1787827861.651572:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827861.651574:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827861.651577:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787827861.651582:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9e00 x1874670272951168/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827861.651588:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827861.651590:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787827861.651591:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827861.651595:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3025
00000100:00080000:0.0:1787827861.651601:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827861.651604:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827861.651607:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787827861.651617:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8780 x1874670272951296/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827861.651627:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827861.651631:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787827861.651633:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827861.651638:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3025
00000100:00080000:0.0:1787827861.651651:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000800:00000100:1.0:1787827861.651656:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:0.0:1787827861.651662:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827861.651669:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787827861.651681:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ead00 x1874670272951424/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827861.651689:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1787827861.651693:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827861/real 1787827861]  req@ffff9ee0056e9680 x1874670272950912/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827886 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827861.651694:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787827861.651697:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827861.651706:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3025
00000100:00080000:0.0:1787827861.651714:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827861.651718:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787827861.651721:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9680 x1874670272950912/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827886 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:0.0:1787827861.651723:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:1.0:1787827861.651736:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:0.0:1787827861.651738:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ea580 x1874670272951552/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827861.651742:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827861.651751:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272950912:192.168.203.121@tcp:250:kworker.0
00000100:00080000:0.0:1787827861.651753:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827861.651758:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787827861.651759:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827861.651763:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3025
00000100:00080000:0.0:1787827861.651765:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827861.651768:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827861.651771:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787827861.651775:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272951040:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787827861.651781:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9a40 x1874670272951680/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1787827861.651797:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827861.651809:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827861/real 1787827861]  req@ffff9ee0056e8b40 x1874670272951040/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827886 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827861.651818:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8b40 x1874670272951040/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827886 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827861.651823:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827861.651825:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827861.651828:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272951040:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787827861.651832:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272951168:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827861.651843:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827861.651849:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827861/real 1787827861]  req@ffff9ee0056e9e00 x1874670272951168/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827886 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827861.651856:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9e00 x1874670272951168/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827886 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827861.651861:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827861.651863:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827861.651865:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272951168:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827861.651869:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272951296:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827861.651878:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827861.651883:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827861/real 1787827861]  req@ffff9ee0056e8780 x1874670272951296/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827886 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827861.651891:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8780 x1874670272951296/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827886 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827861.651896:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827861.651898:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827861.651900:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272951296:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827861.651903:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272951424:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787827861.651912:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827861.651918:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827861/real 1787827861]  req@ffff9ee0056ead00 x1874670272951424/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827886 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827861.651924:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ead00 x1874670272951424/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827886 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827861.651930:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827861.651932:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827861.651934:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272951424:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787827861.651937:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272951552:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827861.651947:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827861.651952:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827861/real 1787827861]  req@ffff9ee0056ea580 x1874670272951552/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827886 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827861.651959:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ea580 x1874670272951552/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827886 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827861.651963:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827861.651965:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827861.651967:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272951552:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827861.651979:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272951680:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827861.651989:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827861.651995:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827861/real 1787827861]  req@ffff9ee0056e9a40 x1874670272951680/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827886 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827861.652002:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9a40 x1874670272951680/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827886 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827861.652007:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827861.652008:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827861.652011:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272951680:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827862.483518:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827862.675427:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787827863.507562:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827863.699546:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827864.531477:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827864.723416:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827865.555467:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827865.747394:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827866.579612:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827866.771427:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787827866.771451:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827866.771459:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787827866.771465:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827866.771479:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3030
00000100:00080000:3.0:1787827866.771493:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827866.771504:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787827866.771554:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707480 x1874670272951808/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827866.771595:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827866.771599:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787827866.771601:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827866.771606:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3030
00000100:00080000:3.0:1787827866.771610:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827866.771614:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827866.771625:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787827866.771639:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057061c0 x1874670272951936/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827866.771649:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827866.771652:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787827866.771654:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827866.771657:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3030
00000100:00080000:3.0:1787827866.771660:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827866.771663:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827866.771668:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827866.771680:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057070c0 x1874670272952064/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827866.771691:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1787827866.771706:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272951808:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787827866.771708:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787827866.771714:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827866.771722:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3030
00000100:00080000:3.0:1787827866.771726:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827866.771730:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827866.771735:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827866.771748:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057052c0 x1874670272952192/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827866.771761:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827866.771765:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787827866.771767:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827866.771771:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3030
00000100:00080000:3.0:1787827866.771775:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827866.771787:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000800:00000100:1.0:1787827866.771788:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000008:00100000:3.0:1787827866.771801:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787827866.771829:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707c00 x1874670272952320/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827866.771845:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1787827866.771851:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827866/real 1787827866]  req@ffff9ee005707480 x1874670272951808/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827891 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827866.771857:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787827866.771864:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827866.771877:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3030
00000100:00080000:3.0:1787827866.771883:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1787827866.771885:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707480 x1874670272951808/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827891 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827866.771893:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827866.771907:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:1.0:1787827866.771912:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827866.771921:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827866.771927:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704000 x1874670272952448/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787827866.771929:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272951808:192.168.203.121@tcp:250:kworker.0
00000100:00100000:1.0:1787827866.771949:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272951936:192.168.203.121@tcp:38:kworker.0
00000100:00080000:3.0:1787827866.771971:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827866.771975:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787827866.771977:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827866.771983:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3030
00000100:00080000:3.0:1787827866.771988:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000800:00000100:1.0:1787827866.771994:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787827866.771997:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827866.772005:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827866.772018:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706d00 x1874670272952576/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787827866.772037:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827866/real 1787827866]  req@ffff9ee0057061c0 x1874670272951936/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827891 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827866.772061:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057061c0 x1874670272951936/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827891 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827866.772076:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827866.772082:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827866.772088:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272951936:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787827866.772099:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272952064:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827866.772155:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827866.772222:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827866/real 1787827866]  req@ffff9ee0057070c0 x1874670272952064/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827891 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827866.772245:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057070c0 x1874670272952064/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827891 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827866.772255:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827866.772259:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827866.772262:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272952064:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827866.772289:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272952192:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827866.772350:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827866.772364:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827866/real 1787827866]  req@ffff9ee0057052c0 x1874670272952192/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827891 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827866.772377:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057052c0 x1874670272952192/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827891 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827866.772385:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827866.772388:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827866.772391:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272952192:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827866.772397:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272952320:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787827866.772415:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827866.772424:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827866/real 1787827866]  req@ffff9ee005707c00 x1874670272952320/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827891 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827866.772435:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707c00 x1874670272952320/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827891 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827866.772443:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827866.772446:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827866.772449:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272952320:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787827866.772454:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272952448:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827866.772468:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827866.772476:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827866/real 1787827866]  req@ffff9ee005704000 x1874670272952448/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827891 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827866.772487:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704000 x1874670272952448/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827891 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827866.772499:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827866.772504:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827866.772509:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272952448:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827866.772519:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272952576:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827866.772548:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827866.772566:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827866/real 1787827866]  req@ffff9ee005706d00 x1874670272952576/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827891 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827866.772585:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706d00 x1874670272952576/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827891 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827866.772598:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827866.772603:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827866.772609:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272952576:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827867.603458:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827867.795395:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787827868.627464:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827868.819426:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827869.651576:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827869.843415:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827870.675503:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827870.867469:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827871.699507:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827871.891435:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787827871.891454:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827871.891459:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787827871.891464:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827871.891472:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3035
00000100:00080000:3.0:1787827871.891481:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827871.891487:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787827871.891519:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705680 x1874670272952704/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827871.891559:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827871.891562:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787827871.891564:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827871.891580:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3035
00000100:00080000:3.0:1787827871.891583:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827871.891586:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827871.891595:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787827871.891605:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706940 x1874670272952832/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827871.891615:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827871.891618:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787827871.891622:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1787827871.891623:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272952704:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787827871.891628:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3035
00000100:00080000:3.0:1787827871.891634:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827871.891637:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827871.891641:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827871.891653:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706d00 x1874670272952960/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827871.891678:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827871.891681:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787827871.891683:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827871.891687:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3035
00000100:00080000:3.0:1787827871.891690:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827871.891693:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827871.891698:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1787827871.891711:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827871.891712:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704000 x1874670272953088/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827871.891723:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827871.891726:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787827871.891727:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827871.891730:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3035
00000100:00080000:3.0:1787827871.891732:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827871.891735:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827871.891737:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787827871.891743:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707c00 x1874670272953216/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827871.891750:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827871.891753:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787827871.891754:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827871.891757:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3035
00000100:00080000:3.0:1787827871.891759:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827871.891762:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827871.891765:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827871.891774:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057052c0 x1874670272953344/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827871.891781:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827871.891784:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787827871.891785:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827871.891789:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3035
00000100:00080000:3.0:1787827871.891808:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827871.891811:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827871.891814:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827871.891824:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057070c0 x1874670272953472/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787827871.891828:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827871/real 1787827871]  req@ffff9ee005705680 x1874670272952704/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827896 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827871.891846:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705680 x1874670272952704/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827896 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827871.891853:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827871.891872:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827871.891876:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272952704:192.168.203.121@tcp:250:kworker.0
00000100:00100000:1.0:1787827871.891896:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272952832:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787827871.891917:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827871.891956:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827871/real 1787827871]  req@ffff9ee005706940 x1874670272952832/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827896 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827871.891966:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706940 x1874670272952832/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827896 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827871.891974:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827871.891976:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827871.891979:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272952832:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787827871.891984:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272952960:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827871.892000:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827871.892024:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827871/real 1787827871]  req@ffff9ee005706d00 x1874670272952960/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827896 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827871.892033:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706d00 x1874670272952960/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827896 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827871.892039:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827871.892041:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827871.892043:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272952960:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827871.892047:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272953088:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827871.892059:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827871.892091:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827871/real 1787827871]  req@ffff9ee005704000 x1874670272953088/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827896 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827871.892101:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704000 x1874670272953088/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827896 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827871.892108:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827871.892110:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827871.892113:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272953088:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827871.892118:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272953216:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787827871.892131:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827871.892186:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827871/real 1787827871]  req@ffff9ee005707c00 x1874670272953216/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827896 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827871.892194:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707c00 x1874670272953216/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827896 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827871.892199:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827871.892201:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827871.892204:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272953216:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787827871.892208:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272953344:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827871.892220:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827871.892244:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827871/real 1787827871]  req@ffff9ee0057052c0 x1874670272953344/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827896 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827871.892253:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057052c0 x1874670272953344/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827896 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827871.892259:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827871.892261:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827871.892263:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272953344:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827871.892268:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272953472:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827871.892282:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827871.892291:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827871/real 1787827871]  req@ffff9ee0057070c0 x1874670272953472/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827896 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827871.892306:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057070c0 x1874670272953472/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827896 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827871.892316:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827871.892321:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827871.892327:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272953472:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827872.723473:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827872.915473:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787827873.747462:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827873.939411:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827874.771629:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827874.963379:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827875.795610:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827875.987461:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827876.819698:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827877.011375:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787827877.011552:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827877.011566:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787827877.011573:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827877.011590:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3040
00000100:00080000:3.0:1787827877.011633:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827877.011644:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787827877.011731:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057061c0 x1874670272953600/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827877.011787:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827877.011794:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787827877.011797:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827877.011803:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3040
00000100:00080000:3.0:1787827877.011809:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827877.011815:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827877.011831:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787827877.011853:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707480 x1874670272953728/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827877.011872:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827877.011878:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787827877.011881:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827877.011887:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3040
00000100:00100000:1.0:1787827877.011895:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272953600:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787827877.011908:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827877.011917:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827877.011925:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827877.011962:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057043c0 x1874670272953856/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827877.011974:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827877.011979:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787827877.011982:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827877.011986:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3040
00000100:00080000:3.0:1787827877.011990:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827877.011994:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827877.012018:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1787827877.012040:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827877.012041:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704b40 x1874670272953984/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827877.012060:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827877.012066:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787827877.012069:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827877.012075:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3040
00000100:00080000:3.0:1787827877.012081:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827877.012086:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827877.012092:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787827877.012139:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706580 x1874670272954112/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787827877.012171:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827877/real 1787827877]  req@ffff9ee0057061c0 x1874670272953600/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827902 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827877.012174:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827877.012185:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787827877.012191:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827877.012205:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3040
00000100:00080000:3.0:1787827877.012212:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1787827877.012220:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057061c0 x1874670272953600/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827902 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827877.012221:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827877.012233:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:1.0:1787827877.012251:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:3.0:1787827877.012257:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704780 x1874670272954240/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827877.012263:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827877.012276:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272953600:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787827877.012282:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827877.012288:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787827877.012291:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827877.012296:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3040
00000100:00080000:3.0:1787827877.012300:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827877.012304:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827877.012309:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827877.012322:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705a40 x1874670272954368/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787827877.012357:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272953728:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787827877.012431:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827877.012453:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827877/real 1787827877]  req@ffff9ee005707480 x1874670272953728/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827902 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827877.012470:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707480 x1874670272953728/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827902 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827877.012481:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827877.012485:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827877.012490:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272953728:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787827877.012498:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272953856:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827877.012521:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827877.012534:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827877/real 1787827877]  req@ffff9ee0057043c0 x1874670272953856/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827902 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827877.012549:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057043c0 x1874670272953856/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827902 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827877.012559:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827877.012563:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827877.012567:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272953856:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827877.012574:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272953984:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827877.012593:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827877.012604:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827877/real 1787827877]  req@ffff9ee005704b40 x1874670272953984/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827902 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827877.012655:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704b40 x1874670272953984/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827902 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827877.012669:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827877.012676:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827877.012682:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272953984:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827877.012693:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272954112:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787827877.012748:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827877.012770:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827877/real 1787827877]  req@ffff9ee005706580 x1874670272954112/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827902 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827877.012795:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706580 x1874670272954112/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827902 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827877.012814:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827877.012821:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827877.012828:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272954112:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787827877.012839:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272954240:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827877.012868:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827877.012883:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827877/real 1787827877]  req@ffff9ee005704780 x1874670272954240/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827902 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827877.012898:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704780 x1874670272954240/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827902 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827877.012908:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827877.012912:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827877.012916:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272954240:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827877.012959:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272954368:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827877.012979:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827877.012989:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827877/real 1787827877]  req@ffff9ee005705a40 x1874670272954368/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827902 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827877.013002:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705a40 x1874670272954368/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827902 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827877.013029:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827877.013033:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827877.013038:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272954368:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827877.843574:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827878.035572:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787827878.867471:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827879.059410:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827879.891525:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827880.083399:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827880.915450:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827881.107396:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827881.939522:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1787827882.131404:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827882.131411:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787827882.131415:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1787827882.131421:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787827882.131424:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3045
00000100:00080000:3.0:1787827882.131435:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827882.131441:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787827882.131481:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707840 x1874670272954496/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827882.131508:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827882.131512:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787827882.131514:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827882.131518:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3045
00000100:00080000:3.0:1787827882.131528:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827882.131532:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827882.131541:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787827882.131555:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705e00 x1874670272954624/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787827882.131556:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272954496:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787827882.131570:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827882.131573:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787827882.131574:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827882.131578:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3045
00000100:00080000:3.0:1787827882.131580:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827882.131587:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827882.131592:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827882.131601:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705a40 x1874670272954752/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827882.131609:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827882.131611:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787827882.131612:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827882.131615:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3045
00000800:00000100:1.0:1787827882.131619:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787827882.131619:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827882.131625:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827882.131629:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827882.131637:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704780 x1874670272954880/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827882.131644:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827882.131646:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787827882.131648:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827882.131650:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3045
00000100:00080000:3.0:1787827882.131653:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827882.131657:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827882.131663:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787827882.131664:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827882/real 1787827882]  req@ffff9ee005707840 x1874670272954496/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827907 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827882.131679:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706580 x1874670272955008/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787827882.131683:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707840 x1874670272954496/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827907 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827882.131713:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827882.131714:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827882.131718:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:3.0:1787827882.131724:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00100000:1.0:1787827882.131726:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272954496:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787827882.131729:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827882.131737:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3045
00000100:00080000:3.0:1787827882.131743:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1787827882.131746:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272954624:192.168.203.121@tcp:38:kworker.0
00000100:00080000:3.0:1787827882.131751:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827882.131760:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1787827882.131769:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827882.131778:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704b40 x1874670272955136/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787827882.131781:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827882/real 1787827882]  req@ffff9ee005705e00 x1874670272954624/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827907 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827882.131814:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1787827882.131819:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705e00 x1874670272954624/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827907 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827882.131821:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787827882.131825:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827882.131836:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3045
00000100:00080000:1.0:1787827882.131841:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827882.131843:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827882.131849:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00080000:3.0:1787827882.131854:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787827882.131859:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272954624:192.168.203.121@tcp:38:kworker.0
00000008:00100000:3.0:1787827882.131863:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787827882.131867:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272954752:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787827882.131882:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057043c0 x1874670272955264/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1787827882.131899:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827882.131910:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827882/real 1787827882]  req@ffff9ee005705a40 x1874670272954752/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827907 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827882.131920:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705a40 x1874670272954752/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827907 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827882.131925:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827882.131927:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827882.131929:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272954752:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827882.131933:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272954880:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827882.131944:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827882.131950:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827882/real 1787827882]  req@ffff9ee005704780 x1874670272954880/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827907 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827882.131957:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704780 x1874670272954880/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827907 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827882.131962:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827882.131964:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827882.131965:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272954880:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827882.131969:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272955008:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787827882.131978:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827882.131983:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827882/real 1787827882]  req@ffff9ee005706580 x1874670272955008/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827907 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827882.131991:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706580 x1874670272955008/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827907 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827882.131996:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827882.131998:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827882.132000:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272955008:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787827882.132012:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272955136:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827882.132022:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827882.132027:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827882/real 1787827882]  req@ffff9ee005704b40 x1874670272955136/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827907 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827882.132034:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704b40 x1874670272955136/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827907 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827882.132039:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827882.132041:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827882.132043:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272955136:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827882.132046:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272955264:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827882.132056:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827882.132061:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827882/real 1787827882]  req@ffff9ee0057043c0 x1874670272955264/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827907 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827882.132088:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057043c0 x1874670272955264/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827907 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827882.132093:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827882.132095:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827882.132098:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272955264:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827882.963431:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827883.155392:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787827883.987471:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827884.179411:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827885.011443:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827885.203391:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827886.035447:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827886.227381:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827887.059475:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1787827887.251375:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827887.251386:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787827887.251391:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1787827887.251399:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787827887.251402:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3050
00000100:00080000:3.0:1787827887.251422:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827887.251433:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787827887.251472:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707480 x1874670272955392/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827887.251496:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827887.251499:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787827887.251500:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827887.251504:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3050
00000100:00080000:3.0:1787827887.251506:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827887.251509:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827887.251518:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787827887.251528:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057061c0 x1874670272955520/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827887.251537:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827887.251542:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787827887.251544:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1787827887.251545:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272955392:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787827887.251550:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3050
00000100:00080000:3.0:1787827887.251554:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827887.251557:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827887.251561:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827887.251572:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057070c0 x1874670272955648/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827887.251578:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827887.251581:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787827887.251582:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827887.251586:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3050
00000100:00080000:3.0:1787827887.251588:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827887.251590:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827887.251594:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827887.251601:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057052c0 x1874670272955776/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827887.251608:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827887.251610:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787827887.251611:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827887.251614:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3050
00000100:00080000:3.0:1787827887.251618:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000800:00000100:1.0:1787827887.251622:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787827887.251626:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827887.251630:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787827887.251640:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707c00 x1874670272955904/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827887.251646:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827887.251649:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787827887.251651:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827887.251654:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3050
00000100:00080000:3.0:1787827887.251658:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827887.251661:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827887.251664:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787827887.251669:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827887/real 1787827887]  req@ffff9ee005707480 x1874670272955392/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827912 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827887.251676:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704000 x1874670272956032/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827887.251685:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827887.251688:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:1.0:1787827887.251690:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707480 x1874670272955392/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827912 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827887.251691:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827887.251700:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3050
00000100:00080000:3.0:1787827887.251706:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827887.251710:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827887.251710:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827887.251718:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:1.0:1787827887.251719:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827887.251726:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272955392:192.168.203.121@tcp:250:kworker.0
00000100:00100000:3.0:1787827887.251731:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706d00 x1874670272956160/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787827887.251760:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272955520:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787827887.251779:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827887.251788:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827887/real 1787827887]  req@ffff9ee0057061c0 x1874670272955520/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827912 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827887.251798:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057061c0 x1874670272955520/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827912 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827887.251804:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827887.251807:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827887.251809:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272955520:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787827887.251813:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272955648:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827887.251825:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827887.251832:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827887/real 1787827887]  req@ffff9ee0057070c0 x1874670272955648/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827912 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827887.251847:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057070c0 x1874670272955648/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827912 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827887.251856:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827887.251858:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827887.251860:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272955648:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827887.251865:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272955776:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827887.251881:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827887.251893:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827887/real 1787827887]  req@ffff9ee0057052c0 x1874670272955776/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827912 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827887.251906:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057052c0 x1874670272955776/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827912 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827887.251915:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827887.251919:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827887.251923:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272955776:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827887.251929:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272955904:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787827887.251946:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827887.251958:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827887/real 1787827887]  req@ffff9ee005707c00 x1874670272955904/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827912 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827887.251972:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707c00 x1874670272955904/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827912 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827887.251981:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827887.251986:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827887.251989:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272955904:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787827887.251996:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272956032:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827887.252012:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827887.252020:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827887/real 1787827887]  req@ffff9ee005704000 x1874670272956032/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827912 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827887.252161:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704000 x1874670272956032/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827912 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827887.252168:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827887.252171:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827887.252173:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272956032:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827887.252178:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272956160:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827887.252194:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827887.252202:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827887/real 1787827887]  req@ffff9ee005706d00 x1874670272956160/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827912 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827887.252210:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706d00 x1874670272956160/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827912 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827887.252219:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827887.252222:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827887.252227:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272956160:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827888.083588:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827888.275444:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787827889.107532:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827889.299405:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827890.131476:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827890.323418:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827891.155482:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827891.347428:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827892.179444:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827892.371395:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:0.0:1787827892.371403:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827892.371409:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1787827892.371412:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827892.371420:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3056
00000100:00080000:0.0:1787827892.371430:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827892.371438:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787827892.371475:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb0c0 x1874670272956288/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827892.371505:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827892.371509:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787827892.371511:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827892.371515:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3056
00000100:00080000:0.0:1787827892.371521:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827892.371526:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787827892.371533:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272956288:192.168.203.121@tcp:250:kworker.0
00000008:00100000:0.0:1787827892.371537:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787827892.371555:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ea940 x1874670272956416/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827892.371566:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827892.371568:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787827892.371570:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827892.371575:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3056
00000100:00080000:0.0:1787827892.371579:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827892.371583:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827892.371589:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787827892.371599:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9a40 x1874670272956544/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827892.371606:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827892.371609:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787827892.371610:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827892.371613:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3056
00000100:00080000:0.0:1787827892.371615:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827892.371617:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827892.371620:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:3.0:1787827892.371624:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827892.371629:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ea580 x1874670272956672/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827892.371636:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827892.371638:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787827892.371639:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827892.371641:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3056
00000100:00080000:0.0:1787827892.371643:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827892.371645:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827892.371647:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787827892.371652:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ead00 x1874670272956800/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827892.371662:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827892.371664:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787827892.371665:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827892.371667:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3056
00000100:00080000:0.0:1787827892.371669:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827892.371671:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827892.371673:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787827892.371679:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8780 x1874670272956928/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827892.371684:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827892.371686:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787827892.371687:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827892.371690:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3056
00000100:00080000:0.0:1787827892.371691:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827892.371693:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827892.371696:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787827892.371703:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9e00 x1874670272957056/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787827892.371727:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827892/real 1787827892]  req@ffff9ee0056eb0c0 x1874670272956288/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827917 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827892.371867:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb0c0 x1874670272956288/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827917 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827892.371920:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827892.371926:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827892.371932:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272956288:192.168.203.121@tcp:250:kworker.0
00000100:00100000:3.0:1787827892.371955:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272956416:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787827892.371981:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827892.372009:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827892/real 1787827892]  req@ffff9ee0056ea940 x1874670272956416/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827917 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827892.372025:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ea940 x1874670272956416/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827917 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827892.372034:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827892.372038:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827892.372042:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272956416:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787827892.372048:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272956544:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827892.372070:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827892.372081:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827892/real 1787827892]  req@ffff9ee0056e9a40 x1874670272956544/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827917 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827892.372093:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9a40 x1874670272956544/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827917 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827892.372102:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827892.372105:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827892.372109:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272956544:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787827892.372117:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272956672:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827892.372135:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827892.372145:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827892/real 1787827892]  req@ffff9ee0056ea580 x1874670272956672/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827917 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827892.372158:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ea580 x1874670272956672/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827917 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827892.372166:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827892.372170:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827892.372174:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272956672:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787827892.372180:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272956800:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787827892.372199:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827892.372210:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827892/real 1787827892]  req@ffff9ee0056ead00 x1874670272956800/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827917 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827892.372222:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ead00 x1874670272956800/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827917 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827892.372231:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827892.372235:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827892.372239:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272956800:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787827892.372245:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272956928:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827892.372262:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827892.372272:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827892/real 1787827892]  req@ffff9ee0056e8780 x1874670272956928/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827917 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827892.372285:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8780 x1874670272956928/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827917 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827892.372294:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827892.372297:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827892.372301:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272956928:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787827892.372307:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272957056:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827892.372356:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827892.372373:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827892/real 1787827892]  req@ffff9ee0056e9e00 x1874670272957056/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827917 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827892.372390:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9e00 x1874670272957056/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827917 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827892.372398:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827892.372403:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827892.372406:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272957056:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827893.203464:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827893.395440:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787827894.227505:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827894.419368:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827895.251446:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827895.443406:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827896.275487:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827896.467381:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827897.299489:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1787827897.491394:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1787827897.491396:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:1.0:1787827897.491407:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1787827897.491411:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827897.491419:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3061
00000100:00080000:1.0:1787827897.491428:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827897.491434:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787827897.491465:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a21c0 x1874670272957184/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827897.491485:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827897.491488:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787827897.491489:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827897.491491:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3061
00000100:00080000:1.0:1787827897.491494:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827897.491496:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827897.491503:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787827897.491512:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0f00 x1874670272957312/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827897.491519:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827897.491521:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787827897.491522:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827897.491525:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3061
00000100:00080000:1.0:1787827897.491528:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827897.491531:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827897.491535:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787827897.491541:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1680 x1874670272957440/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827897.491549:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827897.491552:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787827897.491554:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827897.491556:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3061
00000100:00080000:1.0:1787827897.491558:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827897.491563:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827897.491567:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787827897.491574:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a2940 x1874670272957568/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787827897.491574:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272957184:192.168.203.121@tcp:250:kworker.0
00000100:00080000:1.0:1787827897.491600:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827897.491602:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787827897.491603:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827897.491606:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3061
00000100:00080000:1.0:1787827897.491609:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827897.491612:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827897.491615:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787827897.491623:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a3c00 x1874670272957696/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827897.491628:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827897.491631:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787827897.491632:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827897.491635:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3061
00000100:00080000:1.0:1787827897.491638:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827897.491641:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827897.491644:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787827897.491650:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1a40 x1874670272957824/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827897.491655:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827897.491660:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787827897.491661:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827897.491664:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3061
00000100:00080000:1.0:1787827897.491667:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827897.491669:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827897.491673:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:3.0:1787827897.491677:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827897.491683:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a12c0 x1874670272957952/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787827897.491740:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827897/real 1787827897]  req@ffff9ee0056a21c0 x1874670272957184/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827922 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827897.491772:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a21c0 x1874670272957184/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827922 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827897.491785:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827897.491791:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827897.491795:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272957184:192.168.203.121@tcp:250:kworker.0
00000100:00100000:3.0:1787827897.491802:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272957312:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787827897.491825:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827897.491835:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827897/real 1787827897]  req@ffff9ee0056a0f00 x1874670272957312/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827922 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827897.491844:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0f00 x1874670272957312/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827922 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827897.491850:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827897.491853:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827897.491855:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272957312:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787827897.491881:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272957440:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827897.491895:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827897.491902:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827897/real 1787827897]  req@ffff9ee0056a1680 x1874670272957440/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827922 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827897.491909:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1680 x1874670272957440/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827922 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827897.491920:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827897.491922:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827897.491925:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272957440:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787827897.491929:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272957568:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827897.491939:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827897.491945:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827897/real 1787827897]  req@ffff9ee0056a2940 x1874670272957568/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827922 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827897.491952:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a2940 x1874670272957568/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827922 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827897.491974:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827897.491977:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827897.491980:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272957568:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787827897.491984:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272957696:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787827897.492008:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827897.492017:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827897/real 1787827897]  req@ffff9ee0056a3c00 x1874670272957696/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827922 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827897.492025:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a3c00 x1874670272957696/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827922 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827897.492031:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827897.492033:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827897.492036:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272957696:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787827897.492040:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272957824:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827897.492053:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827897.492060:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827897/real 1787827897]  req@ffff9ee0056a1a40 x1874670272957824/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827922 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827897.492067:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1a40 x1874670272957824/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827922 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827897.492072:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827897.492074:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827897.492076:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272957824:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787827897.492080:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272957952:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827897.492096:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827897.492103:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827897/real 1787827897]  req@ffff9ee0056a12c0 x1874670272957952/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827922 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827897.492109:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a12c0 x1874670272957952/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827922 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827897.492114:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827897.492116:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827897.492118:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272957952:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827898.323428:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827898.515368:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787827899.347520:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827899.539417:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827900.371442:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827900.563417:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827901.395465:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827901.587407:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827902.419442:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827902.611385:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:1.0:1787827902.611386:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827902.611395:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1787827902.611399:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827902.611406:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3066
00000100:00080000:1.0:1787827902.611416:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827902.611422:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787827902.611454:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a03c0 x1874670272958080/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827902.611476:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827902.611479:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787827902.611480:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827902.611483:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3066
00000100:00080000:1.0:1787827902.611485:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827902.611487:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827902.611495:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787827902.611503:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1e00 x1874670272958208/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827902.611511:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827902.611516:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787827902.611517:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1787827902.611518:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272958080:192.168.203.121@tcp:250:kworker.0
00000100:00080000:1.0:1787827902.611522:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3066
00000100:00080000:1.0:1787827902.611526:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827902.611530:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827902.611533:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787827902.611541:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0b40 x1874670272958336/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827902.611547:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827902.611549:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787827902.611551:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827902.611552:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3066
00000100:00080000:1.0:1787827902.611556:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827902.611558:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827902.611561:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787827902.611568:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a2580 x1874670272958464/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827902.611574:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827902.611576:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787827902.611577:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827902.611586:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3066
00000100:00080000:1.0:1787827902.611592:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000800:00000100:3.0:1787827902.611593:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:1.0:1787827902.611601:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827902.611607:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787827902.611620:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a3480 x1874670272958592/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827902.611630:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827902.611634:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787827902.611636:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1787827902.611642:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827902/real 1787827902]  req@ffff9ee0056a03c0 x1874670272958080/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827927 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827902.611643:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3066
00000100:00080000:1.0:1787827902.611653:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827902.611660:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827902.611665:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827902.611669:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a03c0 x1874670272958080/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827927 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827902.611677:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0780 x1874670272958720/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827902.611690:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827902.611695:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827902.611700:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:1.0:1787827902.611701:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787827902.611705:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827902.611710:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3066
00000100:00100000:3.0:1787827902.611711:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272958080:192.168.203.121@tcp:250:kworker.0
00000100:00080000:1.0:1787827902.611713:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827902.611720:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827902.611724:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787827902.611730:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0000 x1874670272958848/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787827902.611744:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272958208:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787827902.611772:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827902.611786:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827902/real 1787827902]  req@ffff9ee0056a1e00 x1874670272958208/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827927 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827902.611800:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1e00 x1874670272958208/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827927 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827902.611809:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827902.611812:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827902.611816:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272958208:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787827902.611822:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272958336:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827902.611845:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827902.611856:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827902/real 1787827902]  req@ffff9ee0056a0b40 x1874670272958336/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827927 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827902.611869:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0b40 x1874670272958336/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827927 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827902.611878:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827902.611881:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827902.611885:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272958336:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787827902.611891:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272958464:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827902.611906:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827902.611914:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827902/real 1787827902]  req@ffff9ee0056a2580 x1874670272958464/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827927 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827902.611942:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a2580 x1874670272958464/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827927 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827902.611951:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827902.611954:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827902.611957:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272958464:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787827902.611965:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272958592:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787827902.611985:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827902.611999:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827902/real 1787827902]  req@ffff9ee0056a3480 x1874670272958592/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827927 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827902.612012:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a3480 x1874670272958592/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827927 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827902.612027:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827902.612030:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827902.612034:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272958592:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787827902.612040:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272958720:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827902.612060:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827902.612072:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827902/real 1787827902]  req@ffff9ee0056a0780 x1874670272958720/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827927 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827902.612085:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0780 x1874670272958720/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827927 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827902.612093:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827902.612097:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827902.612100:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272958720:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787827902.612106:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272958848:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827902.612136:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827902.612148:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827902/real 1787827902]  req@ffff9ee0056a0000 x1874670272958848/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827927 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827902.612161:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0000 x1874670272958848/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827927 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827902.612170:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827902.612173:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827902.612177:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272958848:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827903.443525:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827903.635413:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787827904.467435:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827904.659387:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827905.491460:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827905.683408:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827906.515453:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827906.707418:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827907.539480:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827907.731400:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:0.0:1787827907.731424:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827907.731433:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1787827907.731439:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827907.731450:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3071
00000100:00080000:0.0:1787827907.731465:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827907.731474:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787827907.731527:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8b40 x1874670272958976/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827907.731555:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827907.731559:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787827907.731561:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827907.731565:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3071
00000100:00080000:0.0:1787827907.731570:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827907.731576:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827907.731590:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787827907.731590:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272958976:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787827907.731611:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9680 x1874670272959104/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827907.731625:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827907.731629:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787827907.731631:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827907.731636:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3071
00000100:00080000:0.0:1787827907.731640:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827907.731646:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827907.731652:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787827907.731665:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e92c0 x1874670272959232/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827907.731677:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:3.0:1787827907.731678:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:0.0:1787827907.731684:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787827907.731687:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827907.731692:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3071
00000100:00080000:0.0:1787827907.731697:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827907.731702:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827907.731707:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787827907.731719:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb840 x1874670272959360/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827907.731729:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827907.731734:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787827907.731736:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1787827907.731740:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827907/real 1787827907]  req@ffff9ee0056e8b40 x1874670272958976/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827932 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827907.731743:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3071
00000100:00080000:0.0:1787827907.731748:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827907.731754:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827907.731761:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787827907.731770:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8b40 x1874670272958976/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827932 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827907.731775:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb480 x1874670272959488/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827907.731788:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827907.731793:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827907.731795:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:0.0:1787827907.731801:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00100000:3.0:1787827907.731804:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272958976:192.168.203.121@tcp:250:kworker.0
00000100:00080000:0.0:1787827907.731806:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827907.731813:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3071
00000100:00080000:0.0:1787827907.731817:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827907.731822:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827907.731828:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827907.731831:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272959104:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787827907.731842:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8000 x1874670272959616/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827907.731851:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827907.731854:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787827907.731856:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827907.731859:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3071
00000100:00080000:0.0:1787827907.731863:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000800:00000100:3.0:1787827907.731865:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:0.0:1787827907.731869:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827907.731874:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827907.731880:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827907/real 1787827907]  req@ffff9ee0056e9680 x1874670272959104/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827932 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787827907.731885:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e83c0 x1874670272959744/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787827907.731922:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9680 x1874670272959104/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827932 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827907.731931:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827907.731935:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827907.731939:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272959104:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787827907.731943:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272959232:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827907.731959:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827907.731967:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827907/real 1787827907]  req@ffff9ee0056e92c0 x1874670272959232/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827932 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827907.731975:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e92c0 x1874670272959232/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827932 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827907.731980:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827907.731983:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827907.731985:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272959232:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787827907.731988:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272959360:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827907.731998:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827907.732004:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827907/real 1787827907]  req@ffff9ee0056eb840 x1874670272959360/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827932 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827907.732011:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb840 x1874670272959360/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827932 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827907.732016:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827907.732018:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827907.732020:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272959360:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787827907.732024:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272959488:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787827907.732034:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827907.732040:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827907/real 1787827907]  req@ffff9ee0056eb480 x1874670272959488/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827932 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827907.732048:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb480 x1874670272959488/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827932 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827907.732053:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827907.732054:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827907.732056:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272959488:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787827907.732067:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272959616:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827907.732077:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827907.732083:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827907/real 1787827907]  req@ffff9ee0056e8000 x1874670272959616/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827932 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827907.732090:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8000 x1874670272959616/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827932 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827907.732094:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827907.732096:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827907.732098:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272959616:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787827907.732101:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272959744:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827907.732120:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827907.732126:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827907/real 1787827907]  req@ffff9ee0056e83c0 x1874670272959744/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827932 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827907.732134:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e83c0 x1874670272959744/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827932 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827907.732139:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827907.732142:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827907.732144:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272959744:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827908.563509:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827908.755382:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787827909.587445:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827909.779397:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827910.611483:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827910.803379:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827911.635472:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827911.827378:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827912.659453:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1787827912.851434:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1787827912.851438:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:0.0:1787827912.851447:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1787827912.851452:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827912.851463:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3076
00000100:00080000:0.0:1787827912.851475:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827912.851483:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787827912.851537:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ebc00 x1874670272959872/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827912.851563:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827912.851566:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787827912.851567:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827912.851570:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3076
00000100:00080000:0.0:1787827912.851574:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827912.851579:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827912.851589:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787827912.851597:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272959872:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787827912.851602:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8f00 x1874670272960000/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827912.851611:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827912.851614:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787827912.851615:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827912.851617:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3076
00000100:00080000:0.0:1787827912.851620:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827912.851623:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827912.851632:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787827912.851643:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e83c0 x1874670272960128/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827912.851650:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827912.851652:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787827912.851653:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827912.851655:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3076
00000100:00080000:0.0:1787827912.851663:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827912.851666:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827912.851670:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:3.0:1787827912.851675:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827912.851679:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8000 x1874670272960256/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827912.851693:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827912.851696:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787827912.851698:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827912.851700:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3076
00000100:00080000:0.0:1787827912.851702:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827912.851705:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827912.851709:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787827912.851719:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb480 x1874670272960384/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787827912.851723:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827912/real 1787827912]  req@ffff9ee0056ebc00 x1874670272959872/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827937 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827912.851737:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827912.851743:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787827912.851745:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827912.851748:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3076
00000100:00080000:0.0:1787827912.851750:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1787827912.851752:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ebc00 x1874670272959872/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827937 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827912.851756:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827912.851763:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:3.0:1787827912.851772:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:0.0:1787827912.851776:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb840 x1874670272960512/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827912.851780:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827912.851788:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272959872:192.168.203.121@tcp:250:kworker.0
00000100:00080000:0.0:1787827912.851793:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827912.851797:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787827912.851798:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827912.851802:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3076
00000100:00080000:0.0:1787827912.851805:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827912.851807:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827912.851809:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827912.851816:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272960000:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787827912.851820:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e92c0 x1874670272960640/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1787827912.851840:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827912.851869:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827912/real 1787827912]  req@ffff9ee0056e8f00 x1874670272960000/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827937 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827912.851880:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8f00 x1874670272960000/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827937 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827912.851886:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827912.851888:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827912.851891:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272960000:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787827912.851895:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272960128:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827912.851912:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827912.851920:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827912/real 1787827912]  req@ffff9ee0056e83c0 x1874670272960128/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827937 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827912.851928:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e83c0 x1874670272960128/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827937 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827912.851933:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827912.851935:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827912.851937:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272960128:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787827912.851940:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272960256:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827912.851950:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827912.851956:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827912/real 1787827912]  req@ffff9ee0056e8000 x1874670272960256/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827937 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827912.851963:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8000 x1874670272960256/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827937 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827912.851973:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827912.851975:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827912.851977:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272960256:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787827912.851980:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272960384:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787827912.851990:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827912.851995:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827912/real 1787827912]  req@ffff9ee0056eb480 x1874670272960384/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827937 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827912.852001:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb480 x1874670272960384/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827937 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827912.852006:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827912.852008:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827912.852010:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272960384:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787827912.852014:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272960512:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827912.852023:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827912.852029:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827912/real 1787827912]  req@ffff9ee0056eb840 x1874670272960512/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827937 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827912.852035:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb840 x1874670272960512/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827937 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827912.852040:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827912.852043:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827912.852045:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272960512:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787827912.852061:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272960640:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827912.852081:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827912.852094:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827912/real 1787827912]  req@ffff9ee0056e92c0 x1874670272960640/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827937 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827912.852107:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e92c0 x1874670272960640/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827937 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827912.852115:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827912.852117:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827912.852119:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272960640:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827913.683459:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827913.875400:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787827914.707469:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827914.899447:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827915.731480:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827915.923386:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827916.755454:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827916.947419:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827917.779473:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827917.971430:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:0.0:1787827917.971432:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827917.971443:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1787827917.971449:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827917.971460:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3081
00000100:00080000:0.0:1787827917.971474:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827917.971483:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787827917.971533:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9680 x1874670272960768/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827917.971561:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827917.971565:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787827917.971567:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827917.971571:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3081
00000100:00080000:0.0:1787827917.971575:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827917.971581:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827917.971593:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787827917.971603:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272960768:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787827917.971611:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8b40 x1874670272960896/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827917.971624:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827917.971631:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787827917.971633:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827917.971637:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3081
00000100:00080000:0.0:1787827917.971641:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827917.971646:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827917.971652:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787827917.971663:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9e00 x1874670272961024/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827917.971674:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827917.971677:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787827917.971679:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827917.971683:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3081
00000100:00080000:0.0:1787827917.971687:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827917.971691:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827917.971696:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787827917.971707:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8780 x1874670272961152/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827917.971718:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827917.971722:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787827917.971724:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827917.971729:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3081
00000100:00080000:0.0:1787827917.971734:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1787827917.971742:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272960896:192.168.203.121@tcp:38:kworker.0
00000100:00080000:0.0:1787827917.971743:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827917.971754:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787827917.971772:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ead00 x1874670272961280/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827917.971785:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827917.971792:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00100000:3.0:1787827917.971792:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272961024:192.168.203.121@tcp:8:kworker.0
00000100:00080000:0.0:1787827917.971796:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827917.971804:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3081
00000100:00080000:0.0:1787827917.971810:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827917.971829:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827917.971836:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827917.971838:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272961152:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787827917.971854:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ea580 x1874670272961408/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827917.971866:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827917.971870:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787827917.971873:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1787827917.971875:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272961280:192.168.203.121@tcp:38:kworker.0
00000100:00080000:0.0:1787827917.971881:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3081
00000100:00080000:0.0:1787827917.971888:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827917.971893:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827917.971900:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787827917.971916:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9a40 x1874670272961536/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787827917.971916:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272961408:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787827917.971945:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272961536:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827918.803457:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827918.995384:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787827919.827467:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827920.019384:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827920.851543:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827921.043419:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000400:00000100:2.0:1787827921.043898:0:2354:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.203.121:988
00000400:00000100:2.0:1787827921.043953:0:2354:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.203.121@tcp at host 192.168.203.121 was unreachable: the network or that node may be down, or Lustre may be misconfigured.
00000800:00000100:2.0:1787827921.043977:0:2354:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:2.0:1787827921.044026:0:2354:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:2.0:1787827921.044040:0:2354:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:2.0:1787827921.044056:0:2354:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000100:00100000:3.0:1787827921.044058:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827917/real 1787827921]  req@ffff9ee0056e8b40 x1874670272960896/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827942 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000800:00000100:2.0:1787827921.044070:0:2354:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:2.0:1787827921.044085:0:2354:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000100:00100000:3.0:1787827921.044099:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8b40 x1874670272960896/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827942 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000800:00000100:2.0:1787827921.044100:0:2354:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000100:00080000:3.0:1787827921.044118:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827921.044125:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827921.044130:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272960896:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787827921.044139:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827917/real 1787827921]  req@ffff9ee0056e9e00 x1874670272961024/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827942 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827921.044154:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9e00 x1874670272961024/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827942 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827921.044162:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827921.044166:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827921.044170:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272961024:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787827921.044177:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827917/real 1787827921]  req@ffff9ee0056e8780 x1874670272961152/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827942 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827921.044196:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8780 x1874670272961152/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827942 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827921.044204:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827921.044207:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827921.044211:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272961152:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787827921.044217:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827917/real 1787827921]  req@ffff9ee0056e9680 x1874670272960768/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827942 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827921.044228:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9680 x1874670272960768/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827942 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827921.044236:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827921.044246:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827921.044250:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272960768:192.168.203.121@tcp:250:kworker.0
00000100:00100000:3.0:1787827921.044282:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827917/real 1787827921]  req@ffff9ee0056e9a40 x1874670272961536/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827942 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827921.044296:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9a40 x1874670272961536/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827942 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827921.044305:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827921.044309:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827921.044312:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272961536:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787827921.044364:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827917/real 1787827921]  req@ffff9ee0056ead00 x1874670272961280/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827942 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827921.044379:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ead00 x1874670272961280/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827942 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827921.044389:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827921.044394:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827921.044399:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272961280:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787827921.044407:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827917/real 1787827921]  req@ffff9ee0056ea580 x1874670272961408/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827942 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827921.044420:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ea580 x1874670272961408/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827942 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827921.044429:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827921.044433:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827921.044437:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272961408:192.168.203.121@tcp:8:kworker.0
00010000:00010000:3.0:1787827921.875582:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787827922.067430:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827922.899558:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1787827923.091455:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827923.091478:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787827923.091483:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827923.091496:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3086
00000100:00080000:3.0:1787827923.091510:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827923.091549:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787827923.091552:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00100000:3.0:1787827923.091603:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706940 x1874670272961664/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827923.091678:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827923.091682:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787827923.091685:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827923.091690:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3086
00000100:00080000:3.0:1787827923.091696:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827923.091701:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827923.091716:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787827923.091742:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705680 x1874670272961792/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787827923.091750:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272961664:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787827923.091807:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827923.091829:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787827923.091832:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827923.091837:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3086
00000100:00080000:3.0:1787827923.091843:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827923.091849:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827923.091856:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827923.091872:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706d00 x1874670272961920/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827923.091885:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827923.091891:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000800:00000100:1.0:1787827923.091893:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787827923.091894:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827923.091903:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3086
00000100:00080000:3.0:1787827923.091909:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827923.091913:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827923.091918:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827923.091930:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704000 x1874670272962048/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827923.091938:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827923.091940:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787827923.091942:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827923.091946:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3086
00000100:00080000:3.0:1787827923.091949:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827923.091955:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787827923.091957:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827923/real 1787827923]  req@ffff9ee005706940 x1874670272961664/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827948 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:3.0:1787827923.091959:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787827923.091972:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707c00 x1874670272962176/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787827923.091992:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706940 x1874670272961664/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827948 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827923.092040:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827923.092041:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827923.092055:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787827923.092057:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:3.0:1787827923.092061:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1787827923.092072:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272961664:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787827923.092076:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3086
00000100:00080000:3.0:1787827923.092092:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827923.092101:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827923.092111:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787827923.092125:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272961792:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787827923.092138:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057052c0 x1874670272962304/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827923.092170:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827923.092176:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787827923.092179:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:1.0:1787827923.092186:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787827923.092194:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3086
00000100:00080000:3.0:1787827923.092205:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827923.092213:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827923.092222:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787827923.092237:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827923/real 1787827923]  req@ffff9ee005705680 x1874670272961792/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827948 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827923.092248:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057070c0 x1874670272962432/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787827923.092311:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705680 x1874670272961792/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827948 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827923.092365:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827923.092371:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827923.092378:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272961792:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787827923.092390:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272961920:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827923.092431:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827923.092473:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827923/real 1787827923]  req@ffff9ee005706d00 x1874670272961920/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827948 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827923.092494:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706d00 x1874670272961920/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827948 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827923.092507:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827923.092512:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827923.092517:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272961920:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827923.092528:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272962048:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827923.092563:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827923.092584:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827923/real 1787827923]  req@ffff9ee005704000 x1874670272962048/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827948 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827923.092606:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704000 x1874670272962048/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827948 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827923.092621:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827923.092627:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827923.092632:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272962048:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827923.092643:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272962176:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787827923.092679:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827923.092701:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827923/real 1787827923]  req@ffff9ee005707c00 x1874670272962176/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827948 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827923.092723:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707c00 x1874670272962176/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827948 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827923.092738:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827923.092743:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827923.092750:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272962176:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787827923.092807:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272962304:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827923.092845:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827923.092867:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827923/real 1787827923]  req@ffff9ee0057052c0 x1874670272962304/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827948 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827923.092890:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057052c0 x1874670272962304/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827948 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827923.092905:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827923.092910:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827923.092917:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272962304:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827923.092929:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272962432:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827923.092966:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827923.092987:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827923/real 1787827923]  req@ffff9ee0057070c0 x1874670272962432/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827948 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827923.093009:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057070c0 x1874670272962432/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827948 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827923.093021:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827923.093026:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827923.093032:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272962432:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827923.923516:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787827924.115604:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787827924.947560:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787827925.139480:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827925.971573:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787827926.163484:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827926.995621:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787827927.187412:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827928.019531:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787827928.211446:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:0.0:1787827928.211476:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827928.211488:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1787827928.211494:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827928.211508:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3091
00000100:00080000:0.0:1787827928.211523:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827928.211537:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787827928.211593:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ea940 x1874670272962560/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827928.211644:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827928.211649:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787827928.211652:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827928.211657:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3091
00000100:00080000:0.0:1787827928.211663:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827928.211669:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827928.211682:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787827928.211700:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb0c0 x1874670272962688/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827928.211720:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827928.211724:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787827928.211730:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1787827928.211738:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272962560:192.168.203.121@tcp:250:kworker.0
00000100:00080000:0.0:1787827928.211740:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3091
00000100:00080000:0.0:1787827928.211765:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827928.211774:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827928.211794:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787827928.211818:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ea580 x1874670272962816/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827928.211840:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827928.211845:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787827928.211848:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827928.211858:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3091
00000100:00080000:0.0:1787827928.211869:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827928.211874:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827928.211883:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787827928.211894:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ead00 x1874670272962944/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827928.211904:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827928.211907:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787827928.211909:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827928.211913:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3091
00000100:00080000:0.0:1787827928.212210:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827928.212215:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827928.212219:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787827928.212235:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9a40 x1874670272963072/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1787827928.212247:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:0.0:1787827928.212255:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827928.212261:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787827928.212264:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827928.212273:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3091
00000100:00080000:0.0:1787827928.212278:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827928.212284:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827928.212291:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787827928.212303:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9680 x1874670272963200/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827928.212385:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827928.212389:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787827928.212391:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827928.212400:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3091
00000100:00080000:0.0:1787827928.212404:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827928.212407:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827928.212413:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787827928.212430:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8780 x1874670272963328/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787827928.212498:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827928/real 1787827928]  req@ffff9ee0056ea940 x1874670272962560/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827953 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827928.212541:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ea940 x1874670272962560/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827953 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827928.212562:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827928.212568:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827928.212574:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272962560:192.168.203.121@tcp:250:kworker.0
00000100:00100000:3.0:1787827928.212611:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272962688:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787827928.212652:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827928.212671:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827928/real 1787827928]  req@ffff9ee0056eb0c0 x1874670272962688/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827953 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827928.212687:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb0c0 x1874670272962688/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827953 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827928.212698:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827928.212703:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827928.212707:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272962688:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787827928.212715:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272962816:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827928.212739:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827928.212786:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827928/real 1787827928]  req@ffff9ee0056ea580 x1874670272962816/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827953 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827928.212802:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ea580 x1874670272962816/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827953 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827928.212813:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827928.212818:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827928.212822:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272962816:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787827928.212830:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272962944:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827928.212859:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827928.212871:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827928/real 1787827928]  req@ffff9ee0056ead00 x1874670272962944/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827953 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827928.212895:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ead00 x1874670272962944/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827953 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827928.212905:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827928.212908:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827928.212912:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272962944:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787827928.212919:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272963072:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787827928.212940:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827928.212951:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827928/real 1787827928]  req@ffff9ee0056e9a40 x1874670272963072/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827953 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827928.212965:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9a40 x1874670272963072/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827953 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827928.212982:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827928.212989:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827928.212995:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272963072:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787827928.213007:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272963200:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827928.213048:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827928.213070:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827928/real 1787827928]  req@ffff9ee0056e9680 x1874670272963200/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827953 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827928.213094:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9680 x1874670272963200/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827953 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827928.213113:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827928.213118:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827928.213122:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272963200:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787827928.213131:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272963328:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827928.213158:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827928.213172:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827928/real 1787827928]  req@ffff9ee0056e8780 x1874670272963328/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827953 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827928.213195:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8780 x1874670272963328/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827953 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827928.213205:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827928.213209:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827928.213212:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272963328:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827929.043618:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827929.235453:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787827930.067492:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827930.259546:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827931.091621:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827931.283392:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827932.115562:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787827932.307437:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827933.139565:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1787827933.331435:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827933.331448:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787827933.331455:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1787827933.331467:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:2.0:1787827933.331470:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3097
00000100:00080000:2.0:1787827933.331490:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827933.331502:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787827933.331551:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572bc00 x1874670272963456/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827933.331586:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827933.331591:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787827933.331595:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827933.331599:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3097
00000100:00080000:2.0:1787827933.331604:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827933.331609:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827933.331622:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787827933.331639:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057292c0 x1874670272963584/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787827933.331652:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272963456:192.168.203.121@tcp:250:kworker.0
00000100:00080000:2.0:1787827933.331660:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827933.331667:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787827933.331670:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827933.331676:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3097
00000100:00080000:2.0:1787827933.331680:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827933.331685:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827933.331692:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787827933.331734:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729680 x1874670272963712/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827933.331750:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827933.331754:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787827933.331757:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827933.331762:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3097
00000100:00080000:2.0:1787827933.331768:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827933.331773:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827933.331780:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:3.0:1787827933.331788:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827933.331808:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728780 x1874670272963840/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827933.331822:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827933.331826:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787827933.331829:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827933.331834:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3097
00000100:00080000:2.0:1787827933.331841:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827933.331846:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827933.331853:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787827933.331854:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827933/real 1787827933]  req@ffff9ee00572bc00 x1874670272963456/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827958 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827933.331877:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a940 x1874670272963968/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787827933.331893:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572bc00 x1874670272963456/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827958 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827933.331896:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827933.331914:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787827933.331923:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827933.331935:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3097
00000100:00080000:2.0:1787827933.331943:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827933.331960:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00080000:3.0:1787827933.331961:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827933.331978:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000008:00100000:2.0:1787827933.331980:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827933.331987:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272963456:192.168.203.121@tcp:250:kworker.0
00000100:00100000:2.0:1787827933.332015:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729e00 x1874670272964096/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787827933.332028:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057292c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272963584:192.168.203.121@tcp:38:kworker.0
00000100:00080000:2.0:1787827933.332046:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827933.332052:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787827933.332055:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827933.332065:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3097
00000100:00080000:2.0:1787827933.332073:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000800:00000100:3.0:1787827933.332081:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:2.0:1787827933.332090:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827933.332100:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827933.332112:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827933/real 1787827933]  req@ffff9ee0057292c0 x1874670272963584/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827958 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827933.332129:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a1c0 x1874670272964224/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787827933.332157:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057292c0 x1874670272963584/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827958 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827933.332180:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827933.332191:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827933.332201:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057292c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272963584:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787827933.332215:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272963712:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827933.332254:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827933.332270:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827933/real 1787827933]  req@ffff9ee005729680 x1874670272963712/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827958 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827933.332286:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729680 x1874670272963712/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827958 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827933.332297:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827933.332301:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827933.332305:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272963712:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787827933.332348:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272963840:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827933.332375:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827933.332388:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827933/real 1787827933]  req@ffff9ee005728780 x1874670272963840/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827958 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827933.332403:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728780 x1874670272963840/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827958 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827933.332413:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827933.332417:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827933.332421:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272963840:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787827933.332428:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272963968:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787827933.332448:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827933.332458:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827933/real 1787827933]  req@ffff9ee00572a940 x1874670272963968/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827958 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827933.332472:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a940 x1874670272963968/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827958 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827933.332482:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827933.332485:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827933.332488:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272963968:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787827933.332513:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272964096:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827933.332532:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827933.332543:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827933/real 1787827933]  req@ffff9ee005729e00 x1874670272964096/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827958 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827933.332558:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729e00 x1874670272964096/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827958 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827933.332567:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827933.332571:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827933.332574:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272964096:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787827933.332581:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272964224:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827933.332599:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827933.332610:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827933/real 1787827933]  req@ffff9ee00572a1c0 x1874670272964224/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827958 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827933.332624:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a1c0 x1874670272964224/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827958 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827933.332633:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827933.332636:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827933.332640:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272964224:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827934.163544:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787827934.355456:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787827935.187480:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787827935.379424:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827936.211497:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787827936.403441:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827937.235621:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787827937.427466:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827938.259565:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787827938.451473:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:2.0:1787827938.451479:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827938.451489:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787827938.451494:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827938.451505:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3102
00000100:00080000:2.0:1787827938.451520:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827938.451533:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787827938.451586:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728f00 x1874670272964352/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827938.451621:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827938.451627:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787827938.451630:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827938.451636:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3102
00000100:00080000:2.0:1787827938.451642:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827938.451648:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827938.451660:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787827938.451661:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272964352:192.168.203.121@tcp:250:kworker.0
00000100:00100000:2.0:1787827938.451731:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b840 x1874670272964480/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827938.451746:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827938.451750:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787827938.451752:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827938.451755:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3102
00000100:00080000:2.0:1787827938.451760:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827938.451764:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827938.451768:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787827938.451781:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057283c0 x1874670272964608/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1787827938.451786:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:2.0:1787827938.451797:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827938.451801:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787827938.451803:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827938.451808:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3102
00000100:00080000:2.0:1787827938.451812:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827938.451815:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827938.451819:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787827938.451830:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728000 x1874670272964736/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787827938.451836:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827938/real 1787827938]  req@ffff9ee005728f00 x1874670272964352/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827963 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827938.451849:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827938.451856:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787827938.451859:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827938.451865:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3102
00000100:00100000:1.0:1787827938.451867:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728f00 x1874670272964352/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827963 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827938.451870:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827938.451880:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827938.451890:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00080000:1.0:1787827938.451892:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827938.451899:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827938.451904:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a580 x1874670272964864/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787827938.451909:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272964352:192.168.203.121@tcp:250:kworker.0
00000100:00080000:2.0:1787827938.451926:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827938.451929:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787827938.451932:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827938.451936:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3102
00000100:00080000:2.0:1787827938.451940:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827938.451945:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787827938.451946:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272964480:192.168.203.121@tcp:38:kworker.0
00000008:00100000:2.0:1787827938.451950:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787827938.451964:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728b40 x1874670272964992/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827938.451975:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827938.451978:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787827938.451980:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827938.451983:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3102
00000100:00080000:2.0:1787827938.451987:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000800:00000100:1.0:1787827938.451993:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:2.0:1787827938.451995:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827938.452003:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787827938.452014:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b480 x1874670272965120/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787827938.452023:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827938/real 1787827938]  req@ffff9ee00572b840 x1874670272964480/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827963 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827938.452065:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b840 x1874670272964480/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827963 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827938.452078:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827938.452083:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827938.452088:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272964480:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787827938.452097:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272964608:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827938.452128:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827938.452144:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827938/real 1787827938]  req@ffff9ee0057283c0 x1874670272964608/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827963 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827938.452155:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057283c0 x1874670272964608/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827963 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827938.452162:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827938.452165:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827938.452168:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272964608:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827938.452175:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272964736:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827938.452201:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827938.452218:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827938/real 1787827938]  req@ffff9ee005728000 x1874670272964736/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827963 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827938.452235:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728000 x1874670272964736/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827963 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827938.452246:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827938.452249:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827938.452252:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272964736:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827938.452258:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272964864:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787827938.452277:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827938.452286:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827938/real 1787827938]  req@ffff9ee00572a580 x1874670272964864/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827963 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827938.452296:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a580 x1874670272964864/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827963 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827938.452303:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827938.452305:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827938.452308:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272964864:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787827938.452328:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272964992:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827938.452393:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827938.452408:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827938/real 1787827938]  req@ffff9ee005728b40 x1874670272964992/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827963 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827938.452419:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728b40 x1874670272964992/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827963 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827938.452427:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827938.452429:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827938.452432:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272964992:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827938.452437:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272965120:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827938.452452:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827938.452460:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827938/real 1787827938]  req@ffff9ee00572b480 x1874670272965120/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827963 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827938.452469:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b480 x1874670272965120/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827963 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827938.452476:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827938.452478:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827938.452480:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272965120:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827939.283472:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787827939.475415:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787827940.307469:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787827940.499411:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827941.331524:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787827941.523456:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827942.355597:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787827942.547528:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827943.379559:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787827943.571489:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787827943.571628:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827943.571659:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787827943.571693:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827943.571703:0:8:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3107
00000100:00080000:3.0:1787827943.571716:0:8:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827943.571725:0:8:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787827943.571769:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057061c0 x1874670272965248/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827943.571804:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827943.571809:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787827943.571811:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827943.571816:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3107
00000100:00080000:3.0:1787827943.571820:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827943.571824:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827943.571835:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787827943.571850:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707480 x1874670272965376/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787827943.571866:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272965248:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787827943.571869:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827943.571881:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787827943.571883:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827943.571889:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3107
00000100:00080000:3.0:1787827943.571892:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827943.571896:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827943.571902:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827943.571923:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057043c0 x1874670272965504/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827943.571942:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827943.571946:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787827943.571948:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827943.571952:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3107
00000100:00080000:3.0:1787827943.571957:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827943.571960:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827943.571966:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1787827943.571971:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827943.571986:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704b40 x1874670272965632/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827943.572000:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827943.572004:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787827943.572006:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827943.572011:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3107
00000100:00080000:3.0:1787827943.572016:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827943.572028:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827943.572034:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787827943.572044:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827943/real 1787827943]  req@ffff9ee0057061c0 x1874670272965248/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827968 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827943.572051:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706580 x1874670272965760/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827943.572102:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827943.572107:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787827943.572110:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827943.572115:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3107
00000100:00080000:3.0:1787827943.572120:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1787827943.572127:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057061c0 x1874670272965248/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827968 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827943.572129:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827943.572139:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827943.572158:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704780 x1874670272965888/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827943.572170:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827943.572174:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827943.572174:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787827943.572179:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827943.572189:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:3.0:1787827943.572191:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3107
00000100:00080000:3.0:1787827943.572201:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1787827943.572205:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272965248:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787827943.572212:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827943.572223:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827943.572236:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705a40 x1874670272966016/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787827943.572250:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272965376:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787827943.572299:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827943.572355:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827943/real 1787827943]  req@ffff9ee005707480 x1874670272965376/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827968 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827943.572409:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707480 x1874670272965376/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827968 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827943.572428:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827943.572435:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827943.572443:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272965376:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787827943.572465:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272965504:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827943.572526:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827943.572554:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827943/real 1787827943]  req@ffff9ee0057043c0 x1874670272965504/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827968 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827943.572596:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057043c0 x1874670272965504/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827968 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827943.572614:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827943.572620:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827943.572627:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272965504:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827943.572667:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272965632:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827943.572715:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827943.572742:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827943/real 1787827943]  req@ffff9ee005704b40 x1874670272965632/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827968 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827943.572758:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704b40 x1874670272965632/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827968 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827943.572769:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827943.572773:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827943.572777:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272965632:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827943.572786:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272965760:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787827943.572811:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827943.572823:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827943/real 1787827943]  req@ffff9ee005706580 x1874670272965760/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827968 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827943.572837:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706580 x1874670272965760/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827968 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827943.572847:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827943.572850:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827943.572853:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272965760:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787827943.572860:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272965888:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827943.572879:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827943.572890:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827943/real 1787827943]  req@ffff9ee005704780 x1874670272965888/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827968 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827943.572913:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704780 x1874670272965888/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827968 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827943.572923:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827943.572926:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827943.572929:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272965888:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827943.572954:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272966016:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827943.572974:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827943.572986:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827943/real 1787827943]  req@ffff9ee005705a40 x1874670272966016/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827968 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827943.572999:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705a40 x1874670272966016/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827968 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827943.573008:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827943.573012:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827943.573015:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272966016:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827944.403511:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787827944.595400:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787827945.427488:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787827945.619392:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827946.451443:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787827946.643410:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827947.475464:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787827947.667394:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827948.499796:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1787827948.691415:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827948.691427:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787827948.691434:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1787827948.691435:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787827948.691448:0:8:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3112
00000100:00080000:3.0:1787827948.691463:0:8:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827948.691473:0:8:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787827948.691532:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705e00 x1874670272966144/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827948.691562:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827948.691565:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787827948.691567:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827948.691571:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3112
00000100:00080000:3.0:1787827948.691574:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827948.691578:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827948.691590:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787827948.691618:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707840 x1874670272966272/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787827948.691629:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272966144:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787827948.691635:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827948.691640:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787827948.691642:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827948.691647:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3112
00000100:00080000:3.0:1787827948.691651:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827948.691654:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827948.691660:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827948.691675:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705a40 x1874670272966400/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827948.691684:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827948.691688:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787827948.691689:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827948.691692:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3112
00000100:00080000:3.0:1787827948.691697:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827948.691701:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827948.691706:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827948.691716:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704780 x1874670272966528/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827948.691725:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:1.0:1787827948.691731:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787827948.691733:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787827948.691738:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827948.691743:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3112
00000100:00080000:3.0:1787827948.691747:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827948.691751:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827948.691756:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787827948.691767:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706580 x1874670272966656/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827948.691775:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827948.691779:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787827948.691781:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827948.691785:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3112
00000100:00100000:1.0:1787827948.691791:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827948/real 1787827948]  req@ffff9ee005705e00 x1874670272966144/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827973 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827948.691792:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827948.691802:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827948.691811:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787827948.691832:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705e00 x1874670272966144/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827973 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827948.691832:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704b40 x1874670272966784/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827948.691876:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827948.691880:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827948.691880:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787827948.691883:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827948.691888:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:3.0:1787827948.691890:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3112
00000100:00080000:3.0:1787827948.691896:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1787827948.691897:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272966144:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787827948.691903:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827948.691910:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827948.691919:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057043c0 x1874670272966912/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787827948.691935:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272966272:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787827948.691969:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827948.691982:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827948/real 1787827948]  req@ffff9ee005707840 x1874670272966272/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827973 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827948.691994:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707840 x1874670272966272/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827973 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827948.692002:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827948.692006:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827948.692009:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272966272:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787827948.692015:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272966400:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827948.692032:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827948.692041:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827948/real 1787827948]  req@ffff9ee005705a40 x1874670272966400/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827973 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827948.692051:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705a40 x1874670272966400/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827973 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827948.692065:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827948.692068:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827948.692071:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272966400:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827948.692076:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272966528:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827948.692089:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827948.692097:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827948/real 1787827948]  req@ffff9ee005704780 x1874670272966528/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827973 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827948.692106:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704780 x1874670272966528/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827973 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827948.692115:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827948.692119:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827948.692124:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272966528:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827948.692133:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272966656:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787827948.692160:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827948.692177:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827948/real 1787827948]  req@ffff9ee005706580 x1874670272966656/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827973 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827948.692195:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706580 x1874670272966656/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827973 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827948.692203:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827948.692207:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827948.692211:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272966656:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787827948.692216:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272966784:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827948.692237:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827948.692247:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827948/real 1787827948]  req@ffff9ee005704b40 x1874670272966784/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827973 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827948.692258:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704b40 x1874670272966784/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827973 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827948.692265:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827948.692268:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827948.692271:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272966784:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827948.692275:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272966912:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827948.692288:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827948.692296:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827948/real 1787827948]  req@ffff9ee0057043c0 x1874670272966912/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827973 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827948.692306:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057043c0 x1874670272966912/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827973 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827948.692313:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827948.692339:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827948.692342:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272966912:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827949.523477:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787827949.715465:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787827950.547508:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787827950.739378:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827951.571498:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787827951.763465:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827952.595564:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787827952.787399:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787827953.619714:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1787827953.811443:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827953.811453:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787827953.811457:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827953.811470:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3117
00000100:00080000:2.0:1787827953.811481:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827953.811489:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787827953.811511:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00100000:2.0:1787827953.811526:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572ad00 x1874670272967040/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827953.811555:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827953.811560:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00100000:1.0:1787827953.811643:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272967040:192.168.203.121@tcp:250:kworker.0
00000800:00000100:1.0:1787827953.811711:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:2.0:1787827953.811724:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827953.811731:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3117
00000100:00080000:2.0:1787827953.811736:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827953.811740:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827953.811749:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787827953.811757:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827953/real 1787827953]  req@ffff9ee00572ad00 x1874670272967040/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827978 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827953.811765:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729a40 x1874670272967168/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827953.811791:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1787827953.811795:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572ad00 x1874670272967040/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827978 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827953.811796:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787827953.811800:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827953.811810:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3117
00000100:00080000:2.0:1787827953.811815:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827953.811816:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827953.811824:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00080000:1.0:1787827953.811828:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000008:00100000:2.0:1787827953.811830:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787827953.811833:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272967040:192.168.203.121@tcp:250:kworker.0
00000100:00100000:2.0:1787827953.811843:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b0c0 x1874670272967296/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827953.811852:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827953.811854:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787827953.811856:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827953.811858:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3117
00000100:00080000:2.0:1787827953.811861:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827953.811864:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827953.811866:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787827953.811874:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572ad00 x1874670272967424/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787827953.811879:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272967168:192.168.203.121@tcp:38:kworker.0
00000100:00080000:2.0:1787827953.811897:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827953.811901:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787827953.811903:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827953.811909:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3117
00000800:00000100:1.0:1787827953.811914:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:2.0:1787827953.811917:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827953.811925:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787827953.811929:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827953/real 1787827953]  req@ffff9ee005729a40 x1874670272967168/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827978 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:2.0:1787827953.811935:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787827953.811944:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729a40 x1874670272967168/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827978 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827953.811953:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b480 x1874670272967552/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827953.811954:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827953.811963:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827953.811972:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272967168:192.168.203.121@tcp:38:kworker.0
00000100:00080000:2.0:1787827953.811974:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827953.811979:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787827953.811980:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1787827953.811981:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272967296:192.168.203.121@tcp:8:kworker.0
00000100:00080000:2.0:1787827953.811986:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3117
00000100:00080000:2.0:1787827953.811991:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827953.811995:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827953.812000:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1787827953.812006:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787827953.812012:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728b40 x1874670272967680/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787827953.812018:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827953/real 1787827953]  req@ffff9ee00572b0c0 x1874670272967296/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827978 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827953.812024:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827953.812050:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787827953.812054:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1787827953.812061:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b0c0 x1874670272967296/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827978 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827953.812061:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3117
00000100:00080000:2.0:1787827953.812064:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827953.812072:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827953.812082:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:1.0:1787827953.812086:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827953.812092:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787827953.812096:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a580 x1874670272967808/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787827953.812098:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272967296:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827953.812124:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272967424:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827953.812158:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827953.812174:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827953/real 1787827953]  req@ffff9ee00572ad00 x1874670272967424/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827978 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827953.812189:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572ad00 x1874670272967424/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827978 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827953.812210:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827953.812212:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827953.812215:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272967424:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827953.812221:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272967552:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787827953.812239:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827953.812249:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827953/real 1787827953]  req@ffff9ee00572b480 x1874670272967552/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827978 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827953.812258:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b480 x1874670272967552/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827978 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827953.812264:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827953.812266:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827953.812269:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272967552:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787827953.812274:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272967680:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827953.812285:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827953.812292:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827953/real 1787827953]  req@ffff9ee005728b40 x1874670272967680/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827978 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827953.812300:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728b40 x1874670272967680/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827978 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827953.812360:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827953.812364:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827953.812368:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272967680:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827953.812374:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272967808:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827953.812421:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827953.812435:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827953/real 1787827953]  req@ffff9ee00572a580 x1874670272967808/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827978 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827953.812445:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a580 x1874670272967808/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827978 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827953.812452:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827953.812454:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827953.812457:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272967808:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827954.643543:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787827954.835405:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787827955.667655:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787827955.859508:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827956.691520:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787827956.883414:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827957.715618:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787827957.907478:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787827958.739521:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1787827958.931476:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827958.931488:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787827958.931494:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827958.931509:0:8:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3122
00000100:00100000:0.0:1787827958.931512:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:2.0:1787827958.931524:0:8:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827958.931559:0:8:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787827958.931616:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728000 x1874670272967936/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827958.931668:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827958.931673:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787827958.931675:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827958.931679:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3122
00000100:00080000:2.0:1787827958.931683:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827958.931687:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827958.931699:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787827958.931714:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057283c0 x1874670272968064/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827958.931728:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827958.931733:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787827958.931738:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827958.931744:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3122
00000100:00080000:2.0:1787827958.931750:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827958.931757:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827958.931770:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787827958.931789:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b840 x1874670272968192/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827958.931804:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827958.931808:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787827958.931810:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827958.931814:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3122
00000100:00080000:2.0:1787827958.931818:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827958.931830:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827958.931836:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787827958.931848:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728f00 x1874670272968320/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787827958.931862:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272967936:192.168.203.121@tcp:250:kworker.0
00000100:00080000:2.0:1787827958.931866:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827958.931881:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787827958.931891:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827958.931896:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3122
00000100:00080000:2.0:1787827958.931899:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827958.931902:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827958.931905:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787827958.931916:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a1c0 x1874670272968448/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827958.931925:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827958.931928:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787827958.931930:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827958.931934:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3122
00000100:00080000:2.0:1787827958.931937:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827958.931940:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827958.931945:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787827958.931952:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729e00 x1874670272968576/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827958.931959:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827958.931963:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787827958.931965:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827958.931970:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3122
00000100:00080000:2.0:1787827958.931973:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827958.931976:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827958.931979:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787827958.931988:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a940 x1874670272968704/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1787827958.932012:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827958.932099:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827958/real 1787827958]  req@ffff9ee005728000 x1874670272967936/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827983 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827958.932123:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728000 x1874670272967936/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827983 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827958.932139:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827958.932145:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827958.932150:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272967936:192.168.203.121@tcp:250:kworker.0
00000100:00100000:1.0:1787827958.932160:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272968064:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787827958.932208:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827958.932226:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827958/real 1787827958]  req@ffff9ee0057283c0 x1874670272968064/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827983 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827958.932242:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057283c0 x1874670272968064/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827983 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827958.932253:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827958.932257:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827958.932261:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272968064:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787827958.932269:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272968192:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827958.932291:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827958.932302:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827958/real 1787827958]  req@ffff9ee00572b840 x1874670272968192/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827983 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827958.932317:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b840 x1874670272968192/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827983 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827958.932380:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827958.932384:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827958.932389:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272968192:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827958.932430:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272968320:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827958.932457:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827958.932471:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827958/real 1787827958]  req@ffff9ee005728f00 x1874670272968320/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827983 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827958.932486:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728f00 x1874670272968320/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827983 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827958.932496:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827958.932500:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827958.932504:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272968320:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827958.932510:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272968448:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787827958.932571:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827958.932592:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827958/real 1787827958]  req@ffff9ee00572a1c0 x1874670272968448/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827983 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827958.932605:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a1c0 x1874670272968448/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827983 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827958.932613:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827958.932634:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827958.932639:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272968448:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787827958.932647:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272968576:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827958.932674:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827958.932686:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827958/real 1787827958]  req@ffff9ee005729e00 x1874670272968576/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827983 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827958.932700:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729e00 x1874670272968576/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827983 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827958.932710:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827958.932713:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827958.932717:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272968576:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827958.932724:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272968704:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827958.932742:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827958.932753:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827958/real 1787827958]  req@ffff9ee00572a940 x1874670272968704/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827983 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827958.932767:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a940 x1874670272968704/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827983 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827958.932776:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827958.932780:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827958.932783:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272968704:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827959.763605:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787827959.955464:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787827960.787461:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787827960.979399:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827961.811602:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787827962.003477:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827962.835628:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787827963.027464:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787827963.859460:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787827964.051554:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:2.0:1787827964.051613:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827964.051637:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787827964.051644:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827964.051661:0:8:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3127
00000100:00080000:2.0:1787827964.051679:0:8:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827964.051691:0:8:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787827964.051764:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728780 x1874670272968832/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827964.051794:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827964.051799:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787827964.051802:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827964.051811:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3127
00000100:00080000:2.0:1787827964.051815:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1787827964.051818:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272968832:192.168.203.121@tcp:250:kworker.0
00000100:00080000:2.0:1787827964.051825:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827964.051839:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787827964.051858:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729680 x1874670272968960/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827964.051871:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827964.051875:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787827964.051878:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827964.051884:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3127
00000100:00080000:2.0:1787827964.051890:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000800:00000100:1.0:1787827964.051899:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:2.0:1787827964.051901:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787827964.051938:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827964/real 1787827964]  req@ffff9ee005728780 x1874670272968832/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827989 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:2.0:1787827964.051963:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787827964.051992:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057292c0 x1874670272969088/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827964.052010:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1787827964.052025:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728780 x1874670272968832/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827989 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787827964.052043:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787827964.052049:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787827964.052061:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3127
00000100:00080000:1.0:1787827964.052064:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827964.052069:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827964.052078:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:2.0:1787827964.052084:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827964.052096:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787827964.052101:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272968832:192.168.203.121@tcp:250:kworker.0
00000100:00100000:2.0:1787827964.052116:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572bc00 x1874670272969216/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827964.052130:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827964.052134:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787827964.052137:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1787827964.052139:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272968960:192.168.203.121@tcp:38:kworker.0
00000100:00080000:2.0:1787827964.052148:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3127
00000100:00080000:2.0:1787827964.052165:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827964.052171:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827964.052178:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787827964.052201:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728780 x1874670272969344/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787827964.052218:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787827964.052223:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787827964.052225:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:1.0:1787827964.052245:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:2.0:1787827964.052245:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3127
00000100:00080000:2.0:1787827964.052277:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827964.052284:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827964.052291:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787827964.052302:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827964/real 1787827964]  req@ffff9ee005729680 x1874670272968960/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827989 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827964.052310:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a940 x1874670272969472/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787827964.052417:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729680 x1874670272968960/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827989 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827964.052436:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787827964.052436:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827964.052451:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00080000:2.0:1787827964.052454:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:1.0:1787827964.052462:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272968960:192.168.203.121@tcp:38:kworker.0
00000100:00080000:2.0:1787827964.052465:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1787827964.052475:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057292c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272969088:192.168.203.121@tcp:8:kworker.0
00000100:00080000:2.0:1787827964.052486:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3127
00000800:00000100:1.0:1787827964.052531:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:2.0:1787827964.052531:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787827964.052547:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787827964.052556:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787827964.052565:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827964/real 1787827964]  req@ffff9ee0057292c0 x1874670272969088/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827989 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787827964.052578:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729e00 x1874670272969600/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787827964.052618:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057292c0 x1874670272969088/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827989 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827964.052647:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827964.052656:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827964.052663:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057292c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272969088:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827964.052673:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272969216:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827964.052705:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827964.052721:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827964/real 1787827964]  req@ffff9ee00572bc00 x1874670272969216/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827989 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827964.052752:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572bc00 x1874670272969216/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827989 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827964.052783:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827964.052786:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827964.052788:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272969216:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827964.052803:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272969344:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787827964.052817:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827964.052825:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827964/real 1787827964]  req@ffff9ee005728780 x1874670272969344/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827989 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827964.052848:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728780 x1874670272969344/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827989 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827964.052854:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827964.052856:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827964.052859:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272969344:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787827964.052864:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272969472:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827964.052876:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827964.052882:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827964/real 1787827964]  req@ffff9ee00572a940 x1874670272969472/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827989 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827964.052890:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a940 x1874670272969472/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827989 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827964.052913:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827964.052917:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827964.052921:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272969472:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827964.052928:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272969600:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827964.052955:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827964.052975:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827964/real 1787827964]  req@ffff9ee005729e00 x1874670272969600/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827989 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827964.052999:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729e00 x1874670272969600/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827989 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827964.053021:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827964.053028:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827964.053035:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272969600:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827964.883592:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787827965.075484:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787827965.907627:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787827966.099459:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827966.931564:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787827967.123511:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827967.955663:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787827968.147490:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787827968.979611:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787827969.171490:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787827969.171535:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827969.171545:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787827969.171552:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827969.171566:0:8:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3132
00000100:00080000:3.0:1787827969.171584:0:8:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827969.171595:0:8:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787827969.171666:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707480 x1874670272969728/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827969.171727:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827969.171732:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787827969.171735:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827969.171740:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3132
00000100:00080000:3.0:1787827969.171746:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827969.171753:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827969.171769:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787827969.171787:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272969728:192.168.203.121@tcp:250:kworker.0
00000100:00100000:3.0:1787827969.171791:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057061c0 x1874670272969856/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827969.171811:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827969.171815:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787827969.171817:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827969.171821:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3132
00000100:00080000:3.0:1787827969.171825:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827969.171830:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827969.171835:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827969.171849:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057070c0 x1874670272969984/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827969.171859:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827969.171863:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787827969.171865:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827969.171871:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3132
00000100:00080000:3.0:1787827969.171877:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827969.171881:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827969.171885:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827969.171897:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057052c0 x1874670272970112/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827969.171907:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827969.171911:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787827969.171913:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:1.0:1787827969.171923:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787827969.171925:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3132
00000100:00080000:3.0:1787827969.171934:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827969.171940:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827969.171945:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787827969.171959:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707c00 x1874670272970240/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827969.171970:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827969.171974:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787827969.171976:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827969.171981:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3132
00000100:00080000:3.0:1787827969.171985:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827969.171990:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827969.171996:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787827969.172013:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827969/real 1787827969]  req@ffff9ee005707480 x1874670272969728/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827994 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827969.172014:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704000 x1874670272970368/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827969.172073:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827969.172078:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787827969.172082:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1787827969.172084:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707480 x1874670272969728/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827994 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827969.172091:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3132
00000100:00080000:3.0:1787827969.172100:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827969.172111:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00080000:1.0:1787827969.172116:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000008:00100000:3.0:1787827969.172117:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:1.0:1787827969.172131:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827969.172138:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706d00 x1874670272970496/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787827969.172143:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272969728:192.168.203.121@tcp:250:kworker.0
00000100:00100000:1.0:1787827969.172191:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272969856:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787827969.172226:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827969.172242:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827969/real 1787827969]  req@ffff9ee0057061c0 x1874670272969856/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827994 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827969.172257:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057061c0 x1874670272969856/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827994 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827969.172267:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827969.172271:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827969.172274:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272969856:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787827969.172280:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272969984:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827969.172299:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827969.172309:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827969/real 1787827969]  req@ffff9ee0057070c0 x1874670272969984/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827994 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827969.172355:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057070c0 x1874670272969984/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827994 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827969.172372:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827969.172376:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827969.172380:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272969984:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827969.172386:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272970112:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827969.172407:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827969.172418:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827969/real 1787827969]  req@ffff9ee0057052c0 x1874670272970112/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827994 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827969.172430:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057052c0 x1874670272970112/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827994 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827969.172439:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827969.172443:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827969.172446:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272970112:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827969.172452:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272970240:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787827969.172501:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827969.172515:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827969/real 1787827969]  req@ffff9ee005707c00 x1874670272970240/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827994 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827969.172527:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707c00 x1874670272970240/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827994 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827969.172535:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827969.172539:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827969.172543:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272970240:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787827969.172550:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272970368:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827969.172569:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827969.172579:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827969/real 1787827969]  req@ffff9ee005704000 x1874670272970368/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827994 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827969.172591:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704000 x1874670272970368/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827994 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827969.172600:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827969.172602:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827969.172606:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272970368:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827969.172611:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272970496:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827969.172627:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827969.172636:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827969/real 1787827969]  req@ffff9ee005706d00 x1874670272970496/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827994 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827969.172647:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706d00 x1874670272970496/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827994 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827969.172655:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827969.172658:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827969.172662:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272970496:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827970.003626:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787827970.195487:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787827971.027638:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787827971.219528:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827972.051643:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787827972.243407:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827973.075590:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787827973.267508:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787827974.099552:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787827974.291458:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787827974.291458:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827974.291474:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787827974.291481:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827974.291495:0:8:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3138
00000100:00080000:3.0:1787827974.291510:0:8:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827974.291520:0:8:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787827974.291573:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705680 x1874670272970624/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827974.291611:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827974.291616:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787827974.291618:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827974.291623:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3138
00000100:00080000:3.0:1787827974.291629:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827974.291634:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827974.291649:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787827974.291655:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272970624:192.168.203.121@tcp:250:kworker.0
00000100:00100000:3.0:1787827974.291667:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706940 x1874670272970752/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827974.291682:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827974.291686:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787827974.291689:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827974.291694:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3138
00000100:00080000:3.0:1787827974.291697:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827974.291702:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827974.291707:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827974.291719:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706d00 x1874670272970880/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827974.291731:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827974.291739:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000800:00000100:1.0:1787827974.291741:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787827974.291745:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827974.291757:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3138
00000100:00080000:3.0:1787827974.291767:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827974.291775:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827974.291784:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787827974.291806:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827974/real 1787827974]  req@ffff9ee005705680 x1874670272970624/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827999 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827974.291813:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704000 x1874670272971008/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787827974.291838:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705680 x1874670272970624/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787827999 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827974.291900:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827974.291905:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827974.291911:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:3.0:1787827974.291913:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787827974.291918:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1787827974.291919:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272970624:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787827974.291932:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3138
00000100:00100000:1.0:1787827974.291952:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272970752:192.168.203.121@tcp:38:kworker.0
00000100:00080000:3.0:1787827974.291953:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827974.291974:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827974.291988:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000800:00000100:1.0:1787827974.291989:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827974.292003:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827974/real 1787827974]  req@ffff9ee005706940 x1874670272970752/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827999 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827974.292016:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706940 x1874670272970752/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827999 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827974.292022:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707c00 x1874670272971136/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827974.292042:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827974.292057:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827974.292072:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272970752:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787827974.292099:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272970880:192.168.203.121@tcp:8:kworker.0
00000100:00080000:3.0:1787827974.292104:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827974.292115:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787827974.292119:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827974.292133:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3138
00000800:00000100:1.0:1787827974.292135:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787827974.292147:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827974.292156:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787827974.292164:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827974/real 1787827974]  req@ffff9ee005706d00 x1874670272970880/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827999 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:3.0:1787827974.292166:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827974.292188:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057052c0 x1874670272971264/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787827974.292203:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706d00 x1874670272970880/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827999 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827974.292208:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827974.292213:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787827974.292218:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827974.292232:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827974.292261:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3138
00000100:00080000:1.0:1787827974.292263:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00080000:3.0:1787827974.292267:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1787827974.292274:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272970880:192.168.203.121@tcp:8:kworker.0
00000100:00080000:3.0:1787827974.292275:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827974.292291:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787827974.292299:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272971008:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787827974.292308:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057070c0 x1874670272971392/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1787827974.292361:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827974.292375:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827974/real 1787827974]  req@ffff9ee005704000 x1874670272971008/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827999 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827974.292391:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704000 x1874670272971008/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827999 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827974.292396:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827974.292399:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827974.292401:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272971008:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827974.292416:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272971136:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787827974.292447:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827974.292455:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827974/real 1787827974]  req@ffff9ee005707c00 x1874670272971136/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827999 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827974.292463:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707c00 x1874670272971136/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787827999 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827974.292469:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827974.292471:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827974.292473:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272971136:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787827974.292477:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272971264:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827974.292489:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827974.292495:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827974/real 1787827974]  req@ffff9ee0057052c0 x1874670272971264/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827999 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827974.292502:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057052c0 x1874670272971264/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827999 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827974.292507:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827974.292509:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827974.292511:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272971264:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827974.292515:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272971392:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827974.292524:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827974.292530:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827974/real 1787827974]  req@ffff9ee0057070c0 x1874670272971392/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827999 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827974.292537:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057070c0 x1874670272971392/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787827999 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827974.292542:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827974.292543:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827974.292546:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272971392:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827975.123577:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787827975.315491:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787827976.147616:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787827976.339490:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827977.171546:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787827977.363509:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827978.195562:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787827978.387538:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787827979.219601:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1787827979.411484:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1787827979.411493:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787827979.411502:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787827979.411511:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827979.411525:0:8:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3143
00000100:00080000:3.0:1787827979.411542:0:8:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827979.411554:0:8:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787827979.411615:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057061c0 x1874670272971520/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827979.411652:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827979.411657:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787827979.411659:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827979.411664:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3143
00000100:00080000:3.0:1787827979.411668:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827979.411674:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827979.411688:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787827979.411708:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272971520:192.168.203.121@tcp:250:kworker.0
00000100:00100000:3.0:1787827979.411709:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707480 x1874670272971648/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827979.411740:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827979.411744:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787827979.411747:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827979.411752:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3143
00000100:00080000:3.0:1787827979.411756:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827979.411760:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827979.411766:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827979.411784:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057043c0 x1874670272971776/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827979.411794:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827979.411799:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787827979.411801:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827979.411806:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3143
00000100:00080000:3.0:1787827979.411809:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827979.411813:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827979.411817:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1787827979.411831:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827979.411833:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704b40 x1874670272971904/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827979.411851:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827979.411858:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787827979.411862:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827979.411870:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3143
00000100:00080000:3.0:1787827979.411877:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827979.411885:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827979.411894:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787827979.411921:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827979/real 1787827979]  req@ffff9ee0057061c0 x1874670272971520/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828004 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827979.411922:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706580 x1874670272972032/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827979.411984:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1787827979.411985:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057061c0 x1874670272971520/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828004 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827979.411991:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787827979.412003:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827979.412015:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3143
00000100:00080000:3.0:1787827979.412021:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827979.412026:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827979.412032:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:1.0:1787827979.412053:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:3.0:1787827979.412054:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704780 x1874670272972160/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827979.412073:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:3.0:1787827979.412076:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827979.412084:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:1.0:1787827979.412085:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272971520:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787827979.412088:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827979.412098:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3143
00000100:00080000:3.0:1787827979.412103:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827979.412108:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827979.412114:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827979.412133:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705a40 x1874670272972288/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787827979.412135:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272971648:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787827979.412185:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827979.412205:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827979/real 1787827979]  req@ffff9ee005707480 x1874670272971648/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828004 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827979.412221:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707480 x1874670272971648/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828004 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827979.412231:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827979.412235:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827979.412240:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272971648:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787827979.412247:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272971776:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827979.412268:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827979.412279:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827979/real 1787827979]  req@ffff9ee0057043c0 x1874670272971776/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828004 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827979.412291:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057043c0 x1874670272971776/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828004 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827979.412300:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827979.412303:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827979.412306:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272971776:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827979.412312:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272971904:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827979.412365:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827979.412383:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827979/real 1787827979]  req@ffff9ee005704b40 x1874670272971904/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828004 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827979.412442:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704b40 x1874670272971904/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828004 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827979.412452:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827979.412455:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827979.412459:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272971904:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827979.412466:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272972032:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787827979.412493:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827979.412506:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827979/real 1787827979]  req@ffff9ee005706580 x1874670272972032/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828004 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827979.412519:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706580 x1874670272972032/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828004 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827979.412527:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827979.412530:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827979.412533:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272972032:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787827979.412540:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272972160:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827979.412558:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827979.412568:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827979/real 1787827979]  req@ffff9ee005704780 x1874670272972160/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828004 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827979.412580:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704780 x1874670272972160/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828004 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827979.412588:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827979.412591:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827979.412594:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272972160:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827979.412617:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272972288:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827979.412634:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827979.412644:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827979/real 1787827979]  req@ffff9ee005705a40 x1874670272972288/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828004 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827979.412655:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705a40 x1874670272972288/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828004 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827979.412664:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827979.412668:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827979.412671:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272972288:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827980.243608:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787827980.435537:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787827981.267696:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787827981.459410:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827982.291599:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787827982.483441:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827983.315682:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787827983.507463:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787827984.339563:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787827984.531441:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787827984.531456:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827984.531472:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787827984.531480:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827984.531498:0:8:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3148
00000100:00080000:3.0:1787827984.531515:0:8:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827984.531529:0:8:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787827984.531582:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707840 x1874670272972416/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827984.531632:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827984.531636:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787827984.531639:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827984.531644:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3148
00000100:00080000:3.0:1787827984.531651:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827984.531660:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827984.531676:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787827984.531702:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272972416:192.168.203.121@tcp:250:kworker.0
00000100:00100000:3.0:1787827984.531706:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705e00 x1874670272972544/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827984.531737:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827984.531744:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787827984.531749:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827984.531755:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3148
00000100:00080000:3.0:1787827984.531763:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827984.531769:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827984.531777:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827984.531796:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705a40 x1874670272972672/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827984.531810:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827984.531814:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787827984.531817:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827984.531822:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3148
00000100:00080000:3.0:1787827984.531826:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827984.531830:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827984.531836:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827984.531848:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704780 x1874670272972800/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827984.531877:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827984.531882:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787827984.531885:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827984.531891:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3148
00000100:00080000:3.0:1787827984.531897:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1787827984.531905:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272972544:192.168.203.121@tcp:38:kworker.0
00000100:00080000:3.0:1787827984.531907:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827984.531921:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787827984.531941:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706580 x1874670272972928/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827984.531964:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827984.531970:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787827984.531974:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787827984.531983:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3148
00000100:00080000:3.0:1787827984.531991:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1787827984.531998:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272972672:192.168.203.121@tcp:8:kworker.0
00000100:00080000:3.0:1787827984.532002:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827984.532020:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827984.532039:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704b40 x1874670272973056/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787827984.532051:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787827984.532055:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787827984.532058:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1787827984.532067:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272972800:192.168.203.121@tcp:8:kworker.0
00000100:00080000:3.0:1787827984.532068:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3148
00000100:00080000:3.0:1787827984.532082:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787827984.532092:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787827984.532105:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787827984.532131:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057043c0 x1874670272973184/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787827984.532145:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272972928:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787827984.532196:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272973056:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827984.532221:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272973184:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827985.363586:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787827985.555461:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787827986.387532:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787827986.579466:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827987.411599:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787827987.603383:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000400:00000100:2.0:1787827987.603520:0:2352:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.203.121:988
00000400:00000100:2.0:1787827987.603552:0:2352:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.203.121@tcp at host 192.168.203.121 was unreachable: the network or that node may be down, or Lustre may be misconfigured.
00000800:00000100:2.0:1787827987.603567:0:2352:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:2.0:1787827987.603598:0:2352:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:2.0:1787827987.603604:0:2352:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:2.0:1787827987.603610:0:2352:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:2.0:1787827987.603615:0:2352:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:2.0:1787827987.603620:0:2352:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:2.0:1787827987.603632:0:2352:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000100:00100000:1.0:1787827987.603677:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827984/real 1787827987]  req@ffff9ee0057043c0 x1874670272973184/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828009 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827987.603704:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057043c0 x1874670272973184/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828009 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827987.603717:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827987.603723:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827987.603745:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272973184:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827987.603766:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827984/real 1787827987]  req@ffff9ee005706580 x1874670272972928/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828009 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827987.603806:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706580 x1874670272972928/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828009 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827987.603815:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827987.603819:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827987.603823:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272972928:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787827987.603830:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827984/real 1787827987]  req@ffff9ee005704b40 x1874670272973056/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828009 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827987.603842:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704b40 x1874670272973056/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828009 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827987.603849:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827987.603853:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827987.603856:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272973056:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827987.603862:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827984/real 1787827987]  req@ffff9ee005705e00 x1874670272972544/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828009 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827987.603873:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705e00 x1874670272972544/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828009 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827987.603880:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827987.603884:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827987.603887:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272972544:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787827987.603893:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827984/real 1787827987]  req@ffff9ee005705a40 x1874670272972672/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828009 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827987.603906:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705a40 x1874670272972672/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828009 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827987.603914:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827987.603917:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827987.603920:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272972672:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827987.603926:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827984/real 1787827987]  req@ffff9ee005704780 x1874670272972800/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828009 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827987.603937:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704780 x1874670272972800/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828009 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827987.603945:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827987.603948:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827987.603951:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272972800:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827987.603958:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827984/real 1787827987]  req@ffff9ee005707840 x1874670272972416/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828009 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827987.603970:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707840 x1874670272972416/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828009 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827987.603978:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827987.603982:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827987.603986:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272972416:192.168.203.121@tcp:250:kworker.0
00010000:00010000:3.0:1787827988.435621:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787827988.627534:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787827989.459607:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1787827989.651519:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827989.651536:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1787827989.651544:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1787827989.651545:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:0.0:1787827989.651566:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3153
00000100:00080000:0.0:1787827989.651586:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827989.651598:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787827989.651658:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9e00 x1874670272973312/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827989.651695:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827989.651700:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787827989.651703:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827989.651708:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3153
00000100:00080000:0.0:1787827989.651713:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827989.651718:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827989.651734:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787827989.651750:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8b40 x1874670272973440/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827989.651766:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827989.651775:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00100000:1.0:1787827989.651775:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272973312:192.168.203.121@tcp:250:kworker.0
00000100:00080000:0.0:1787827989.651781:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827989.651801:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3153
00000100:00080000:0.0:1787827989.651807:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827989.651817:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827989.651828:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787827989.651853:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e92c0 x1874670272973568/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827989.651875:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827989.651882:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787827989.651886:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827989.651894:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3153
00000100:00080000:0.0:1787827989.651903:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827989.651911:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827989.651919:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1787827989.651925:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787827989.651943:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb840 x1874670272973696/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827989.651959:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827989.651964:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787827989.651967:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827989.651973:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3153
00000100:00080000:0.0:1787827989.651978:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827989.651983:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827989.651990:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787827989.652008:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb480 x1874670272973824/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787827989.652024:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827989/real 1787827989]  req@ffff9ee0056e9e00 x1874670272973312/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828014 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827989.652025:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827989.652042:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787827989.652048:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827989.652066:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3153
00000100:00080000:0.0:1787827989.652078:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1787827989.652089:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9e00 x1874670272973312/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828014 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827989.652092:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827989.652111:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:1.0:1787827989.652129:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827989.652144:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787827989.652160:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8000 x1874670272973952/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787827989.652162:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272973312:192.168.203.121@tcp:250:kworker.0
00000100:00080000:0.0:1787827989.652194:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827989.652202:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787827989.652206:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827989.652215:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3153
00000100:00080000:0.0:1787827989.652223:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1787827989.652227:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272973440:192.168.203.121@tcp:38:kworker.0
00000100:00080000:0.0:1787827989.652238:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827989.652254:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787827989.652281:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e83c0 x1874670272974080/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1787827989.652300:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827989.652459:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827989/real 1787827989]  req@ffff9ee0056e8b40 x1874670272973440/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828014 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827989.652492:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8b40 x1874670272973440/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828014 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827989.652510:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827989.652518:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827989.652525:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272973440:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787827989.652538:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272973568:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827989.652586:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827989.652611:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827989/real 1787827989]  req@ffff9ee0056e92c0 x1874670272973568/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828014 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827989.652651:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e92c0 x1874670272973568/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828014 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827989.652668:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827989.652675:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827989.652681:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272973568:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827989.652694:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272973696:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827989.652739:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827989.652762:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827989/real 1787827989]  req@ffff9ee0056eb840 x1874670272973696/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828014 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827989.652786:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb840 x1874670272973696/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828014 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827989.652802:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827989.652809:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827989.652816:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272973696:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827989.652829:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272973824:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787827989.652870:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827989.652895:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827989/real 1787827989]  req@ffff9ee0056eb480 x1874670272973824/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828014 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827989.652920:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb480 x1874670272973824/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828014 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827989.652965:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827989.652980:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827989.652987:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272973824:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787827989.653000:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272973952:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827989.653044:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827989.653069:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827989/real 1787827989]  req@ffff9ee0056e8000 x1874670272973952/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828014 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827989.653093:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8000 x1874670272973952/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828014 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827989.653111:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827989.653117:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827989.653125:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272973952:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827989.653167:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272974080:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827989.653212:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827989.653237:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827989/real 1787827989]  req@ffff9ee0056e83c0 x1874670272974080/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828014 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827989.653278:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e83c0 x1874670272974080/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828014 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827989.653295:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827989.653303:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827989.653372:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272974080:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827990.483568:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787827990.675564:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787827991.507485:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787827991.699424:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827992.531551:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787827992.723512:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827993.555508:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787827993.747451:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787827994.579669:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787827994.771456:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:1.0:1787827994.771495:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827994.771504:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1787827994.771511:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827994.771524:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3158
00000100:00080000:1.0:1787827994.771540:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827994.771551:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787827994.771629:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a30c0 x1874670272974208/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827994.771673:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827994.771678:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787827994.771681:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827994.771688:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3158
00000100:00080000:1.0:1787827994.771696:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827994.771704:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827994.771723:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787827994.771752:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0000 x1874670272974336/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827994.771777:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827994.771785:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787827994.771789:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827994.771800:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3158
00000100:00100000:3.0:1787827994.771803:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272974208:192.168.203.121@tcp:250:kworker.0
00000100:00080000:1.0:1787827994.771807:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827994.771821:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827994.771831:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787827994.771850:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0780 x1874670272974464/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827994.771864:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827994.771869:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787827994.771872:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827994.771877:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3158
00000100:00080000:1.0:1787827994.771883:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827994.771887:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827994.771893:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787827994.771924:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a3480 x1874670272974592/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827994.771935:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827994.771940:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787827994.771942:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827994.771946:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3158
00000100:00080000:1.0:1787827994.771950:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827994.771954:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787827994.771961:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000800:00000100:3.0:1787827994.771963:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827994.771987:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a2580 x1874670272974720/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827994.772005:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787827994.772012:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787827994.772015:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827994.772022:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3158
00000100:00080000:1.0:1787827994.772029:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827994.772037:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787827994.772046:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827994/real 1787827994]  req@ffff9ee0056a30c0 x1874670272974208/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828019 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:1.0:1787827994.772049:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787827994.772096:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0b40 x1874670272974848/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787827994.772112:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1787827994.772116:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a30c0 x1874670272974208/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828019 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827994.772118:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787827994.772125:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787827994.772140:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3158
00000100:00080000:1.0:1787827994.772151:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787827994.772162:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00080000:3.0:1787827994.772170:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000008:00100000:1.0:1787827994.772171:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:3.0:1787827994.772191:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827994.772194:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1e00 x1874670272974976/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787827994.772206:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272974208:192.168.203.121@tcp:250:kworker.0
00000100:00100000:3.0:1787827994.772229:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272974336:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787827994.772273:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827994.772360:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827994/real 1787827994]  req@ffff9ee0056a0000 x1874670272974336/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828019 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827994.772379:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0000 x1874670272974336/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828019 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827994.772391:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827994.772396:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827994.772400:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272974336:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787827994.772440:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272974464:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827994.772486:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827994.772499:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827994/real 1787827994]  req@ffff9ee0056a0780 x1874670272974464/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828019 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827994.772519:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0780 x1874670272974464/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828019 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827994.772528:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827994.772530:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827994.772533:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272974464:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787827994.772539:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272974592:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827994.772578:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827994.772589:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827994/real 1787827994]  req@ffff9ee0056a3480 x1874670272974592/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828019 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827994.772604:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a3480 x1874670272974592/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828019 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827994.772613:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827994.772617:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827994.772621:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272974592:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787827994.772627:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272974720:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787827994.772647:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827994.772658:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827994/real 1787827994]  req@ffff9ee0056a2580 x1874670272974720/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828019 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827994.772672:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a2580 x1874670272974720/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828019 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827994.772691:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827994.772694:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827994.772698:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272974720:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787827994.772704:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272974848:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827994.772723:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827994.772734:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827994/real 1787827994]  req@ffff9ee0056a0b40 x1874670272974848/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828019 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827994.772746:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0b40 x1874670272974848/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828019 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827994.772756:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827994.772760:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827994.772764:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272974848:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787827994.772770:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272974976:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787827994.772788:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787827994.772798:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827994/real 1787827994]  req@ffff9ee0056a1e00 x1874670272974976/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828019 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787827994.772811:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1e00 x1874670272974976/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828019 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787827994.772821:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787827994.772826:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787827994.772833:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272974976:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787827995.603598:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787827995.795466:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787827996.627596:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787827996.819447:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827997.651656:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787827997.843446:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787827998.675629:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787827998.867534:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787827999.699493:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787827999.891423:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:0.0:1787827999.891482:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827999.891487:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1787827999.891491:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827999.891499:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3163
00000100:00080000:0.0:1787827999.891509:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827999.891515:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787827999.891546:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8f00 x1874670272975104/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827999.891570:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827999.891575:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787827999.891578:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827999.891582:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3163
00000100:00080000:0.0:1787827999.891587:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827999.891593:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827999.891603:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787827999.891613:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272975104:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787827999.891622:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ebc00 x1874670272975232/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827999.891633:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827999.891636:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787827999.891644:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827999.891648:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3163
00000100:00080000:0.0:1787827999.891653:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827999.891657:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827999.891662:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787827999.891673:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e83c0 x1874670272975360/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827999.891680:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827999.891682:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787827999.891684:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:1.0:1787827999.891689:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:0.0:1787827999.891692:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3163
00000100:00080000:0.0:1787827999.891713:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827999.891718:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827999.891722:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787827999.891731:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8000 x1874670272975488/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827999.891740:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827999.891742:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787827999.891746:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1787827999.891747:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827999/real 1787827999]  req@ffff9ee0056e8f00 x1874670272975104/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828024 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827999.891751:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3163
00000100:00080000:0.0:1787827999.891757:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827999.891760:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787827999.891763:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787827999.891795:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb480 x1874670272975616/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787827999.891799:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8f00 x1874670272975104/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828024 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787827999.891833:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827999.891840:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787827999.891844:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827999.891849:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3163
00000100:00080000:1.0:1787827999.891851:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787827999.891852:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827999.891860:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00080000:1.0:1787827999.891861:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000008:00100000:0.0:1787827999.891863:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787827999.891869:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272975104:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787827999.891875:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb840 x1874670272975744/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787827999.891882:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787827999.891884:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787827999.891886:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787827999.891889:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3163
00000100:00080000:0.0:1787827999.891891:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787827999.891894:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787827999.891897:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272975232:192.168.203.121@tcp:38:kworker.0
00000008:00100000:0.0:1787827999.891899:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787827999.891911:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e92c0 x1874670272975872/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1787827999.891924:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827999.891940:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827999/real 1787827999]  req@ffff9ee0056ebc00 x1874670272975232/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828024 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827999.891952:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ebc00 x1874670272975232/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828024 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827999.891959:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827999.891962:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827999.891966:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272975232:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787827999.891972:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272975360:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827999.891988:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827999.891997:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827999/real 1787827999]  req@ffff9ee0056e83c0 x1874670272975360/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828024 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827999.892005:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e83c0 x1874670272975360/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828024 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827999.892010:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827999.892012:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827999.892014:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272975360:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827999.892018:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272975488:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827999.892028:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827999.892034:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827999/real 1787827999]  req@ffff9ee0056e8000 x1874670272975488/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828024 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827999.892041:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8000 x1874670272975488/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828024 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827999.892046:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827999.892048:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827999.892049:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272975488:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827999.892053:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272975616:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787827999.892062:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827999.892067:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827999/real 1787827999]  req@ffff9ee0056eb480 x1874670272975616/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828024 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827999.892074:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb480 x1874670272975616/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828024 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827999.892079:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827999.892081:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827999.892083:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272975616:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787827999.892086:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272975744:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827999.892104:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827999.892110:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827999/real 1787827999]  req@ffff9ee0056eb840 x1874670272975744/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828024 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827999.892118:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb840 x1874670272975744/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828024 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827999.892123:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827999.892125:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827999.892127:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272975744:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787827999.892138:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272975872:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787827999.892148:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787827999.892154:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787827999/real 1787827999]  req@ffff9ee0056e92c0 x1874670272975872/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828024 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787827999.892161:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e92c0 x1874670272975872/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828024 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787827999.892166:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787827999.892168:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787827999.892169:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272975872:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828000.723603:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787828000.915509:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828001.747490:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787828001.939473:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828002.771531:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787828002.963440:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828003.795541:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787828003.987490:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828004.819545:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828005.011459:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:0.0:1787828005.011472:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828005.011482:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1787828005.011488:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828005.011503:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3168
00000100:00080000:0.0:1787828005.011519:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828005.011529:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787828005.011580:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8b40 x1874670272976000/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828005.011615:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828005.011622:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787828005.011627:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828005.011636:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3168
00000100:00080000:0.0:1787828005.011645:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828005.011655:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828005.011672:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787828005.011679:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272976000:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787828005.011705:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9e00 x1874670272976128/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828005.011732:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828005.011737:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787828005.011740:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828005.011745:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3168
00000100:00080000:0.0:1787828005.011752:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828005.011758:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828005.011765:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1787828005.011768:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787828005.011791:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8780 x1874670272976256/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828005.011806:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828005.011810:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787828005.011812:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828005.011818:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3168
00000100:00080000:0.0:1787828005.011823:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828005.011833:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787828005.011834:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828005/real 1787828005]  req@ffff9ee0056e8b40 x1874670272976000/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828030 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:0.0:1787828005.011839:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828005.011861:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9680 x1874670272976384/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828005.011873:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8b40 x1874670272976000/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828030 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828005.011881:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828005.011895:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787828005.011901:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787828005.011913:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787828005.011914:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3168
00000100:00080000:0.0:1787828005.011925:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828005.011932:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:0.0:1787828005.011939:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828005.011946:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787828005.011949:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272976000:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787828005.011963:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9a40 x1874670272976512/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828005.011977:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828005.011982:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787828005.011984:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828005.011991:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3168
00000100:00080000:0.0:1787828005.011996:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828005.012005:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787828005.012006:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272976128:192.168.203.121@tcp:38:kworker.0
00000008:00100000:0.0:1787828005.012026:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828005.012047:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ead00 x1874670272976640/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828005.012062:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828005.012067:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787828005.012073:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:1.0:1787828005.012075:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:0.0:1787828005.012082:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3168
00000100:00080000:0.0:1787828005.012091:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828005.012097:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828005.012105:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787828005.012111:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828005/real 1787828005]  req@ffff9ee0056e9e00 x1874670272976128/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828030 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787828005.012126:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ea580 x1874670272976768/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828005.012144:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9e00 x1874670272976128/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828030 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828005.012159:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828005.012165:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828005.012171:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272976128:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828005.012184:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272976256:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828005.012244:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828005.012264:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828005/real 1787828005]  req@ffff9ee0056e8780 x1874670272976256/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828030 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828005.012279:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8780 x1874670272976256/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828030 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828005.012290:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828005.012294:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828005.012298:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272976256:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828005.012306:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272976384:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828005.012375:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828005.012404:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828005/real 1787828005]  req@ffff9ee0056e9680 x1874670272976384/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828030 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828005.012419:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9680 x1874670272976384/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828030 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828005.012429:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828005.012433:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828005.012437:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272976384:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828005.012445:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272976512:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787828005.012466:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828005.012477:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828005/real 1787828005]  req@ffff9ee0056e9a40 x1874670272976512/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828030 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828005.012491:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9a40 x1874670272976512/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828030 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828005.012501:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828005.012504:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828005.012508:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272976512:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828005.012531:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272976640:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828005.012550:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828005.012561:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828005/real 1787828005]  req@ffff9ee0056ead00 x1874670272976640/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828030 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828005.012576:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ead00 x1874670272976640/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828030 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828005.012586:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828005.012589:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828005.012593:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272976640:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828005.012600:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272976768:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828005.012618:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828005.012628:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828005/real 1787828005]  req@ffff9ee0056ea580 x1874670272976768/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828030 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828005.012642:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ea580 x1874670272976768/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828030 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828005.012652:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828005.012655:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828005.012659:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272976768:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828005.843580:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828006.035460:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828006.867555:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828007.059411:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828007.891522:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828008.083437:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828008.915549:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828009.107415:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828009.939456:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828010.131406:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:2.0:1787828010.131427:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828010.131433:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787828010.131437:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828010.131445:0:8:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3173
00000100:00080000:2.0:1787828010.131455:0:8:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828010.131461:0:8:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787828010.131497:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a1c0 x1874670272976896/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828010.131527:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828010.131531:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787828010.131533:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828010.131537:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3173
00000100:00080000:2.0:1787828010.131542:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828010.131546:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828010.131556:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787828010.131568:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728f00 x1874670272977024/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828010.131581:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828010.131584:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787828010.131586:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828010.131590:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3173
00000100:00080000:2.0:1787828010.131594:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1787828010.131597:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272976896:192.168.203.121@tcp:250:kworker.0
00000100:00080000:2.0:1787828010.131602:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828010.131609:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828010.131623:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b840 x1874670272977152/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828010.131635:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828010.131650:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000800:00000100:1.0:1787828010.131655:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:2.0:1787828010.131656:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828010.131663:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3173
00000100:00080000:2.0:1787828010.131668:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828010.131672:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828010.131677:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828010.131690:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057283c0 x1874670272977280/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828010.131702:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1787828010.131707:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828010/real 1787828010]  req@ffff9ee00572a1c0 x1874670272976896/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828035 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828010.131707:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787828010.131709:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828010.131720:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3173
00000100:00080000:2.0:1787828010.131726:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1787828010.131731:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a1c0 x1874670272976896/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828035 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828010.131733:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828010.131742:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00080000:1.0:1787828010.131745:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828010.131751:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828010.131755:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272976896:192.168.203.121@tcp:250:kworker.0
00000100:00100000:2.0:1787828010.131760:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728000 x1874670272977408/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828010.131764:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272977024:192.168.203.121@tcp:38:kworker.0
00000100:00080000:2.0:1787828010.131778:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828010.131782:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787828010.131785:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:1.0:1787828010.131789:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:2.0:1787828010.131793:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3173
00000100:00080000:2.0:1787828010.131799:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828010.131805:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787828010.131809:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828010/real 1787828010]  req@ffff9ee005728f00 x1874670272977024/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828035 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:2.0:1787828010.131810:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787828010.131832:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728f00 x1874670272977024/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828035 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828010.131832:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a580 x1874670272977536/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787828010.131866:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828010.131867:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828010.131874:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787828010.131875:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00080000:2.0:1787828010.131877:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1787828010.131884:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272977024:192.168.203.121@tcp:38:kworker.0
00000100:00080000:2.0:1787828010.131885:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3173
00000100:00080000:2.0:1787828010.131892:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828010.131898:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828010.131903:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828010.131913:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728b40 x1874670272977664/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828010.131918:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272977152:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828010.131945:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828010.131957:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828010/real 1787828010]  req@ffff9ee00572b840 x1874670272977152/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828035 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828010.131965:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b840 x1874670272977152/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828035 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828010.131984:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828010.131986:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828010.131989:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272977152:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828010.131993:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272977280:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828010.132004:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828010.132010:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828010/real 1787828010]  req@ffff9ee0057283c0 x1874670272977280/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828035 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828010.132017:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057283c0 x1874670272977280/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828035 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828010.132022:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828010.132024:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828010.132026:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272977280:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828010.132029:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272977408:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787828010.132038:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828010.132044:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828010/real 1787828010]  req@ffff9ee005728000 x1874670272977408/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828035 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828010.132050:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728000 x1874670272977408/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828035 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828010.132055:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828010.132057:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828010.132060:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272977408:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828010.132063:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272977536:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828010.132073:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828010.132078:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828010/real 1787828010]  req@ffff9ee00572a580 x1874670272977536/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828035 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828010.132084:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a580 x1874670272977536/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828035 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828010.132089:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828010.132091:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828010.132093:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272977536:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828010.132103:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272977664:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828010.132112:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828010.132118:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828010/real 1787828010]  req@ffff9ee005728b40 x1874670272977664/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828035 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828010.132124:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728b40 x1874670272977664/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828035 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828010.132129:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828010.132131:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828010.132133:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272977664:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828010.963539:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787828011.155512:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828011.987572:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787828012.179438:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828013.011540:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787828013.203428:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828014.035554:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787828014.227458:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828015.059574:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1787828015.251431:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828015.251445:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787828015.251451:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1787828015.251462:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:2.0:1787828015.251465:0:8:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3178
00000100:00080000:2.0:1787828015.251506:0:8:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828015.251517:0:8:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787828015.251568:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b480 x1874670272977792/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828015.251639:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828015.251646:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787828015.251650:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828015.251656:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3178
00000100:00080000:2.0:1787828015.251664:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828015.251671:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828015.251695:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787828015.251708:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272977792:192.168.203.121@tcp:250:kworker.0
00000100:00100000:2.0:1787828015.251719:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572ad00 x1874670272977920/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828015.251736:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828015.251740:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787828015.251743:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828015.251747:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3178
00000100:00080000:2.0:1787828015.251754:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828015.251759:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828015.251766:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828015.251779:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b0c0 x1874670272978048/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828015.251792:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:1.0:1787828015.251799:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:2.0:1787828015.251801:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787828015.251808:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828015.251814:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3178
00000100:00080000:2.0:1787828015.251819:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828015.251823:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828015.251829:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828015.251843:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729a40 x1874670272978176/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828015.251854:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828015.251868:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787828015.251870:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1787828015.251873:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828015/real 1787828015]  req@ffff9ee00572b480 x1874670272977792/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828040 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828015.251878:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3178
00000100:00080000:2.0:1787828015.251887:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828015.251898:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828015.251925:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787828015.251937:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b480 x1874670272977792/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828040 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828015.251945:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728b40 x1874670272978304/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787828015.251975:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828015.251991:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828015.251997:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:2.0:1787828015.251999:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787828015.252005:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1787828015.252012:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272977792:192.168.203.121@tcp:250:kworker.0
00000100:00080000:2.0:1787828015.252016:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3178
00000100:00080000:2.0:1787828015.252028:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828015.252034:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828015.252039:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828015.252050:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a580 x1874670272978432/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828015.252060:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272977920:192.168.203.121@tcp:38:kworker.0
00000100:00080000:2.0:1787828015.252069:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828015.252075:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787828015.252077:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828015.252084:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3178
00000100:00080000:2.0:1787828015.252090:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828015.252095:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828015.252100:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1787828015.252109:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828015.252118:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728000 x1874670272978560/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828015.252134:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828015/real 1787828015]  req@ffff9ee00572ad00 x1874670272977920/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828040 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828015.252202:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572ad00 x1874670272977920/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828040 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828015.252216:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828015.252222:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828015.252227:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272977920:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828015.252236:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272978048:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828015.252267:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828015.252281:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828015/real 1787828015]  req@ffff9ee00572b0c0 x1874670272978048/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828040 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828015.252296:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b0c0 x1874670272978048/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828040 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828015.252315:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828015.252319:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828015.252324:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272978048:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828015.252371:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272978176:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828015.252408:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828015.252423:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828015/real 1787828015]  req@ffff9ee005729a40 x1874670272978176/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828040 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828015.252437:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729a40 x1874670272978176/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828040 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828015.252447:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828015.252452:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828015.252456:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272978176:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828015.252463:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272978304:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787828015.252482:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828015.252493:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828015/real 1787828015]  req@ffff9ee005728b40 x1874670272978304/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828040 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828015.252506:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728b40 x1874670272978304/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828040 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828015.252516:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828015.252520:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828015.252525:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272978304:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828015.252565:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272978432:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828015.252605:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828015.252618:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828015/real 1787828015]  req@ffff9ee00572a580 x1874670272978432/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828040 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828015.252630:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a580 x1874670272978432/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828040 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828015.252639:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828015.252642:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828015.252645:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272978432:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828015.252651:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272978560:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828015.252667:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828015.252676:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828015/real 1787828015]  req@ffff9ee005728000 x1874670272978560/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828040 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828015.252688:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728000 x1874670272978560/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828040 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828015.252696:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828015.252699:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828015.252702:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272978560:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828016.083480:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787828016.275401:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828017.107494:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787828017.299377:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828018.131499:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787828018.323380:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828019.155546:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787828019.347403:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828020.179542:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1787828020.371458:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1787828020.371468:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:2.0:1787828020.371484:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787828020.371496:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828020.371517:0:8:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3184
00000100:00080000:2.0:1787828020.371537:0:8:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828020.371552:0:8:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787828020.371623:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057283c0 x1874670272978688/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828020.371665:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828020.371681:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787828020.371684:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828020.371689:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3184
00000100:00080000:2.0:1787828020.371695:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828020.371701:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828020.371716:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787828020.371736:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b840 x1874670272978816/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828020.371761:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1787828020.371762:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272978688:192.168.203.121@tcp:250:kworker.0
00000100:00080000:2.0:1787828020.371782:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787828020.371788:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828020.371796:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3184
00000100:00080000:2.0:1787828020.371805:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828020.371815:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828020.371828:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828020.371866:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728f00 x1874670272978944/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828020.371892:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828020.371896:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787828020.371899:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828020.371905:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3184
00000800:00000100:1.0:1787828020.371914:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:2.0:1787828020.371917:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828020.371927:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828020.371936:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828020.371955:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a1c0 x1874670272979072/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828020.371967:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828020.371972:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787828020.371975:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828020.371981:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3184
00000100:00080000:2.0:1787828020.371987:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1787828020.371989:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828020/real 1787828020]  req@ffff9ee0057283c0 x1874670272978688/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828045 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828020.371997:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828020.372009:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787828020.372039:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729e00 x1874670272979200/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828020.372041:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057283c0 x1874670272978688/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828045 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828020.372132:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828020.372134:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828020.372146:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787828020.372153:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787828020.372161:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:2.0:1787828020.372162:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3184
00000100:00080000:2.0:1787828020.372176:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1787828020.372180:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272978688:192.168.203.121@tcp:250:kworker.0
00000100:00080000:2.0:1787828020.372189:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828020.372201:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828020.372223:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a940 x1874670272979328/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828020.372232:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272978816:192.168.203.121@tcp:38:kworker.0
00000100:00080000:2.0:1787828020.372252:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828020.372259:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787828020.372262:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828020.372268:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3184
00000100:00080000:2.0:1787828020.372276:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828020.372281:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828020.372288:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1787828020.372292:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828020.372364:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728780 x1874670272979456/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828020.372414:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828020/real 1787828020]  req@ffff9ee00572b840 x1874670272978816/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828045 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828020.372440:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b840 x1874670272978816/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828045 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828020.372465:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828020.372470:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828020.372475:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272978816:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828020.372484:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272978944:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828020.372520:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828020.372537:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828020/real 1787828020]  req@ffff9ee005728f00 x1874670272978944/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828045 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828020.372585:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728f00 x1874670272978944/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828045 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828020.372618:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828020.372626:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828020.372633:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272978944:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828020.372647:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272979072:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828020.372684:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828020.372710:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828020/real 1787828020]  req@ffff9ee00572a1c0 x1874670272979072/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828045 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828020.372737:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a1c0 x1874670272979072/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828045 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828020.372755:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828020.372763:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828020.372768:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272979072:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828020.372777:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272979200:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787828020.372809:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828020.372825:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828020/real 1787828020]  req@ffff9ee005729e00 x1874670272979200/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828045 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828020.372840:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729e00 x1874670272979200/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828045 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828020.372851:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828020.372855:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828020.372859:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272979200:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828020.372898:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272979328:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828020.372919:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828020.372931:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828020/real 1787828020]  req@ffff9ee00572a940 x1874670272979328/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828045 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828020.372946:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a940 x1874670272979328/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828045 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828020.372955:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828020.372959:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828020.372963:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272979328:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828020.372969:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272979456:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828020.372988:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828020.372999:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828020/real 1787828020]  req@ffff9ee005728780 x1874670272979456/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828045 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828020.373013:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728780 x1874670272979456/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828045 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828020.373023:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828020.373026:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828020.373030:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272979456:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828021.203561:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787828021.395447:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828022.227617:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787828022.419393:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828023.251607:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787828023.443424:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828024.275505:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787828024.467469:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828025.299537:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1787828025.491516:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1787828025.491517:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:2.0:1787828025.491533:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787828025.491541:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828025.491574:0:8:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3189
00000100:00080000:2.0:1787828025.491598:0:8:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828025.491610:0:8:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787828025.491663:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572bc00 x1874670272979584/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828025.491700:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828025.491703:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787828025.491705:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828025.491709:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3189
00000100:00080000:2.0:1787828025.491712:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828025.491714:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828025.491725:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787828025.491734:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057292c0 x1874670272979712/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828025.491741:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828025.491745:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787828025.491746:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828025.491749:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3189
00000100:00080000:2.0:1787828025.491752:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828025.491773:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828025.491780:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828025.491793:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729680 x1874670272979840/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828025.491804:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828025.491814:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787828025.491817:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828025.491841:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3189
00000100:00080000:2.0:1787828025.491848:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828025.491858:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787828025.491859:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272979584:192.168.203.121@tcp:250:kworker.0
00000008:00100000:2.0:1787828025.491864:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828025.491906:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728780 x1874670272979968/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828025.491918:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828025.491922:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787828025.491924:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828025.491928:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3189
00000100:00080000:2.0:1787828025.491931:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828025.491935:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828025.491943:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787828025.491954:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a940 x1874670272980096/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828025.491976:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828025.491981:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787828025.491983:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828025.491987:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3189
00000100:00080000:2.0:1787828025.491991:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828025.491994:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828025.491998:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828025.492009:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729e00 x1874670272980224/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1787828025.492035:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:2.0:1787828025.492055:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828025.492061:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787828025.492063:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828025.492108:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3189
00000100:00080000:2.0:1787828025.492113:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828025.492117:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828025.492124:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828025.492139:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a1c0 x1874670272980352/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828025.492158:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828025/real 1787828025]  req@ffff9ee00572bc00 x1874670272979584/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828050 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828025.492186:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572bc00 x1874670272979584/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828050 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828025.492201:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828025.492207:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828025.492213:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272979584:192.168.203.121@tcp:250:kworker.0
00000100:00100000:1.0:1787828025.492223:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057292c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272979712:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787828025.492257:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828025.492279:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828025/real 1787828025]  req@ffff9ee0057292c0 x1874670272979712/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828050 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828025.492382:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057292c0 x1874670272979712/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828050 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828025.492398:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828025.492403:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828025.492408:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057292c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272979712:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828025.492429:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272979840:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828025.492464:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828025.492491:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828025/real 1787828025]  req@ffff9ee005729680 x1874670272979840/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828050 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828025.492507:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729680 x1874670272979840/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828050 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828025.492526:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828025.492531:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828025.492535:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272979840:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828025.492583:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272979968:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828025.492615:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828025.492637:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828025/real 1787828025]  req@ffff9ee005728780 x1874670272979968/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828050 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828025.492662:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728780 x1874670272979968/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828050 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828025.492680:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828025.492687:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828025.492694:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272979968:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828025.492707:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272980096:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787828025.492737:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828025.492752:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828025/real 1787828025]  req@ffff9ee00572a940 x1874670272980096/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828050 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828025.492767:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a940 x1874670272980096/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828050 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828025.492788:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828025.492792:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828025.492796:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272980096:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828025.492804:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272980224:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828025.492832:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828025.492853:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828025/real 1787828025]  req@ffff9ee005729e00 x1874670272980224/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828050 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828025.492877:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729e00 x1874670272980224/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828050 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828025.492894:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828025.492912:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828025.492919:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272980224:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828025.492930:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272980352:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828025.492960:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828025.492981:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828025/real 1787828025]  req@ffff9ee00572a1c0 x1874670272980352/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828050 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828025.492996:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a1c0 x1874670272980352/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828050 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828025.493006:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828025.493010:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828025.493014:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272980352:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828026.323564:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787828026.515373:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828027.347620:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787828027.539463:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828028.371639:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787828028.563457:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828029.395596:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787828029.587443:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828030.419564:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1787828030.611581:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828030.611598:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1787828030.611605:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1787828030.611609:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:0.0:1787828030.611624:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3194
00000100:00080000:0.0:1787828030.611644:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828030.611659:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787828030.611721:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb0c0 x1874670272980480/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828030.611770:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828030.611777:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787828030.611781:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828030.611789:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3194
00000100:00080000:0.0:1787828030.611798:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828030.611809:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828030.611827:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787828030.611841:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272980480:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787828030.611859:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ea940 x1874670272980608/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828030.611885:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828030.611889:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787828030.611892:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828030.611897:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3194
00000100:00080000:0.0:1787828030.611903:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828030.611908:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828030.611917:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828030.611933:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ea580 x1874670272980736/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828030.611946:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828030.611950:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787828030.611952:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828030.611955:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3194
00000100:00080000:0.0:1787828030.611960:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000800:00000100:1.0:1787828030.611969:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:0.0:1787828030.611970:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828030.611981:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828030.611998:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ead00 x1874670272980864/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828030.612010:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828030.612015:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787828030.612017:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828030.612024:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3194
00000100:00080000:0.0:1787828030.612029:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1787828030.612066:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828030/real 1787828030]  req@ffff9ee0056eb0c0 x1874670272980480/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828055 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828030.612067:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828030.612085:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787828030.612107:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9a40 x1874670272980992/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828030.612121:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828030.612129:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00100000:1.0:1787828030.612130:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb0c0 x1874670272980480/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828055 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828030.612132:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828030.612146:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3194
00000100:00080000:0.0:1787828030.612168:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828030.612172:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787828030.612175:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00080000:1.0:1787828030.612185:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000008:00100000:0.0:1787828030.612186:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787828030.612197:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272980480:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787828030.612207:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9680 x1874670272981120/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828030.612220:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828030.612224:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787828030.612227:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828030.612232:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3194
00000100:00100000:1.0:1787828030.612237:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272980608:192.168.203.121@tcp:38:kworker.0
00000100:00080000:0.0:1787828030.612240:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828030.612251:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828030.612259:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828030.612276:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8780 x1874670272981248/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1787828030.612294:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828030.612382:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828030/real 1787828030]  req@ffff9ee0056ea940 x1874670272980608/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828055 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828030.612401:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ea940 x1874670272980608/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828055 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828030.612413:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828030.612417:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828030.612422:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272980608:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828030.612430:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272980736:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828030.612460:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828030.612475:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828030/real 1787828030]  req@ffff9ee0056ea580 x1874670272980736/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828055 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828030.612499:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ea580 x1874670272980736/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828055 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828030.612508:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828030.612512:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828030.612516:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272980736:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828030.612523:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272980864:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828030.612552:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828030.612563:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828030/real 1787828030]  req@ffff9ee0056ead00 x1874670272980864/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828055 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828030.612577:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ead00 x1874670272980864/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828055 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828030.612587:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828030.612590:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828030.612594:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272980864:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828030.612600:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272980992:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787828030.612619:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828030.612629:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828030/real 1787828030]  req@ffff9ee0056e9a40 x1874670272980992/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828055 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828030.612642:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9a40 x1874670272980992/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828055 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828030.612659:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828030.612663:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828030.612667:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272980992:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828030.612673:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272981120:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828030.612691:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828030.612702:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828030/real 1787828030]  req@ffff9ee0056e9680 x1874670272981120/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828055 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828030.612715:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9680 x1874670272981120/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828055 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828030.612724:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828030.612728:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828030.612732:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272981120:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828030.612756:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272981248:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828030.612789:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828030.612813:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828030/real 1787828030]  req@ffff9ee0056e8780 x1874670272981248/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828055 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828030.612837:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8780 x1874670272981248/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828055 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828030.612855:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828030.612867:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828030.612875:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272981248:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828031.443588:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787828031.635541:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828032.467569:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787828032.659428:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828033.491515:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787828033.683395:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828034.515538:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787828034.707447:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828035.539539:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1787828035.731435:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828035.731448:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1787828035.731454:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828035.731468:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3199
00000100:00080000:0.0:1787828035.731483:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828035.731496:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787828035.731499:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00100000:0.0:1787828035.731546:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9e00 x1874670272981376/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828035.731582:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828035.731587:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787828035.731590:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828035.731596:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3199
00000100:00080000:0.0:1787828035.731601:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828035.731619:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828035.731632:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787828035.731655:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8b40 x1874670272981504/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828035.731657:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272981376:192.168.203.121@tcp:250:kworker.0
00000100:00080000:0.0:1787828035.731685:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828035.731691:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787828035.731696:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828035.731703:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3199
00000100:00080000:0.0:1787828035.731708:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828035.731717:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828035.731727:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828035.731765:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e92c0 x1874670272981632/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1787828035.731777:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:0.0:1787828035.731801:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828035.731809:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787828035.731814:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828035.731825:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3199
00000100:00080000:0.0:1787828035.731835:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1787828035.731844:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828035/real 1787828035]  req@ffff9ee0056e9e00 x1874670272981376/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828060 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828035.731848:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828035.731866:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787828035.731885:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9e00 x1874670272981376/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828060 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787828035.731893:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb840 x1874670272981760/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787828035.731931:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787828035.731934:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828035.731943:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787828035.731945:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:0.0:1787828035.731948:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1787828035.731958:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272981376:192.168.203.121@tcp:250:kworker.0
00000100:00080000:0.0:1787828035.731963:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3199
00000100:00080000:0.0:1787828035.731976:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828035.731983:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828035.731992:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787828035.732039:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb480 x1874670272981888/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828035.732041:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272981504:192.168.203.121@tcp:38:kworker.0
00000100:00080000:0.0:1787828035.732070:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828035.732075:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787828035.732079:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828035.732085:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3199
00000100:00080000:0.0:1787828035.732094:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000800:00000100:1.0:1787828035.732095:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:0.0:1787828035.732107:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828035.732116:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787828035.732126:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828035/real 1787828035]  req@ffff9ee0056e8b40 x1874670272981504/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828060 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787828035.732137:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8000 x1874670272982016/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828035.732164:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1787828035.732165:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8b40 x1874670272981504/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828060 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828035.732181:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787828035.732188:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828035.732204:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3199
00000100:00080000:1.0:1787828035.732206:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787828035.732210:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828035.732220:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00080000:0.0:1787828035.732221:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828035.732235:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787828035.732237:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272981504:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828035.732253:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272981632:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787828035.732259:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e83c0 x1874670272982144/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1787828035.732377:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828035.732414:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828035/real 1787828035]  req@ffff9ee0056e92c0 x1874670272981632/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828060 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828035.732434:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e92c0 x1874670272981632/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828060 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828035.732446:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828035.732451:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828035.732456:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272981632:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828035.732463:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272981760:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828035.732484:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828035.732496:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828035/real 1787828035]  req@ffff9ee0056eb840 x1874670272981760/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828060 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828035.732509:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb840 x1874670272981760/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828060 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828035.732519:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828035.732522:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828035.732526:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272981760:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828035.732546:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272981888:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787828035.732566:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828035.732578:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828035/real 1787828035]  req@ffff9ee0056eb480 x1874670272981888/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828060 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828035.732601:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb480 x1874670272981888/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828060 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828035.732611:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828035.732615:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828035.732618:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272981888:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828035.732625:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272982016:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828035.732642:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828035.732653:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828035/real 1787828035]  req@ffff9ee0056e8000 x1874670272982016/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828060 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828035.732667:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8000 x1874670272982016/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828060 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828035.732676:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828035.732680:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828035.732683:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272982016:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828035.732690:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272982144:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828035.732707:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828035.732717:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828035/real 1787828035]  req@ffff9ee0056e83c0 x1874670272982144/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828060 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828035.732730:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e83c0 x1874670272982144/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828060 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828035.732746:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828035.732750:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828035.732754:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272982144:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828036.563556:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828036.755475:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828037.587614:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828037.779442:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828038.611532:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828038.803464:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828039.635672:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828039.827446:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828040.659610:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828040.851486:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:0.0:1787828040.851487:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828040.851506:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1787828040.851514:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828040.851531:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3204
00000100:00080000:0.0:1787828040.851549:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828040.851564:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787828040.851626:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ebc00 x1874670272982272/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828040.851667:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828040.851672:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787828040.851675:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828040.851680:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3204
00000100:00080000:0.0:1787828040.851684:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828040.851690:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828040.851706:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787828040.851725:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8f00 x1874670272982400/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828040.851739:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272982272:192.168.203.121@tcp:250:kworker.0
00000100:00080000:0.0:1787828040.851753:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828040.851759:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787828040.851762:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828040.851768:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3204
00000100:00080000:0.0:1787828040.851774:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828040.851780:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828040.851788:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828040.851810:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e83c0 x1874670272982528/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828040.851832:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828040.851838:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787828040.851840:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828040.851855:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3204
00000800:00000100:1.0:1787828040.851856:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:0.0:1787828040.851869:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828040.851877:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828040.851886:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828040.851905:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8000 x1874670272982656/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828040.851920:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828040.851925:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787828040.851928:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1787828040.851934:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828040/real 1787828040]  req@ffff9ee0056ebc00 x1874670272982272/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828065 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828040.851942:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3204
00000100:00080000:0.0:1787828040.851950:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828040.851955:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828040.851984:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787828040.852033:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb480 x1874670272982784/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828040.852036:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ebc00 x1874670272982272/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828065 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828040.852145:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787828040.852147:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828040.852167:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787828040.852171:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787828040.852174:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:0.0:1787828040.852190:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3204
00000100:00100000:1.0:1787828040.852193:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272982272:192.168.203.121@tcp:250:kworker.0
00000100:00080000:0.0:1787828040.852200:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828040.852217:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828040.852238:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787828040.852248:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272982400:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787828040.852264:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb840 x1874670272982912/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828040.852287:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828040.852295:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787828040.852297:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:1.0:1787828040.852307:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:0.0:1787828040.852349:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3204
00000100:00080000:0.0:1787828040.852357:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828040.852363:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828040.852375:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787828040.852399:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828040/real 1787828040]  req@ffff9ee0056e8f00 x1874670272982400/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828065 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787828040.852426:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e92c0 x1874670272983040/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828040.852428:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8f00 x1874670272982400/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828065 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828040.852534:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828040.852552:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828040.852564:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272982400:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828040.852583:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272982528:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828040.852629:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828040.852648:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828040/real 1787828040]  req@ffff9ee0056e83c0 x1874670272982528/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828065 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828040.852665:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e83c0 x1874670272982528/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828065 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828040.852676:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828040.852680:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828040.852684:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272982528:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828040.852692:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272982656:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828040.852714:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828040.852725:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828040/real 1787828040]  req@ffff9ee0056e8000 x1874670272982656/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828065 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828040.852738:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8000 x1874670272982656/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828065 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828040.852748:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828040.852751:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828040.852756:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272982656:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828040.852763:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272982784:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787828040.852782:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828040.852793:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828040/real 1787828040]  req@ffff9ee0056eb480 x1874670272982784/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828065 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828040.852806:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb480 x1874670272982784/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828065 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828040.852816:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828040.852820:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828040.852823:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272982784:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828040.852858:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272982912:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828040.852878:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828040.852889:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828040/real 1787828040]  req@ffff9ee0056eb840 x1874670272982912/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828065 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828040.852902:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb840 x1874670272982912/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828065 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828040.852912:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828040.852916:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828040.852920:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272982912:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828040.852927:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272983040:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828040.852944:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828040.852956:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828040/real 1787828040]  req@ffff9ee0056e92c0 x1874670272983040/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828065 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828040.852999:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e92c0 x1874670272983040/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828065 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828040.853010:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828040.853021:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828040.853025:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272983040:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828041.683590:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787828041.875554:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828042.707588:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787828042.899488:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828043.731541:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828043.923574:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828044.755486:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828044.947432:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828045.779620:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828045.971457:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:2.0:1787828045.971503:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828045.971521:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787828045.971529:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828045.971545:0:8:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3209
00000100:00080000:2.0:1787828045.971563:0:8:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828045.971574:0:8:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787828045.971641:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728f00 x1874670272983168/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828045.971700:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828045.971705:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787828045.971708:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828045.971713:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3209
00000100:00080000:2.0:1787828045.971718:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828045.971724:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828045.971739:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787828045.971756:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b840 x1874670272983296/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828045.971765:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272983168:192.168.203.121@tcp:250:kworker.0
00000100:00080000:2.0:1787828045.971802:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828045.971809:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787828045.971812:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828045.971821:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3209
00000100:00080000:2.0:1787828045.971825:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828045.971830:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828045.971838:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828045.971853:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057283c0 x1874670272983424/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828045.971865:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828045.971870:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787828045.971872:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828045.971877:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3209
00000100:00080000:2.0:1787828045.971883:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828045.971888:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828045.971895:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1787828045.971908:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828045.971920:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728000 x1874670272983552/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828045.971965:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828045.971971:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787828045.971975:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828045.971985:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3209
00000100:00080000:2.0:1787828045.971993:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828045.972003:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828045.972015:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787828045.972022:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828045/real 1787828045]  req@ffff9ee005728f00 x1874670272983168/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828070 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828045.972051:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a580 x1874670272983680/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828045.972055:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728f00 x1874670272983168/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828070 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828045.972172:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828045.972175:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828045.972184:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:2.0:1787828045.972187:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787828045.972193:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1787828045.972194:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272983168:192.168.203.121@tcp:250:kworker.0
00000100:00080000:2.0:1787828045.972216:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3209
00000100:00080000:2.0:1787828045.972224:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828045.972232:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828045.972241:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787828045.972252:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272983296:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787828045.972263:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728b40 x1874670272983808/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828045.972291:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828045.972296:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787828045.972298:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:1.0:1787828045.972313:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:2.0:1787828045.972390:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3209
00000100:00100000:1.0:1787828045.972402:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828045/real 1787828045]  req@ffff9ee00572b840 x1874670272983296/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828070 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828045.972403:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828045.972426:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828045.972451:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828045.972483:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729a40 x1874670272983936/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828045.972491:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b840 x1874670272983296/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828070 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828045.972562:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828045.972572:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828045.972578:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272983296:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828045.972592:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272983424:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828045.972625:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828045.972638:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828045/real 1787828045]  req@ffff9ee0057283c0 x1874670272983424/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828070 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828045.972653:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057283c0 x1874670272983424/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828070 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828045.972663:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828045.972667:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828045.972671:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272983424:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828045.972678:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272983552:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828045.972696:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828045.972707:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828045/real 1787828045]  req@ffff9ee005728000 x1874670272983552/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828070 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828045.972720:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728000 x1874670272983552/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828070 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828045.972738:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828045.972742:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828045.972745:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272983552:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828045.972752:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272983680:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787828045.972771:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828045.972781:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828045/real 1787828045]  req@ffff9ee00572a580 x1874670272983680/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828070 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828045.972794:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a580 x1874670272983680/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828070 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828045.972803:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828045.972807:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828045.972811:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272983680:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828045.972838:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272983808:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828045.972865:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828045.972885:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828045/real 1787828045]  req@ffff9ee005728b40 x1874670272983808/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828070 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828045.972909:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728b40 x1874670272983808/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828070 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828045.972948:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828045.972955:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828045.972964:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272983808:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828045.972978:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272983936:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828045.973009:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828045.973025:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828045/real 1787828045]  req@ffff9ee005729a40 x1874670272983936/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828070 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828045.973039:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729a40 x1874670272983936/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828070 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828045.973050:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828045.973053:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828045.973057:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272983936:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828046.803619:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828046.995513:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828047.827606:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828048.019440:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828048.851558:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828049.043467:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828049.875568:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828050.067430:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828050.899599:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828051.091455:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787828051.091476:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828051.091487:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787828051.091493:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828051.091506:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3214
00000100:00080000:3.0:1787828051.091520:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828051.091529:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787828051.091581:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707480 x1874670272984064/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828051.091631:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828051.091639:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787828051.091643:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828051.091652:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3214
00000100:00080000:3.0:1787828051.091659:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828051.091666:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828051.091679:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787828051.091682:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272984064:192.168.203.121@tcp:250:kworker.0
00000100:00100000:3.0:1787828051.091704:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057061c0 x1874670272984192/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828051.091723:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828051.091727:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787828051.091730:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828051.091735:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3214
00000100:00080000:3.0:1787828051.091740:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828051.091745:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828051.091751:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787828051.091765:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057070c0 x1874670272984320/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828051.091777:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828051.091781:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787828051.091784:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828051.091789:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3214
00000100:00080000:3.0:1787828051.091794:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828051.091798:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828051.091804:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787828051.091816:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057052c0 x1874670272984448/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828051.091827:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828051.091832:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787828051.091834:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828051.091839:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3214
00000100:00080000:3.0:1787828051.091843:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828051.091847:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828051.091854:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787828051.091867:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707c00 x1874670272984576/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828051.091876:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272984192:192.168.203.121@tcp:38:kworker.0
00000100:00080000:3.0:1787828051.091917:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828051.091926:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787828051.091929:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828051.091937:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3214
00000100:00080000:3.0:1787828051.091946:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828051.091953:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828051.091961:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787828051.091965:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272984320:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787828051.092001:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704000 x1874670272984704/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828051.092008:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272984448:192.168.203.121@tcp:8:kworker.0
00000100:00080000:3.0:1787828051.092059:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1787828051.092061:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272984576:192.168.203.121@tcp:38:kworker.0
00000100:00080000:3.0:1787828051.092080:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787828051.092087:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828051.092099:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3214
00000100:00080000:3.0:1787828051.092109:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1787828051.092111:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272984704:192.168.203.121@tcp:8:kworker.0
00000100:00080000:3.0:1787828051.092125:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828051.092139:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787828051.092162:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706d00 x1874670272984832/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828051.092219:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272984832:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828051.923588:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828052.115519:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828052.947586:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828053.139474:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828053.971668:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828054.163517:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000400:00000100:0.0:1787828054.163670:0:2355:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.203.121:988
00000400:00000100:0.0:1787828054.163735:0:2355:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.203.121@tcp at host 192.168.203.121 was unreachable: the network or that node may be down, or Lustre may be misconfigured.
00000800:00000100:0.0:1787828054.163757:0:2355:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:0.0:1787828054.163802:0:2355:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:0.0:1787828054.163814:0:2355:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:0.0:1787828054.163824:0:2355:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:0.0:1787828054.163833:0:2355:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:0.0:1787828054.163849:0:2355:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:0.0:1787828054.163887:0:2355:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000100:00100000:1.0:1787828054.163929:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828051/real 1787828054]  req@ffff9ee005704000 x1874670272984704/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828076 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828054.163981:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704000 x1874670272984704/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828076 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828054.164004:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828054.164014:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828054.164035:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272984704:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828054.164050:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828051/real 1787828054]  req@ffff9ee005707c00 x1874670272984576/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828076 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828054.164075:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707c00 x1874670272984576/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828076 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828054.164090:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828054.164096:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828054.164103:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272984576:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828054.164115:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828051/real 1787828054]  req@ffff9ee0057061c0 x1874670272984192/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828076 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828054.164138:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057061c0 x1874670272984192/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828076 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828054.164153:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828054.164159:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828054.164165:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272984192:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828054.164178:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828051/real 1787828054]  req@ffff9ee0057070c0 x1874670272984320/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828076 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828054.164197:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057070c0 x1874670272984320/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828076 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828054.164209:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828054.164224:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828054.164230:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272984320:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828054.164241:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828051/real 1787828054]  req@ffff9ee0057052c0 x1874670272984448/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828076 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828054.164260:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057052c0 x1874670272984448/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828076 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828054.164273:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828054.164279:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828054.164283:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272984448:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828054.164295:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828051/real 1787828054]  req@ffff9ee005707480 x1874670272984064/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828076 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828054.164315:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707480 x1874670272984064/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828076 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828054.164365:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828054.164372:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828054.164378:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272984064:192.168.203.121@tcp:250:kworker.0
00000100:00100000:1.0:1787828054.164438:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828051/real 1787828054]  req@ffff9ee005706d00 x1874670272984832/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828076 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828054.164460:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706d00 x1874670272984832/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828076 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828054.164493:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828054.164499:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828054.164504:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272984832:192.168.203.121@tcp:8:kworker.0
00010000:00010000:3.0:1787828054.995592:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828055.187543:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828056.019703:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1787828056.211434:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828056.211453:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787828056.211461:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828056.211475:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3219
00000100:00100000:1.0:1787828056.211491:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787828056.211495:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828056.211516:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787828056.211579:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706940 x1874670272984960/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828056.211619:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828056.211625:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787828056.211629:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828056.211636:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3219
00000100:00080000:3.0:1787828056.211646:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828056.211654:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828056.211672:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787828056.211683:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272984960:192.168.203.121@tcp:250:kworker.0
00000100:00100000:3.0:1787828056.211723:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705680 x1874670272985088/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828056.211746:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828056.211753:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787828056.211756:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828056.211764:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3219
00000100:00080000:3.0:1787828056.211770:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828056.211778:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000800:00000100:1.0:1787828056.211786:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000008:00100000:3.0:1787828056.211799:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787828056.211831:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706d00 x1874670272985216/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828056.211850:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828056.211883:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:1.0:1787828056.211890:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828056/real 1787828056]  req@ffff9ee005706940 x1874670272984960/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828081 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828056.211891:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828056.211908:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3219
00000100:00080000:3.0:1787828056.211926:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828056.211936:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787828056.211946:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706940 x1874670272984960/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828081 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:3.0:1787828056.211948:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:1.0:1787828056.211978:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:3.0:1787828056.211985:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707480 x1874670272985344/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787828056.211992:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828056.212001:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272984960:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787828056.212061:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828056.212067:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787828056.212071:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1787828056.212077:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272985088:192.168.203.121@tcp:38:kworker.0
00000100:00080000:3.0:1787828056.212087:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3219
00000100:00080000:3.0:1787828056.212101:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828056.212109:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828056.212119:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000800:00000100:1.0:1787828056.212139:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787828056.212155:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057052c0 x1874670272985472/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828056.212173:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828056/real 1787828056]  req@ffff9ee005705680 x1874670272985088/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828081 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828056.212186:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828056.212196:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787828056.212199:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828056.212210:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3219
00000100:00100000:1.0:1787828056.212212:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705680 x1874670272985088/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828081 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828056.212218:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828056.212237:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00080000:1.0:1787828056.212249:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000008:00100000:3.0:1787828056.212252:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:1.0:1787828056.212266:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787828056.212285:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057070c0 x1874670272985600/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828056.212286:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272985088:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828056.212371:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272985216:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828056.212416:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828056.212437:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828056/real 1787828056]  req@ffff9ee005706d00 x1874670272985216/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828081 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828056.212469:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706d00 x1874670272985216/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828081 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828056.212480:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828056.212486:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828056.212492:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272985216:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828056.212503:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272985344:192.168.203.121@tcp:8:kworker.0
00000100:00080000:3.0:1787828056.212530:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828056.212539:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787828056.212547:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:1.0:1787828056.212548:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787828056.212567:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3219
00000100:00080000:3.0:1787828056.212581:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1787828056.212587:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828056/real 1787828056]  req@ffff9ee005707480 x1874670272985344/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828081 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828056.212597:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828056.212620:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787828056.212634:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707480 x1874670272985344/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828081 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787828056.212653:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057061c0 x1874670272985728/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787828056.212659:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828056.212683:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828056.212698:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272985344:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828056.212742:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272985472:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787828056.212778:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828056.212795:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828056/real 1787828056]  req@ffff9ee0057052c0 x1874670272985472/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828081 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828056.212814:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057052c0 x1874670272985472/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828081 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828056.212827:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828056.212833:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828056.212838:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272985472:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828056.212848:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272985600:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828056.212895:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828056.212911:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828056/real 1787828056]  req@ffff9ee0057070c0 x1874670272985600/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828081 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828056.212929:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057070c0 x1874670272985600/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828081 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828056.212948:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828056.212952:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828056.212956:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272985600:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828056.212965:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272985728:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828056.212992:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828056.213005:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828056/real 1787828056]  req@ffff9ee0057061c0 x1874670272985728/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828081 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828056.213016:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057061c0 x1874670272985728/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828081 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828056.213023:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828056.213026:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828056.213028:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272985728:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828057.043525:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828057.235724:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828058.067665:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828058.259492:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828059.091627:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828059.283440:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828060.115492:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828060.307462:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828061.139669:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828061.331458:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787828061.331635:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828061.331646:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787828061.331654:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828061.331671:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3225
00000100:00080000:3.0:1787828061.331691:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828061.331704:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787828061.331774:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707c00 x1874670272985856/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828061.331905:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272985856:192.168.203.121@tcp:250:kworker.0
00000800:00000100:1.0:1787828061.332035:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787828061.332093:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828061.332102:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787828061.332106:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828061.332114:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3225
00000100:00080000:3.0:1787828061.332123:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828061.332131:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828061.332150:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787828061.332175:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704000 x1874670272985984/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828061.332296:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828061/real 1787828061]  req@ffff9ee005707c00 x1874670272985856/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828086 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828061.332361:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707c00 x1874670272985856/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828086 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828061.332383:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828061.332392:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828061.332401:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272985856:192.168.203.121@tcp:250:kworker.0
00000100:00100000:1.0:1787828061.332442:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272985984:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787828061.332488:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828061.332513:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828061/real 1787828061]  req@ffff9ee005704000 x1874670272985984/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828086 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828061.332537:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704000 x1874670272985984/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828086 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828061.332552:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828061.332558:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828061.332562:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272985984:192.168.203.121@tcp:38:kworker.0
00000100:00080000:3.0:1787828061.332650:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828061.332656:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787828061.332659:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828061.332665:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3225
00000100:00080000:3.0:1787828061.332671:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828061.332676:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828061.332684:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787828061.332705:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707840 x1874670272986112/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828061.332717:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828061.332721:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787828061.332724:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828061.332728:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3225
00000100:00080000:3.0:1787828061.332732:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828061.332735:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828061.332740:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787828061.332748:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704780 x1874670272986240/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828061.332757:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828061.332761:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787828061.332763:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828061.332768:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3225
00000100:00080000:3.0:1787828061.332772:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828061.332776:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828061.332781:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787828061.332790:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705a40 x1874670272986368/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828061.332799:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828061.332803:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787828061.332805:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828061.332809:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3225
00000100:00080000:3.0:1787828061.332812:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828061.332815:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828061.332840:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787828061.332860:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705e00 x1874670272986496/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828061.332883:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828061.332889:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787828061.332892:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828061.332899:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3225
00000100:00080000:3.0:1787828061.332906:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828061.332914:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787828061.332920:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272986112:192.168.203.121@tcp:8:kworker.0
00000008:00100000:3.0:1787828061.332922:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787828061.332940:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704b40 x1874670272986624/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1787828061.332962:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828061.333009:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828061/real 1787828061]  req@ffff9ee005707840 x1874670272986112/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828086 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828061.333034:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707840 x1874670272986112/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828086 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828061.333047:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828061.333051:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828061.333055:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272986112:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828061.333064:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272986240:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828061.333093:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828061.333106:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828061/real 1787828061]  req@ffff9ee005704780 x1874670272986240/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828086 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828061.333119:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704780 x1874670272986240/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828086 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828061.333128:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828061.333132:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828061.333136:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272986240:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828061.333142:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272986368:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787828061.333159:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828061.333168:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828061/real 1787828061]  req@ffff9ee005705a40 x1874670272986368/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828086 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828061.333180:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705a40 x1874670272986368/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828086 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828061.333189:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828061.333192:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828061.333195:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272986368:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828061.333201:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272986496:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828061.333216:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828061.333225:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828061/real 1787828061]  req@ffff9ee005705e00 x1874670272986496/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828086 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828061.333238:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705e00 x1874670272986496/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828086 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828061.333246:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828061.333249:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828061.333252:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272986496:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828061.333274:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272986624:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828061.333291:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828061.333300:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828061/real 1787828061]  req@ffff9ee005704b40 x1874670272986624/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828086 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828061.333311:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704b40 x1874670272986624/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828086 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828061.333345:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828061.333350:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828061.333354:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272986624:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828062.163567:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828062.355530:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828063.187567:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828063.379442:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828064.211561:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828064.403484:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828065.235570:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828065.427509:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828066.259547:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1787828066.451444:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1787828066.451460:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787828066.451461:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787828066.451470:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828066.451488:0:8:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3230
00000100:00080000:3.0:1787828066.451506:0:8:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828066.451517:0:8:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787828066.451578:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706580 x1874670272986752/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828066.451620:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828066.451625:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787828066.451628:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828066.451632:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3230
00000100:00080000:3.0:1787828066.451636:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828066.451641:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828066.451655:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787828066.451668:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057043c0 x1874670272986880/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828066.451699:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828066.451703:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787828066.451706:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828066.451711:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3230
00000100:00080000:3.0:1787828066.451718:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828066.451724:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828066.451732:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787828066.451748:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704b40 x1874670272987008/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828066.451764:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828066.451769:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787828066.451771:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828066.451776:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3230
00000100:00080000:3.0:1787828066.451781:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828066.451811:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787828066.451833:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272986752:192.168.203.121@tcp:250:kworker.0
00000008:00100000:3.0:1787828066.451838:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787828066.451861:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705e00 x1874670272987136/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828066.451876:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828066.451880:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787828066.451883:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828066.451891:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3230
00000100:00080000:3.0:1787828066.451896:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828066.451901:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828066.451907:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787828066.451921:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705a40 x1874670272987264/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828066.451941:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828066.451945:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787828066.451948:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828066.451952:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3230
00000100:00080000:3.0:1787828066.451956:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828066.451959:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828066.451964:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1787828066.451969:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787828066.451987:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704780 x1874670272987392/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828066.452004:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828066.452010:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787828066.452016:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828066.452025:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3230
00000100:00080000:3.0:1787828066.452033:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828066.452040:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828066.452051:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787828066.452061:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828066/real 1787828066]  req@ffff9ee005706580 x1874670272986752/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828091 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787828066.452082:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707840 x1874670272987520/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828066.452100:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706580 x1874670272986752/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828091 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828066.452150:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828066.452160:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828066.452166:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272986752:192.168.203.121@tcp:250:kworker.0
00000100:00100000:1.0:1787828066.452179:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272986880:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787828066.452211:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828066.452227:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828066/real 1787828066]  req@ffff9ee0057043c0 x1874670272986880/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828091 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828066.452243:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057043c0 x1874670272986880/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828091 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828066.452253:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828066.452258:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828066.452262:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272986880:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828066.452293:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272987008:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828066.452372:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828066.452389:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828066/real 1787828066]  req@ffff9ee005704b40 x1874670272987008/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828091 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828066.452405:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704b40 x1874670272987008/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828091 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828066.452415:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828066.452420:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828066.452424:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272987008:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828066.452432:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272987136:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828066.452457:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828066.452468:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828066/real 1787828066]  req@ffff9ee005705e00 x1874670272987136/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828091 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828066.452482:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705e00 x1874670272987136/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828091 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828066.452491:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828066.452495:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828066.452499:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272987136:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828066.452505:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272987264:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787828066.452523:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828066.452534:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828066/real 1787828066]  req@ffff9ee005705a40 x1874670272987264/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828091 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828066.452548:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705a40 x1874670272987264/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828091 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828066.452557:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828066.452561:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828066.452564:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272987264:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828066.452571:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272987392:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828066.452589:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828066.452600:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828066/real 1787828066]  req@ffff9ee005704780 x1874670272987392/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828091 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828066.452614:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704780 x1874670272987392/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828091 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828066.452623:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828066.452627:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828066.452630:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272987392:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828066.452637:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272987520:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828066.452654:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828066.452664:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828066/real 1787828066]  req@ffff9ee005707840 x1874670272987520/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828091 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828066.452677:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707840 x1874670272987520/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828091 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828066.452687:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828066.452690:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828066.452694:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272987520:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828067.283557:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828067.475428:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828068.307543:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828068.499508:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828069.331547:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828069.523466:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828070.355523:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828070.547370:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828071.379522:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1787828071.571503:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828071.571532:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00100000:1.0:1787828071.571542:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787828071.571543:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828071.571570:0:8:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3235
00000100:00080000:3.0:1787828071.571588:0:8:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828071.571616:0:8:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787828071.571697:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704000 x1874670272987648/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828071.571776:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828071.571787:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787828071.571793:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828071.571806:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3235
00000100:00080000:3.0:1787828071.571815:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828071.571828:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828071.571848:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787828071.571849:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272987648:192.168.203.121@tcp:250:kworker.0
00000100:00100000:3.0:1787828071.571904:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707c00 x1874670272987776/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828071.571934:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828071.571942:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787828071.571947:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:2.0:1787828071.572004:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787828071.572079:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3235
00000100:00100000:2.0:1787828071.572087:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828071/real 1787828071]  req@ffff9ee005704000 x1874670272987648/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828096 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828071.572116:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704000 x1874670272987648/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828096 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828071.572135:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828071.572142:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828071.572149:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272987648:192.168.203.121@tcp:250:kworker.0
00000100:00100000:2.0:1787828071.572206:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272987776:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787828071.572250:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828071.572268:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828071/real 1787828071]  req@ffff9ee005707c00 x1874670272987776/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828096 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828071.572285:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707c00 x1874670272987776/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828096 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828071.572366:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828071.572375:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828071.572383:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272987776:192.168.203.121@tcp:38:kworker.0
00000100:00080000:3.0:1787828071.572459:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828071.572483:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828071.572499:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787828071.572535:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057061c0 x1874670272987904/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828071.572592:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828071.572601:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787828071.572607:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828071.572618:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3235
00000100:00080000:3.0:1787828071.572629:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828071.572639:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787828071.572648:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272987904:192.168.203.121@tcp:8:kworker.0
00000008:00100000:3.0:1787828071.572659:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787828071.572697:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057070c0 x1874670272988032/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1787828071.572707:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828071.572739:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828071/real 1787828071]  req@ffff9ee0057061c0 x1874670272987904/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828096 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828071.572742:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828071.572783:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787828071.572787:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828071.572798:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3235
00000100:00080000:3.0:1787828071.572807:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828071.572816:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828071.572839:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787828071.572854:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057061c0 x1874670272987904/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828096 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828071.572869:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:3.0:1787828071.572874:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057052c0 x1874670272988160/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828071.572878:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828071.572895:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272987904:192.168.203.121@tcp:8:kworker.0
00000100:00080000:3.0:1787828071.572938:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828071.572947:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00100000:2.0:1787828071.572963:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272988032:192.168.203.121@tcp:8:kworker.0
00000100:00080000:3.0:1787828071.572965:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828071.572989:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3235
00000100:00080000:3.0:1787828071.573001:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828071.573011:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828071.573023:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:2.0:1787828071.573037:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828071.573076:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828071/real 1787828071]  req@ffff9ee0057070c0 x1874670272988032/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828096 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787828071.573078:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707480 x1874670272988288/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787828071.573152:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057070c0 x1874670272988032/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828096 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828071.573170:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828071.573173:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828071.573194:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00080000:3.0:1787828071.573194:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787828071.573212:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1787828071.573214:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272988032:192.168.203.121@tcp:8:kworker.0
00000100:00080000:3.0:1787828071.573251:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3235
00000100:00100000:2.0:1787828071.573253:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272988160:192.168.203.121@tcp:38:kworker.0
00000100:00080000:3.0:1787828071.573281:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828071.573298:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000800:00000100:2.0:1787828071.573309:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000008:00100000:3.0:1787828071.573314:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828071.573410:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828071/real 1787828071]  req@ffff9ee0057052c0 x1874670272988160/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828096 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787828071.573411:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706d00 x1874670272988416/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787828071.573514:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057052c0 x1874670272988160/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828096 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828071.573537:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828071.573543:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828071.573548:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272988160:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787828071.573575:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272988288:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787828071.573602:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828071.573615:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828071/real 1787828071]  req@ffff9ee005707480 x1874670272988288/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828096 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828071.573630:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707480 x1874670272988288/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828096 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828071.573640:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828071.573644:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828071.573648:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272988288:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787828071.573656:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272988416:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787828071.573676:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828071.573687:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828071/real 1787828071]  req@ffff9ee005706d00 x1874670272988416/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828096 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828071.573702:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706d00 x1874670272988416/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828096 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828071.573711:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828071.573715:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828071.573720:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272988416:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828072.403514:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828072.595498:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828073.427602:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828073.619466:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828074.451606:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828074.643402:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828075.475518:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828075.667469:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828076.499582:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1787828076.691481:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1787828076.691497:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:2.0:1787828076.691498:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787828076.691507:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828076.691525:0:8:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3240
00000100:00080000:2.0:1787828076.691543:0:8:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828076.691555:0:8:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787828076.691636:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b0c0 x1874670272988544/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828076.691688:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828076.691694:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787828076.691696:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828076.691702:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3240
00000100:00080000:2.0:1787828076.691708:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828076.691760:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828076.691775:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787828076.691817:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572ad00 x1874670272988672/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828076.691821:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272988544:192.168.203.121@tcp:250:kworker.0
00000100:00080000:2.0:1787828076.691863:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828076.691871:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787828076.691875:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828076.691902:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3240
00000100:00080000:2.0:1787828076.691908:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828076.691915:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828076.691926:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828076.691953:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b480 x1874670272988800/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1787828076.691955:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:2.0:1787828076.692002:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828076.692010:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787828076.692015:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828076.692027:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3240
00000100:00080000:2.0:1787828076.692034:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828076.692040:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828076.692050:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787828076.692062:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828076/real 1787828076]  req@ffff9ee00572b0c0 x1874670272988544/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828101 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828076.692077:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729a40 x1874670272988928/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828076.692152:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828076.692158:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787828076.692163:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1787828076.692171:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b0c0 x1874670272988544/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828101 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828076.692182:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3240
00000100:00080000:2.0:1787828076.692201:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828076.692218:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828076.692230:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00080000:1.0:1787828076.692234:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828076.692247:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828076.692265:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272988544:192.168.203.121@tcp:250:kworker.0
00000100:00100000:2.0:1787828076.692284:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728b40 x1874670272989056/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828076.692310:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828076.692321:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787828076.692329:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828076.692338:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3240
00000100:00080000:2.0:1787828076.692345:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1787828076.692348:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272988672:192.168.203.121@tcp:38:kworker.0
00000100:00080000:2.0:1787828076.692356:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828076.692373:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1787828076.692405:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828076.692430:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828076/real 1787828076]  req@ffff9ee00572ad00 x1874670272988672/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828101 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828076.692442:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a580 x1874670272989184/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828076.692476:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572ad00 x1874670272988672/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828101 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828076.692480:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828076.692508:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787828076.692518:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787828076.692528:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828076.692534:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3240
00000100:00080000:1.0:1787828076.692552:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00080000:2.0:1787828076.692567:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1787828076.692568:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272988672:192.168.203.121@tcp:38:kworker.0
00000100:00080000:2.0:1787828076.692587:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787828076.692595:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272988800:192.168.203.121@tcp:8:kworker.0
00000008:00100000:2.0:1787828076.692603:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828076.692634:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728000 x1874670272989312/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1787828076.692650:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828076.692679:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828076/real 1787828076]  req@ffff9ee00572b480 x1874670272988800/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828101 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828076.692699:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b480 x1874670272988800/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828101 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828076.692736:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828076.692743:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828076.692747:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272988800:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828076.692758:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272988928:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828076.692787:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828076.692801:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828076/real 1787828076]  req@ffff9ee005729a40 x1874670272988928/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828101 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828076.692815:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729a40 x1874670272988928/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828101 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828076.692825:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828076.692830:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828076.692834:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272988928:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828076.692857:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272989056:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787828076.692877:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828076.692899:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828076/real 1787828076]  req@ffff9ee005728b40 x1874670272989056/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828101 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828076.692913:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728b40 x1874670272989056/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828101 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828076.692923:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828076.692927:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828076.692943:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272989056:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828076.692963:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272989184:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828076.692991:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828076.693012:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828076/real 1787828076]  req@ffff9ee00572a580 x1874670272989184/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828101 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828076.693036:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a580 x1874670272989184/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828101 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828076.693052:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828076.693058:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828076.693064:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272989184:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828076.693078:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272989312:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828076.693112:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828076.693127:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828076/real 1787828076]  req@ffff9ee005728000 x1874670272989312/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828101 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828076.693142:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728000 x1874670272989312/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828101 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828076.693152:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828076.693157:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828076.693160:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272989312:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828077.523516:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828077.715453:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828078.547574:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828078.739458:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828079.571564:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828079.763458:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828080.595511:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828080.787416:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828081.619545:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828081.811492:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:0.0:1787828081.811561:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828081.811589:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1787828081.811596:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828081.811608:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3245
00000100:00080000:0.0:1787828081.811623:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828081.811633:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787828081.811705:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8b40 x1874670272989440/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828081.811754:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828081.811759:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787828081.811762:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828081.811767:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3245
00000100:00080000:0.0:1787828081.811772:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828081.811777:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828081.811789:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787828081.811808:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9e00 x1874670272989568/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828081.811827:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828081.811833:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787828081.811840:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1787828081.811843:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272989440:192.168.203.121@tcp:250:kworker.0
00000100:00080000:0.0:1787828081.811849:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3245
00000100:00080000:0.0:1787828081.811861:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828081.811866:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828081.811872:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828081.811890:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8780 x1874670272989696/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828081.811914:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828081.811919:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787828081.811922:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828081.811927:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3245
00000100:00080000:0.0:1787828081.811943:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828081.811949:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000800:00000100:1.0:1787828081.811957:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000008:00100000:0.0:1787828081.811959:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828081.811980:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9680 x1874670272989824/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828081.811992:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828081.811997:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787828081.812000:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828081.812007:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3245
00000100:00080000:0.0:1787828081.812013:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1787828081.812021:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828081/real 1787828081]  req@ffff9ee0056e8b40 x1874670272989440/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828106 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828081.812024:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828081.812033:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787828081.812047:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9a40 x1874670272989952/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828081.812092:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828081.812097:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787828081.812105:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1787828081.812107:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8b40 x1874670272989440/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828106 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828081.812117:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3245
00000100:00080000:0.0:1787828081.812131:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828081.812146:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828081.812166:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828081.812196:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ead00 x1874670272990080/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787828081.812201:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828081.812220:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828081.812231:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272989440:192.168.203.121@tcp:250:kworker.0
00000100:00080000:0.0:1787828081.812237:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828081.812248:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787828081.812251:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828081.812258:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3245
00000100:00080000:0.0:1787828081.812265:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828081.812270:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828081.812279:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787828081.812286:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272989568:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787828081.812308:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ea580 x1874670272990208/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1787828081.812376:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828081.812403:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828081/real 1787828081]  req@ffff9ee0056e9e00 x1874670272989568/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828106 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828081.812423:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9e00 x1874670272989568/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828106 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828081.812435:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828081.812440:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828081.812444:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272989568:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828081.812463:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272989696:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828081.812487:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828081.812499:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828081/real 1787828081]  req@ffff9ee0056e8780 x1874670272989696/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828106 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828081.812514:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8780 x1874670272989696/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828106 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828081.812530:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828081.812534:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828081.812537:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272989696:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828081.812544:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272989824:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828081.812562:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828081.812573:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828081/real 1787828081]  req@ffff9ee0056e9680 x1874670272989824/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828106 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828081.812591:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9680 x1874670272989824/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828106 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828081.812612:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828081.812619:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828081.812624:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272989824:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828081.812637:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272989952:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787828081.812700:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828081.812725:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828081/real 1787828081]  req@ffff9ee0056e9a40 x1874670272989952/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828106 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828081.812753:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9a40 x1874670272989952/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828106 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828081.812764:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828081.812768:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828081.812772:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272989952:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828081.812780:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272990080:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828081.812807:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828081.812819:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828081/real 1787828081]  req@ffff9ee0056ead00 x1874670272990080/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828106 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828081.812834:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ead00 x1874670272990080/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828106 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828081.812843:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828081.812846:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828081.812850:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272990080:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828081.812875:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272990208:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828081.812895:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828081.812916:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828081/real 1787828081]  req@ffff9ee0056ea580 x1874670272990208/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828106 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828081.812930:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ea580 x1874670272990208/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828106 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828081.812939:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828081.812942:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828081.812946:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272990208:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828082.643549:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828082.835431:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828083.667705:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828083.859479:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828084.691618:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828084.883414:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828085.715633:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828085.907449:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828086.739620:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1787828086.931436:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1787828086.931444:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:0.0:1787828086.931463:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1787828086.931471:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828086.931484:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3250
00000100:00080000:0.0:1787828086.931497:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828086.931506:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787828086.931549:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ea940 x1874670272990336/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828086.931594:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828086.931599:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787828086.931601:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828086.931606:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3250
00000100:00080000:0.0:1787828086.931611:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828086.931615:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828086.931627:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787828086.931683:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb0c0 x1874670272990464/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828086.931696:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272990336:192.168.203.121@tcp:250:kworker.0
00000100:00080000:0.0:1787828086.931706:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828086.931715:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787828086.931718:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828086.931724:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3250
00000100:00080000:0.0:1787828086.931729:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828086.931734:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828086.931742:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828086.931761:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ea580 x1874670272990592/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828086.931775:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828086.931794:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787828086.931799:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:1.0:1787828086.931811:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:0.0:1787828086.931819:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3250
00000100:00080000:0.0:1787828086.931830:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828086.931840:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828086.931851:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787828086.931869:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828086/real 1787828086]  req@ffff9ee0056ea940 x1874670272990336/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828111 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787828086.931883:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ead00 x1874670272990720/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828086.931907:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ea940 x1874670272990336/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828111 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828086.931914:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828086.931935:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787828086.931942:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828086.931959:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3250
00000100:00080000:1.0:1787828086.931960:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787828086.931971:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828086.931973:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:0.0:1787828086.931988:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787828086.931991:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272990336:192.168.203.121@tcp:250:kworker.0
00000008:00100000:0.0:1787828086.932000:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787828086.932023:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9a40 x1874670272990848/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828086.932031:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272990464:192.168.203.121@tcp:38:kworker.0
00000100:00080000:0.0:1787828086.932057:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828086.932062:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787828086.932066:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828086.932072:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3250
00000100:00080000:0.0:1787828086.932093:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000800:00000100:1.0:1787828086.932100:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:0.0:1787828086.932114:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828086.932122:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787828086.932145:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828086/real 1787828086]  req@ffff9ee0056eb0c0 x1874670272990464/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828111 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787828086.932149:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9680 x1874670272990976/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828086.932197:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb0c0 x1874670272990464/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828111 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828086.932199:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828086.932219:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787828086.932226:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787828086.932231:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787828086.932238:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3250
00000100:00080000:1.0:1787828086.932246:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00080000:0.0:1787828086.932252:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1787828086.932256:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272990464:192.168.203.121@tcp:38:kworker.0
00000100:00080000:0.0:1787828086.932265:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828086.932276:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787828086.932292:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272990592:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787828086.932297:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8780 x1874670272991104/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1787828086.932418:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828086.932446:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828086/real 1787828086]  req@ffff9ee0056ea580 x1874670272990592/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828111 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828086.932464:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ea580 x1874670272990592/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828111 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828086.932475:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828086.932480:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828086.932484:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272990592:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828086.932493:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272990720:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828086.932519:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828086.932539:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828086/real 1787828086]  req@ffff9ee0056ead00 x1874670272990720/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828111 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828086.932553:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ead00 x1874670272990720/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828111 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828086.932563:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828086.932567:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828086.932571:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272990720:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828086.932593:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272990848:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787828086.932614:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828086.932633:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828086/real 1787828086]  req@ffff9ee0056e9a40 x1874670272990848/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828111 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828086.932685:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9a40 x1874670272990848/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828111 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828086.932703:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828086.932710:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828086.932717:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272990848:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828086.932729:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272990976:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828086.932764:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828086.932779:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828086/real 1787828086]  req@ffff9ee0056e9680 x1874670272990976/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828111 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828086.932795:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9680 x1874670272990976/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828111 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828086.932806:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828086.932810:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828086.932814:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272990976:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828086.932821:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272991104:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828086.932839:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828086.932850:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828086/real 1787828086]  req@ffff9ee0056e8780 x1874670272991104/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828111 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828086.932864:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8780 x1874670272991104/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828111 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828086.932873:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828086.932876:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828086.932880:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272991104:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828087.763736:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828087.955415:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828088.787558:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828088.979417:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828089.811452:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828090.003447:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828090.835722:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828091.027511:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828091.859715:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1787828092.051472:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1787828092.051473:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:0.0:1787828092.051487:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1787828092.051494:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828092.051525:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3255
00000100:00080000:0.0:1787828092.051547:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828092.051565:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787828092.051669:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9e00 x1874670272991232/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828092.051702:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828092.051708:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787828092.051711:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828092.051716:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3255
00000100:00080000:0.0:1787828092.051720:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828092.051726:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828092.051739:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787828092.051755:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8b40 x1874670272991360/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828092.051761:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272991232:192.168.203.121@tcp:250:kworker.0
00000100:00080000:0.0:1787828092.051774:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828092.051779:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787828092.051781:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828092.051787:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3255
00000100:00080000:0.0:1787828092.051791:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828092.051796:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828092.051803:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828092.051817:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e92c0 x1874670272991488/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828092.051824:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828092.051828:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787828092.051829:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828092.051833:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3255
00000100:00080000:0.0:1787828092.051836:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828092.051839:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000800:00000100:1.0:1787828092.051845:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000008:00100000:0.0:1787828092.051848:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828092.051858:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb840 x1874670272991616/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828092.051865:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828092.051868:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787828092.051870:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828092.051872:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3255
00000100:00080000:0.0:1787828092.051874:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828092.051877:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828092.051879:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787828092.051887:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb480 x1874670272991744/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828092.051895:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1787828092.051896:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828092/real 1787828092]  req@ffff9ee0056e9e00 x1874670272991232/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828117 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828092.051900:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787828092.051903:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828092.051912:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3255
00000100:00080000:0.0:1787828092.051915:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828092.051918:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828092.051921:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787828092.051925:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9e00 x1874670272991232/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828117 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787828092.051934:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8000 x1874670272991872/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828092.051955:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828092.051957:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787828092.051958:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787828092.051962:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828092.051968:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3255
00000100:00080000:1.0:1787828092.051969:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:0.0:1787828092.051970:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828092.051976:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828092.051980:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787828092.051981:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272991232:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787828092.051989:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e83c0 x1874670272992000/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828092.052016:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272991360:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787828092.052037:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828092.052047:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828092/real 1787828092]  req@ffff9ee0056e8b40 x1874670272991360/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828117 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828092.052056:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8b40 x1874670272991360/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828117 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828092.052063:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828092.052065:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828092.052067:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272991360:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828092.052071:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272991488:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828092.052084:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828092.052090:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828092/real 1787828092]  req@ffff9ee0056e92c0 x1874670272991488/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828117 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828092.052097:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e92c0 x1874670272991488/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828117 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828092.052103:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828092.052105:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828092.052106:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272991488:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828092.052111:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272991616:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828092.052121:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828092.052126:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828092/real 1787828092]  req@ffff9ee0056eb840 x1874670272991616/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828117 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828092.052134:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb840 x1874670272991616/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828117 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828092.052139:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828092.052141:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828092.052143:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272991616:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828092.052146:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272991744:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787828092.052156:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828092.052161:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828092/real 1787828092]  req@ffff9ee0056eb480 x1874670272991744/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828117 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828092.052168:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb480 x1874670272991744/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828117 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828092.052174:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828092.052175:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828092.052177:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272991744:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828092.052180:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272991872:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828092.052189:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828092.052195:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828092/real 1787828092]  req@ffff9ee0056e8000 x1874670272991872/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828117 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828092.052203:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8000 x1874670272991872/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828117 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828092.052208:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828092.052209:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828092.052211:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272991872:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828092.052214:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272992000:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828092.052223:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828092.052228:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828092/real 1787828092]  req@ffff9ee0056e83c0 x1874670272992000/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828117 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828092.052235:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e83c0 x1874670272992000/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828117 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828092.052240:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828092.052242:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828092.052244:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272992000:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828092.883656:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828093.075493:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828093.907678:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828094.099500:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828094.931648:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828095.123444:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828095.955601:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828096.147458:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828096.979611:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828097.171412:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:2.0:1787828097.171435:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828097.171445:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787828097.171451:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828097.171465:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3260
00000100:00080000:2.0:1787828097.171481:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828097.171490:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787828097.171541:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057283c0 x1874670272992128/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828097.171593:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828097.171600:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787828097.171604:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828097.171610:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3260
00000100:00080000:2.0:1787828097.171617:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828097.171624:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828097.171642:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787828097.171659:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272992128:192.168.203.121@tcp:250:kworker.0
00000100:00100000:2.0:1787828097.171667:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b840 x1874670272992256/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828097.171683:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828097.171687:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787828097.171690:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828097.171695:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3260
00000100:00080000:2.0:1787828097.171699:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828097.171704:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828097.171711:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828097.171724:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728f00 x1874670272992384/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828097.171734:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828097.171738:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787828097.171740:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828097.171744:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3260
00000100:00080000:2.0:1787828097.171747:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828097.171750:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828097.171755:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1787828097.171761:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828097.171773:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a1c0 x1874670272992512/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828097.171784:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828097.171788:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787828097.171790:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828097.171794:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3260
00000100:00080000:2.0:1787828097.171797:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828097.171801:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828097.171806:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787828097.171819:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828097/real 1787828097]  req@ffff9ee0057283c0 x1874670272992128/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828122 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828097.171823:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729e00 x1874670272992640/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828097.171861:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828097.171864:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787828097.171867:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1787828097.171873:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057283c0 x1874670272992128/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828122 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828097.171878:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3260
00000100:00080000:2.0:1787828097.171886:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828097.171897:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828097.171907:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:1.0:1787828097.171915:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:2.0:1787828097.171922:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a940 x1874670272992768/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787828097.171926:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828097.171937:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272992128:192.168.203.121@tcp:250:kworker.0
00000100:00080000:2.0:1787828097.171943:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828097.171948:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787828097.171950:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828097.171954:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3260
00000100:00080000:2.0:1787828097.171957:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828097.171961:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828097.171965:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787828097.171978:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272992256:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787828097.171979:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728780 x1874670272992896/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1787828097.172016:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828097.172032:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828097/real 1787828097]  req@ffff9ee00572b840 x1874670272992256/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828122 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828097.172045:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b840 x1874670272992256/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828122 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828097.172053:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828097.172057:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828097.172060:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272992256:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828097.172065:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272992384:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828097.172081:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828097.172090:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828097/real 1787828097]  req@ffff9ee005728f00 x1874670272992384/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828122 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828097.172101:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728f00 x1874670272992384/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828122 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828097.172108:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828097.172111:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828097.172114:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272992384:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828097.172119:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272992512:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828097.172133:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828097.172141:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828097/real 1787828097]  req@ffff9ee00572a1c0 x1874670272992512/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828122 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828097.172151:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a1c0 x1874670272992512/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828122 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828097.172159:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828097.172162:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828097.172164:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272992512:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828097.172169:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272992640:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787828097.172183:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828097.172191:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828097/real 1787828097]  req@ffff9ee005729e00 x1874670272992640/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828122 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828097.172201:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729e00 x1874670272992640/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828122 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828097.172208:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828097.172211:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828097.172214:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272992640:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828097.172231:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272992768:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828097.172248:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828097.172257:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828097/real 1787828097]  req@ffff9ee00572a940 x1874670272992768/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828122 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828097.172269:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a940 x1874670272992768/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828122 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828097.172276:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828097.172279:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828097.172282:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272992768:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828097.172304:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272992896:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828097.172362:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828097.172374:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828097/real 1787828097]  req@ffff9ee005728780 x1874670272992896/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828122 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828097.172386:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728780 x1874670272992896/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828122 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828097.172395:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828097.172398:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828097.172401:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272992896:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828098.003638:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828098.195454:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828099.027611:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828099.219444:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828100.051693:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828100.243474:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828101.075653:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828101.267521:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828102.099596:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1787828102.291445:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828102.291459:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787828102.291465:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1787828102.291471:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787828102.291483:0:8:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3266
00000100:00080000:3.0:1787828102.291501:0:8:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828102.291512:0:8:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787828102.291593:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705680 x1874670272993024/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828102.291632:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828102.291637:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787828102.291640:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828102.291645:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3266
00000100:00080000:3.0:1787828102.291650:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828102.291655:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828102.291668:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787828102.291688:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706940 x1874670272993152/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828102.291706:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828102.291710:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787828102.291713:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828102.291734:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3266
00000100:00100000:1.0:1787828102.291737:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272993024:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787828102.291741:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828102.291764:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828102.291773:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787828102.291793:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706d00 x1874670272993280/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828102.291806:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828102.291810:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787828102.291814:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828102.291820:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3266
00000100:00080000:3.0:1787828102.291825:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828102.291830:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828102.291836:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787828102.291849:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707480 x1874670272993408/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828102.291871:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:1.0:1787828102.291883:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787828102.291894:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787828102.291900:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828102.291915:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3266
00000100:00080000:3.0:1787828102.291925:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828102.291936:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828102.291948:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787828102.291977:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828102/real 1787828102]  req@ffff9ee005705680 x1874670272993024/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828127 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787828102.291979:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057052c0 x1874670272993536/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828102.292013:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1787828102.292017:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705680 x1874670272993024/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828127 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828102.292020:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787828102.292033:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828102.292066:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3266
00000100:00080000:3.0:1787828102.292088:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828102.292104:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787828102.292105:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828102.292131:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:1.0:1787828102.292132:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828102.292151:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272993024:192.168.203.121@tcp:250:kworker.0
00000100:00100000:3.0:1787828102.292165:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057070c0 x1874670272993664/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828102.292189:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1787828102.292201:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272993152:192.168.203.121@tcp:38:kworker.0
00000100:00080000:3.0:1787828102.292202:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787828102.292220:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828102.292235:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3266
00000100:00080000:3.0:1787828102.292246:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000800:00000100:1.0:1787828102.292248:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787828102.292267:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787828102.292278:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828102/real 1787828102]  req@ffff9ee005706940 x1874670272993152/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828127 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:3.0:1787828102.292280:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787828102.292368:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706940 x1874670272993152/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828127 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787828102.292381:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057061c0 x1874670272993792/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787828102.292407:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828102.292433:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828102.292443:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272993152:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828102.292460:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272993280:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828102.292490:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828102.292505:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828102/real 1787828102]  req@ffff9ee005706d00 x1874670272993280/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828127 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828102.292520:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706d00 x1874670272993280/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828127 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828102.292530:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828102.292557:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828102.292561:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272993280:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828102.292571:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272993408:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828102.292593:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828102.292607:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828102/real 1787828102]  req@ffff9ee005707480 x1874670272993408/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828127 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828102.292621:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707480 x1874670272993408/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828127 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828102.292632:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828102.292636:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828102.292640:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272993408:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828102.292647:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272993536:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787828102.292667:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828102.292677:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828102/real 1787828102]  req@ffff9ee0057052c0 x1874670272993536/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828127 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828102.292691:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057052c0 x1874670272993536/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828127 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828102.292701:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828102.292705:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828102.292708:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272993536:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828102.292715:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272993664:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828102.292734:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828102.292745:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828102/real 1787828102]  req@ffff9ee0057070c0 x1874670272993664/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828127 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828102.292760:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057070c0 x1874670272993664/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828127 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828102.292769:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828102.292773:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828102.292776:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272993664:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828102.292801:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272993792:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828102.292821:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828102.292833:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828102/real 1787828102]  req@ffff9ee0057061c0 x1874670272993792/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828127 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828102.292846:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057061c0 x1874670272993792/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828127 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828102.292855:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828102.292860:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828102.292864:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272993792:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828103.123651:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828103.315506:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828104.147505:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828104.339493:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828105.171543:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828105.363495:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828106.195623:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828106.387495:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828107.219606:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1787828107.411431:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828107.411443:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787828107.411452:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828107.411465:0:8:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3271
00000100:00080000:3.0:1787828107.411481:0:8:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828107.411493:0:8:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787828107.411525:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00100000:3.0:1787828107.411585:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707c00 x1874670272993920/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828107.411619:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828107.411625:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787828107.411656:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828107.411663:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3271
00000100:00080000:3.0:1787828107.411670:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828107.411679:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787828107.411687:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272993920:192.168.203.121@tcp:250:kworker.0
00000008:00100000:3.0:1787828107.411698:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787828107.411748:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704000 x1874670272994048/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828107.411760:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828107.411764:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787828107.411766:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828107.411769:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3271
00000100:00080000:3.0:1787828107.411772:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828107.411775:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828107.411778:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787828107.411792:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707840 x1874670272994176/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828107.411799:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828107.411819:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787828107.411822:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828107.411826:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3271
00000100:00080000:3.0:1787828107.411833:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828107.411845:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000800:00000100:2.0:1787828107.411847:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000008:00100000:3.0:1787828107.411867:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828107.411942:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828107/real 1787828107]  req@ffff9ee005707c00 x1874670272993920/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828132 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828107.412005:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707c00 x1874670272993920/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828132 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828107.412031:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828107.412039:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828107.412058:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272993920:192.168.203.121@tcp:250:kworker.0
00000100:00100000:2.0:1787828107.412098:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272994048:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787828107.412133:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828107.412156:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828107/real 1787828107]  req@ffff9ee005704000 x1874670272994048/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828132 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828107.412174:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704000 x1874670272994048/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828132 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828107.412196:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828107.412201:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828107.412206:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272994048:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787828107.412207:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704780 x1874670272994304/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787828107.412259:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272994176:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787828107.412391:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828107.412432:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828107/real 1787828107]  req@ffff9ee005707840 x1874670272994176/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828132 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828107.412457:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1787828107.412468:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707840 x1874670272994176/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828132 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828107.412470:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787828107.412479:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828107.412531:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787828107.412532:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3271
00000100:00080000:2.0:1787828107.412555:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00080000:3.0:1787828107.412562:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1787828107.412565:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272994176:192.168.203.121@tcp:8:kworker.0
00000100:00080000:3.0:1787828107.412577:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828107.412588:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787828107.412601:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272994304:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787828107.412613:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705a40 x1874670272994432/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828107.412631:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828107.412635:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787828107.412638:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:2.0:1787828107.412645:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787828107.412647:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3271
00000100:00080000:3.0:1787828107.412658:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828107.412665:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828107.412671:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828107.412675:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828107/real 1787828107]  req@ffff9ee005704780 x1874670272994304/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828132 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787828107.412694:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705e00 x1874670272994560/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787828107.412708:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704780 x1874670272994304/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828132 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828107.412751:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828107.412761:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787828107.412761:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787828107.412772:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828107.412779:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828107.412802:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272994304:192.168.203.121@tcp:8:kworker.0
00000100:00080000:3.0:1787828107.412810:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3271
00000100:00080000:3.0:1787828107.412817:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828107.412826:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787828107.412834:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272994432:192.168.203.121@tcp:38:kworker.0
00000008:00100000:3.0:1787828107.412835:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787828107.412886:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704b40 x1874670272994688/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1787828107.412901:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828107.412929:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828107/real 1787828107]  req@ffff9ee005705a40 x1874670272994432/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828132 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828107.412957:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705a40 x1874670272994432/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828132 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828107.412969:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828107.412973:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828107.412977:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272994432:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787828107.412993:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272994560:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787828107.413014:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828107.413025:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828107/real 1787828107]  req@ffff9ee005705e00 x1874670272994560/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828132 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828107.413038:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705e00 x1874670272994560/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828132 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828107.413048:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828107.413061:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828107.413065:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272994560:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787828107.413080:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272994688:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787828107.413099:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828107.413110:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828107/real 1787828107]  req@ffff9ee005704b40 x1874670272994688/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828132 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828107.413127:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704b40 x1874670272994688/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828132 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828107.413146:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828107.413150:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828107.413154:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272994688:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828108.243593:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828108.435467:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828109.267662:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828109.459406:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828110.291637:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828110.483428:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828111.315642:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828111.507430:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828112.339602:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828112.531497:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787828112.531497:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828112.531531:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787828112.531536:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828112.531549:0:8:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3276
00000100:00080000:3.0:1787828112.531562:0:8:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828112.531587:0:8:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787828112.531632:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057043c0 x1874670272994816/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828112.531672:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828112.531677:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787828112.531679:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828112.531683:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3276
00000100:00080000:3.0:1787828112.531688:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828112.531708:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828112.531717:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787828112.531728:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706580 x1874670272994944/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828112.531745:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828112.531749:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787828112.531752:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828112.531755:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3276
00000100:00080000:3.0:1787828112.531758:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828112.531763:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828112.531768:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828112.531792:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272994816:192.168.203.121@tcp:250:kworker.0
00000100:00100000:3.0:1787828112.531793:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704b40 x1874670272995072/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828112.531814:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828112.531817:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787828112.531819:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828112.531822:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3276
00000100:00080000:3.0:1787828112.531825:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828112.531830:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828112.531834:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787828112.531855:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705e00 x1874670272995200/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828112.531866:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828112.531870:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787828112.531871:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828112.531876:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3276
00000100:00080000:3.0:1787828112.531879:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828112.531884:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828112.531889:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787828112.531912:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705a40 x1874670272995328/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828112.531921:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828112.531924:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787828112.531925:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828112.531930:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3276
00000100:00080000:3.0:1787828112.531941:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828112.531946:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828112.531950:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787828112.531969:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704780 x1874670272995456/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1787828112.531980:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787828112.531998:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828112.532004:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787828112.532007:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828112.532016:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3276
00000100:00080000:3.0:1787828112.532026:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828112.532034:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828112.532041:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787828112.532075:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707840 x1874670272995584/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787828112.532088:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828112/real 1787828112]  req@ffff9ee0057043c0 x1874670272994816/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828137 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828112.532127:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057043c0 x1874670272994816/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828137 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828112.532144:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828112.532151:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828112.532157:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272994816:192.168.203.121@tcp:250:kworker.0
00000100:00100000:2.0:1787828112.532168:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272994944:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787828112.532208:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828112.532232:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828112/real 1787828112]  req@ffff9ee005706580 x1874670272994944/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828137 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828112.532275:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706580 x1874670272994944/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828137 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828112.532294:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828112.532300:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828112.532380:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272994944:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787828112.532434:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272995072:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787828112.532513:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828112.532532:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828112/real 1787828112]  req@ffff9ee005704b40 x1874670272995072/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828137 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828112.532549:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704b40 x1874670272995072/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828137 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828112.532559:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828112.532564:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828112.532568:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272995072:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787828112.532576:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272995200:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787828112.532603:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828112.532623:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828112/real 1787828112]  req@ffff9ee005705e00 x1874670272995200/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828137 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828112.532647:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705e00 x1874670272995200/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828137 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828112.532677:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828112.532697:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828112.532704:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272995200:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787828112.532716:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272995328:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787828112.532748:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828112.532772:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828112/real 1787828112]  req@ffff9ee005705a40 x1874670272995328/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828137 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828112.532788:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705a40 x1874670272995328/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828137 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828112.532799:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828112.532803:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828112.532807:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272995328:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787828112.532814:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272995456:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787828112.532834:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828112.532845:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828112/real 1787828112]  req@ffff9ee005704780 x1874670272995456/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828137 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828112.532858:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704780 x1874670272995456/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828137 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828112.532868:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828112.532872:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828112.532877:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272995456:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787828112.532884:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272995584:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787828112.532904:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828112.532914:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828112/real 1787828112]  req@ffff9ee005707840 x1874670272995584/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828137 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828112.532928:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707840 x1874670272995584/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828137 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828112.532938:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828112.532941:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828112.532945:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272995584:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828113.363555:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828113.555518:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828114.387683:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828114.579443:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828115.411606:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828115.603411:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828116.435600:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828116.627592:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828117.459628:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1787828117.651425:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828117.651461:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787828117.651468:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828117.651494:0:8:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3281
00000100:00100000:2.0:1787828117.651509:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787828117.651511:0:8:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828117.651525:0:8:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787828117.651573:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704000 x1874670272995712/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828117.651612:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828117.651618:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787828117.651620:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828117.651625:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3281
00000100:00080000:3.0:1787828117.651630:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828117.651634:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828117.651648:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787828117.651665:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707c00 x1874670272995840/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828117.651683:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1787828117.651691:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272995712:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787828117.651694:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787828117.651704:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828117.651712:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3281
00000100:00080000:3.0:1787828117.651718:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828117.651723:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828117.651731:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787828117.651749:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057061c0 x1874670272995968/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828117.651763:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828117.651767:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787828117.651771:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828117.651777:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3281
00000100:00080000:3.0:1787828117.651804:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828117.651815:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828117.651826:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787828117.651864:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057070c0 x1874670272996096/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828117.651886:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1787828117.651894:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272995840:192.168.203.121@tcp:38:kworker.0
00000100:00080000:3.0:1787828117.651896:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787828117.651910:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828117.651922:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3281
00000100:00080000:3.0:1787828117.651930:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828117.651938:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828117.651949:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787828117.651961:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272995968:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787828117.651980:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057052c0 x1874670272996224/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787828117.652008:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272996096:192.168.203.121@tcp:8:kworker.0
00000100:00080000:3.0:1787828117.652016:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828117.652024:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787828117.652027:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828117.652038:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3281
00000100:00080000:3.0:1787828117.652048:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828117.652056:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787828117.652063:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272996224:192.168.203.121@tcp:38:kworker.0
00000008:00100000:3.0:1787828117.652064:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787828117.652095:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707480 x1874670272996352/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828117.652115:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828117.652121:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787828117.652123:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828117.652127:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3281
00000100:00080000:3.0:1787828117.652133:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828117.652154:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787828117.652159:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272996352:192.168.203.121@tcp:8:kworker.0
00000008:00100000:3.0:1787828117.652165:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787828117.652192:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706d00 x1874670272996480/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787828117.652253:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272996480:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828118.483638:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828118.675452:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828119.507557:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828119.699507:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828120.531593:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828120.723523:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000400:00000100:1.0:1787828120.723686:0:2353:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.203.121:988
00000400:00000100:1.0:1787828120.723725:0:2353:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.203.121@tcp at host 192.168.203.121 was unreachable: the network or that node may be down, or Lustre may be misconfigured.
00000800:00000100:1.0:1787828120.723742:0:2353:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:1.0:1787828120.723782:0:2353:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:1.0:1787828120.723793:0:2353:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:1.0:1787828120.723804:0:2353:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:1.0:1787828120.723819:0:2353:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:1.0:1787828120.723838:0:2353:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:1.0:1787828120.723860:0:2353:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000100:00100000:2.0:1787828120.723887:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828117/real 1787828120]  req@ffff9ee005707480 x1874670272996352/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828142 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828120.723946:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707480 x1874670272996352/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828142 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828120.723970:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828120.723980:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828120.723990:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272996352:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787828120.724006:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828117/real 1787828120]  req@ffff9ee0057052c0 x1874670272996224/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828142 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828120.724036:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057052c0 x1874670272996224/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828142 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828120.724064:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828120.724073:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828120.724080:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272996224:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787828120.724096:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828117/real 1787828120]  req@ffff9ee005707c00 x1874670272995840/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828142 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828120.724124:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707c00 x1874670272995840/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828142 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828120.724141:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828120.724148:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828120.724155:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272995840:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787828120.724168:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828117/real 1787828120]  req@ffff9ee0057061c0 x1874670272995968/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828142 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828120.724193:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057061c0 x1874670272995968/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828142 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828120.724209:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828120.724216:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828120.724246:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272995968:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787828120.724262:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828117/real 1787828120]  req@ffff9ee0057070c0 x1874670272996096/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828142 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828120.724287:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057070c0 x1874670272996096/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828142 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828120.724304:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828120.724311:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828120.724356:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272996096:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787828120.724370:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828117/real 1787828120]  req@ffff9ee005704000 x1874670272995712/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828142 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828120.724402:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704000 x1874670272995712/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828142 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828120.724458:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828120.724468:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828120.724477:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272995712:192.168.203.121@tcp:250:kworker.0
00000100:00100000:2.0:1787828120.724557:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828117/real 1787828120]  req@ffff9ee005706d00 x1874670272996480/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828142 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828120.724586:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706d00 x1874670272996480/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828142 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828120.724604:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828120.724611:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828120.724618:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272996480:192.168.203.121@tcp:8:kworker.0
00010000:00010000:3.0:1787828121.555664:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828121.747569:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828122.579572:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1787828122.771477:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1787828122.771489:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:0.0:1787828122.771491:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1787828122.771500:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828122.771516:0:8:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3286
00000100:00080000:0.0:1787828122.771531:0:8:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828122.771544:0:8:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787828122.771589:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8f00 x1874670272996608/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828122.771627:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828122.771632:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787828122.771635:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828122.771639:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3286
00000100:00080000:0.0:1787828122.771644:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828122.771651:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828122.771665:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787828122.771682:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ebc00 x1874670272996736/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787828122.771701:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272996608:192.168.203.121@tcp:250:kworker.0
00000100:00080000:0.0:1787828122.771708:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828122.771723:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787828122.771727:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828122.771736:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3286
00000100:00080000:0.0:1787828122.771745:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828122.771754:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828122.771778:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828122.771807:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e83c0 x1874670272996864/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1787828122.771815:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:0.0:1787828122.771839:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828122.771847:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787828122.771851:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828122.771863:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3286
00000100:00080000:0.0:1787828122.771872:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1787828122.771880:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828122/real 1787828122]  req@ffff9ee0056e8f00 x1874670272996608/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828147 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828122.771889:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828122.771904:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828122.771943:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8000 x1874670272996992/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787828122.771945:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8f00 x1874670272996608/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828147 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828122.772000:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828122.772004:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787828122.772011:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787828122.772021:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828122.772021:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828122.772037:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272996608:192.168.203.121@tcp:250:kworker.0
00000100:00080000:0.0:1787828122.772041:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3286
00000100:00080000:0.0:1787828122.772059:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828122.772073:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787828122.772096:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272996736:192.168.203.121@tcp:38:kworker.0
00000008:00100000:0.0:1787828122.772099:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787828122.772139:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb480 x1874670272997120/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828122.772162:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:2.0:1787828122.772164:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:0.0:1787828122.772177:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787828122.772182:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828122.772194:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3286
00000100:00080000:0.0:1787828122.772203:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1787828122.772205:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828122/real 1787828122]  req@ffff9ee0056ebc00 x1874670272996736/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828147 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828122.772222:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828122.772241:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828122.772255:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ebc00 x1874670272996736/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828147 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787828122.772274:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb840 x1874670272997248/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828122.772283:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828122.772303:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00080000:0.0:1787828122.772376:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828122.772386:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787828122.772419:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1787828122.772427:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272996736:192.168.203.121@tcp:38:kworker.0
00000100:00080000:0.0:1787828122.772436:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3286
00000100:00080000:0.0:1787828122.772452:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1787828122.772458:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272996864:192.168.203.121@tcp:8:kworker.0
00000100:00080000:0.0:1787828122.772470:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828122.772487:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828122.772516:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e92c0 x1874670272997376/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1787828122.772525:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828122.772565:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828122/real 1787828122]  req@ffff9ee0056e83c0 x1874670272996864/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828147 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828122.772596:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e83c0 x1874670272996864/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828147 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828122.772613:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828122.772619:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828122.772626:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272996864:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787828122.772640:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272996992:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787828122.772681:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828122.772705:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828122/real 1787828122]  req@ffff9ee0056e8000 x1874670272996992/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828147 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828122.772732:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8000 x1874670272996992/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828147 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828122.772747:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828122.772753:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828122.772761:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272996992:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787828122.772794:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272997120:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787828122.772837:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828122.772863:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828122/real 1787828122]  req@ffff9ee0056eb480 x1874670272997120/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828147 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828122.772890:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb480 x1874670272997120/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828147 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828122.772907:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828122.772914:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828122.772921:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272997120:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787828122.772935:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272997248:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787828122.772978:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828122.773002:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828122/real 1787828122]  req@ffff9ee0056eb840 x1874670272997248/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828147 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828122.773027:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb840 x1874670272997248/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828147 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828122.773056:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828122.773062:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828122.773068:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272997248:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787828122.773080:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272997376:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787828122.773144:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828122.773178:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828122/real 1787828122]  req@ffff9ee0056e92c0 x1874670272997376/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828147 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828122.773203:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e92c0 x1874670272997376/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828147 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828122.773220:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828122.773226:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828122.773233:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272997376:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828123.603538:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828123.795656:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828124.627601:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828124.819434:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828125.651552:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828125.843422:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828126.675555:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828126.867451:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828127.699629:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828127.891512:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787828127.891556:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828127.891568:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787828127.891575:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828127.891591:0:8:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3291
00000100:00080000:3.0:1787828127.891609:0:8:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828127.891621:0:8:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787828127.891680:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706940 x1874670272997504/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828127.891732:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828127.891739:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787828127.891744:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828127.891751:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3291
00000100:00080000:3.0:1787828127.891760:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828127.891768:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828127.891784:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787828127.891791:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272997504:192.168.203.121@tcp:250:kworker.0
00000100:00100000:3.0:1787828127.891808:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705680 x1874670272997632/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828127.891827:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828127.891834:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787828127.891837:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828127.891843:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3291
00000100:00080000:3.0:1787828127.891863:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828127.891870:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828127.891879:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:2.0:1787828127.891880:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787828127.891898:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706d00 x1874670272997760/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828127.891917:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828127.891922:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787828127.891925:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828127.891932:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3291
00000100:00080000:3.0:1787828127.891956:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828127.891963:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787828127.891972:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828127/real 1787828127]  req@ffff9ee005706940 x1874670272997504/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828152 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:3.0:1787828127.891972:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787828127.891995:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704000 x1874670272997888/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828127.892013:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1787828127.892019:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706940 x1874670272997504/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828152 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828127.892019:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787828127.892023:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828127.892031:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3291
00000100:00080000:3.0:1787828127.892037:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828127.892039:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787828127.892044:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00080000:2.0:1787828127.892047:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000008:00100000:3.0:1787828127.892052:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787828127.892055:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272997504:192.168.203.121@tcp:250:kworker.0
00000100:00100000:3.0:1787828127.892067:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057070c0 x1874670272998016/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828127.892083:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1787828127.892089:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272997632:192.168.203.121@tcp:38:kworker.0
00000100:00080000:3.0:1787828127.892090:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787828127.892093:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828127.892100:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3291
00000100:00080000:3.0:1787828127.892107:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828127.892113:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828127.892121:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:2.0:1787828127.892131:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787828127.892139:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057061c0 x1874670272998144/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787828127.892155:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828127/real 1787828127]  req@ffff9ee005705680 x1874670272997632/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828152 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828127.892156:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828127.892163:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787828127.892166:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828127.892173:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3291
00000100:00080000:3.0:1787828127.892179:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1787828127.892181:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705680 x1874670272997632/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828152 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828127.892186:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828127.892194:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:2.0:1787828127.892198:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828127.892205:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787828127.892211:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707c00 x1874670272998272/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787828127.892212:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272997632:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787828127.892224:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272997760:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787828127.892261:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828127.892284:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828127/real 1787828127]  req@ffff9ee005706d00 x1874670272997760/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828152 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828127.892308:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706d00 x1874670272997760/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828152 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828127.892399:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828127.892404:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828127.892409:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272997760:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787828127.892417:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272997888:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787828127.892448:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828127.892464:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828127/real 1787828127]  req@ffff9ee005704000 x1874670272997888/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828152 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828127.892478:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704000 x1874670272997888/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828152 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828127.892488:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828127.892492:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828127.892496:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272997888:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787828127.892503:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272998016:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787828127.892521:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828127.892533:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828127/real 1787828127]  req@ffff9ee0057070c0 x1874670272998016/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828152 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828127.892546:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057070c0 x1874670272998016/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828152 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828127.892567:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828127.892570:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828127.892575:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272998016:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787828127.892597:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272998144:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787828127.892617:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828127.892646:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828127/real 1787828127]  req@ffff9ee0057061c0 x1874670272998144/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828152 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828127.892660:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057061c0 x1874670272998144/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828152 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828127.892670:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828127.892674:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828127.892678:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272998144:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787828127.892685:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272998272:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787828127.892704:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828127.892715:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828127/real 1787828127]  req@ffff9ee005707c00 x1874670272998272/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828152 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828127.892729:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707c00 x1874670272998272/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828152 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828127.892738:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828127.892741:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828127.892745:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272998272:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828128.723597:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828128.915492:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828129.747650:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828129.939515:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828130.771641:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828130.963452:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828131.795560:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828131.987462:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828132.819597:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1787828133.011466:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828133.011480:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00100000:2.0:1787828133.011483:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787828133.011487:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828133.011507:0:8:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3296
00000100:00080000:3.0:1787828133.011522:0:8:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828133.011532:0:8:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787828133.011593:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057052c0 x1874670272998400/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828133.011653:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828133.011658:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787828133.011661:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828133.011666:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3296
00000100:00080000:3.0:1787828133.011672:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828133.011680:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828133.011694:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787828133.011713:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272998400:192.168.203.121@tcp:250:kworker.0
00000100:00100000:3.0:1787828133.011714:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707480 x1874670272998528/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828133.011760:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828133.011766:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787828133.011769:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828133.011777:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3296
00000100:00080000:3.0:1787828133.011784:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828133.011789:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828133.011796:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787828133.011814:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707840 x1874670272998656/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828133.011827:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828133.011832:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787828133.011834:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828133.011842:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3296
00000800:00000100:2.0:1787828133.011843:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787828133.011856:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828133.011863:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828133.011870:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787828133.011886:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704780 x1874670272998784/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828133.011900:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828133.011904:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787828133.011909:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828133.011917:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3296
00000100:00080000:3.0:1787828133.011925:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828133.011936:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787828133.011942:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828133/real 1787828133]  req@ffff9ee0057052c0 x1874670272998400/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828158 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:3.0:1787828133.011956:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787828133.012003:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705a40 x1874670272998912/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787828133.012012:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057052c0 x1874670272998400/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828158 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828133.012077:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828133.012083:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787828133.012087:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787828133.012095:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828133.012096:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828133.012109:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272998400:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787828133.012138:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3296
00000100:00080000:3.0:1787828133.012150:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828133.012161:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828133.012173:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828133.012174:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272998528:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787828133.012204:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705e00 x1874670272999040/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1787828133.012230:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787828133.012233:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828133.012239:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787828133.012244:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828133.012251:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3296
00000100:00100000:2.0:1787828133.012259:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828133/real 1787828133]  req@ffff9ee005707480 x1874670272998528/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828158 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828133.012261:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828133.012278:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828133.012296:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828133.012307:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707480 x1874670272998528/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828158 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828133.012319:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828133.012382:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828133.012385:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272998528:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787828133.012399:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272998656:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787828133.012407:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704b40 x1874670272999168/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1787828133.012446:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828133.012467:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828133/real 1787828133]  req@ffff9ee005707840 x1874670272998656/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828158 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828133.012478:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707840 x1874670272998656/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828158 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828133.012485:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828133.012488:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828133.012491:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272998656:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787828133.012497:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272998784:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787828133.012510:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828133.012517:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828133/real 1787828133]  req@ffff9ee005704780 x1874670272998784/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828158 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828133.012527:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704780 x1874670272998784/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828158 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828133.012537:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828133.012541:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828133.012545:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272998784:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787828133.012570:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272998912:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787828133.012597:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828133.012611:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828133/real 1787828133]  req@ffff9ee005705a40 x1874670272998912/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828158 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828133.012624:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705a40 x1874670272998912/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828158 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828133.012631:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828133.012634:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828133.012636:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272998912:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787828133.012654:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272999040:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787828133.012671:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828133.012680:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828133/real 1787828133]  req@ffff9ee005705e00 x1874670272999040/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828158 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828133.012690:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705e00 x1874670272999040/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828158 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828133.012696:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828133.012699:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828133.012702:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272999040:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787828133.012707:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272999168:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787828133.012719:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828133.012726:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828133/real 1787828133]  req@ffff9ee005704b40 x1874670272999168/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828158 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828133.012734:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704b40 x1874670272999168/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828158 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828133.012747:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828133.012750:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828133.012753:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272999168:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828133.843610:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828134.035432:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828134.867578:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828135.059415:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828135.891642:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828136.083513:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828136.915564:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828137.107472:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828137.939598:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828138.131477:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:2.0:1787828138.131502:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828138.131514:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787828138.131522:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828138.131537:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3301
00000100:00080000:2.0:1787828138.131553:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828138.131566:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787828138.131617:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729680 x1874670272999296/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828138.131652:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828138.131657:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787828138.131659:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828138.131664:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3301
00000100:00080000:2.0:1787828138.131670:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828138.131675:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828138.131687:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787828138.131701:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272999296:192.168.203.121@tcp:250:kworker.0
00000100:00100000:2.0:1787828138.131707:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057292c0 x1874670272999424/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828138.131723:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828138.131726:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787828138.131729:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828138.131735:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3301
00000100:00080000:2.0:1787828138.131741:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828138.131748:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828138.131757:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828138.131793:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572bc00 x1874670272999552/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1787828138.131804:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:2.0:1787828138.131816:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828138.131823:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787828138.131826:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828138.131831:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3301
00000100:00080000:2.0:1787828138.131837:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828138.131841:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828138.131847:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787828138.131884:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828138/real 1787828138]  req@ffff9ee005729680 x1874670272999296/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828163 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828138.131900:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728780 x1874670272999680/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828138.131912:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729680 x1874670272999296/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828163 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828138.131917:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828138.131930:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787828138.131938:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787828138.131945:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828138.131946:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3301
00000100:00080000:2.0:1787828138.131957:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828138.131958:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:2.0:1787828138.131973:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787828138.131974:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670272999296:192.168.203.121@tcp:250:kworker.0
00000008:00100000:2.0:1787828138.131987:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787828138.132019:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a940 x1874670272999808/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828138.132028:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057292c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272999424:192.168.203.121@tcp:38:kworker.0
00000100:00080000:2.0:1787828138.132033:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828138.132038:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787828138.132041:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828138.132046:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3301
00000100:00080000:2.0:1787828138.132051:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828138.132056:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000800:00000100:1.0:1787828138.132062:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000008:00100000:2.0:1787828138.132065:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787828138.132081:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828138/real 1787828138]  req@ffff9ee0057292c0 x1874670272999424/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828163 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828138.132083:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729e00 x1874670272999936/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828138.132128:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1787828138.132133:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057292c0 x1874670272999424/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828163 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828138.132134:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787828138.132139:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828138.132150:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3301
00000100:00080000:1.0:1787828138.132173:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828138.132175:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828138.132183:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00080000:2.0:1787828138.132186:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787828138.132194:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057292c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272999424:192.168.203.121@tcp:38:kworker.0
00000008:00100000:2.0:1787828138.132197:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787828138.132206:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272999552:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787828138.132216:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a1c0 x1874670273000064/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1787828138.132237:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828138.132255:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828138/real 1787828138]  req@ffff9ee00572bc00 x1874670272999552/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828163 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828138.132269:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572bc00 x1874670272999552/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828163 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828138.132278:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828138.132282:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828138.132327:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272999552:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828138.132356:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272999680:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828138.132393:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828138.132407:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828138/real 1787828138]  req@ffff9ee005728780 x1874670272999680/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828163 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828138.132420:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728780 x1874670272999680/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828163 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828138.132429:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828138.132433:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828138.132436:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670272999680:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828138.132454:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272999808:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787828138.132472:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828138.132483:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828138/real 1787828138]  req@ffff9ee00572a940 x1874670272999808/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828163 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828138.132495:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a940 x1874670272999808/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828163 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828138.132503:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828138.132506:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828138.132509:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272999808:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828138.132515:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272999936:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828138.132531:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828138.132540:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828138/real 1787828138]  req@ffff9ee005729e00 x1874670272999936/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828163 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828138.132552:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729e00 x1874670272999936/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828163 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828138.132560:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828138.132562:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828138.132565:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670272999936:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828138.132571:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273000064:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828138.132585:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828138.132594:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828138/real 1787828138]  req@ffff9ee00572a1c0 x1874670273000064/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828163 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828138.132605:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a1c0 x1874670273000064/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828163 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828138.132613:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828138.132617:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828138.132620:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273000064:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828138.963566:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828139.155426:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828139.987443:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828140.179368:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828141.011590:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828141.203435:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828142.035548:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828142.227431:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828143.059484:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828143.251513:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:0.0:1787828143.251549:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828143.251562:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1787828143.251570:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828143.251599:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3306
00000100:00080000:0.0:1787828143.251617:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828143.251630:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787828143.251699:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8b40 x1874670273000192/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828143.251741:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828143.251748:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787828143.251751:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828143.251758:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3306
00000100:00080000:0.0:1787828143.251766:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828143.251774:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828143.251787:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787828143.251806:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273000192:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787828143.251814:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9e00 x1874670273000320/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828143.251850:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828143.251856:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787828143.251860:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828143.251866:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3306
00000100:00080000:0.0:1787828143.251874:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828143.251882:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000800:00000100:2.0:1787828143.251888:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000008:00100000:0.0:1787828143.251896:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828143.251921:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8780 x1874670273000448/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787828143.251935:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828143/real 1787828143]  req@ffff9ee0056e8b40 x1874670273000192/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828168 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828143.251941:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828143.251964:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787828143.251968:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1787828143.251974:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8b40 x1874670273000192/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828168 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828143.252006:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787828143.252011:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3306
00000100:00080000:2.0:1787828143.252018:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:0.0:1787828143.252029:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1787828143.252030:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273000192:192.168.203.121@tcp:250:kworker.0
00000100:00080000:0.0:1787828143.252046:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828143.252058:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828143.252069:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273000320:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787828143.252087:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9680 x1874670273000576/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1787828143.252108:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:0.0:1787828143.252114:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828143.252124:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787828143.252129:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1787828143.252131:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828143/real 1787828143]  req@ffff9ee0056e9e00 x1874670273000320/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828168 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828143.252145:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3306
00000100:00080000:0.0:1787828143.252159:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1787828143.252160:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9e00 x1874670273000320/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828168 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828143.252178:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00080000:2.0:1787828143.252181:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828143.252196:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000008:00100000:0.0:1787828143.252200:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787828143.252201:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273000320:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787828143.252223:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273000448:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787828143.252238:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9a40 x1874670273000704/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828143.252284:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:2.0:1787828143.252305:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:0.0:1787828143.252320:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787828143.252325:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1787828143.252327:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828143/real 1787828143]  req@ffff9ee0056e8780 x1874670273000448/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828168 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828143.252393:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8780 x1874670273000448/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828168 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828143.252415:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3306
00000100:00080000:2.0:1787828143.252416:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787828143.252431:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828143.252433:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00080000:0.0:1787828143.252452:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787828143.252454:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273000448:192.168.203.121@tcp:8:kworker.0
00000008:00100000:0.0:1787828143.252471:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828143.252497:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273000576:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787828143.252503:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ead00 x1874670273000832/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828143.252530:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828143.252540:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000800:00000100:2.0:1787828143.252541:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:0.0:1787828143.252551:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828143.252567:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3306
00000100:00100000:2.0:1787828143.252569:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828143/real 1787828143]  req@ffff9ee0056e9680 x1874670273000576/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828168 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828143.252594:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1787828143.252606:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9680 x1874670273000576/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828168 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828143.252611:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828143.252627:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:2.0:1787828143.252635:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828143.252648:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787828143.252666:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ea580 x1874670273000960/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787828143.252675:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273000576:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787828143.252716:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273000704:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787828143.252766:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828143.252787:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828143/real 1787828143]  req@ffff9ee0056e9a40 x1874670273000704/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828168 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828143.252809:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9a40 x1874670273000704/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828168 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828143.252818:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828143.252821:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828143.252824:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273000704:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787828143.252841:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273000832:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787828143.252864:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828143.252875:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828143/real 1787828143]  req@ffff9ee0056ead00 x1874670273000832/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828168 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828143.252886:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ead00 x1874670273000832/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828168 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828143.252894:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828143.252898:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828143.252901:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273000832:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787828143.252906:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273000960:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787828143.252920:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828143.252929:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828143/real 1787828143]  req@ffff9ee0056ea580 x1874670273000960/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828168 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828143.252939:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ea580 x1874670273000960/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828168 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828143.252984:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828143.252988:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828143.252991:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273000960:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828144.083512:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828144.275396:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828145.107444:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828145.299406:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828146.131550:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828146.323466:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828147.155559:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828147.347503:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828148.179540:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828148.371481:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:1.0:1787828148.371482:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828148.371547:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1787828148.371555:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787828148.371569:0:8:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3312
00000100:00080000:1.0:1787828148.371584:0:8:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828148.371593:0:8:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787828148.371650:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a03c0 x1874670273001088/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787828148.371680:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828148.371687:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787828148.371690:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787828148.371697:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3312
00000100:00080000:1.0:1787828148.371704:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828148.371711:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787828148.371725:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787828148.371737:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273001088:192.168.203.121@tcp:250:kworker.0
00000100:00100000:1.0:1787828148.371745:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a12c0 x1874670273001216/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787828148.371762:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828148.371767:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787828148.371769:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787828148.371775:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3312
00000100:00080000:1.0:1787828148.371795:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828148.371800:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787828148.371806:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787828148.371818:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1a40 x1874670273001344/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787828148.371830:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:2.0:1787828148.371832:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:1.0:1787828148.371835:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787828148.371838:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787828148.371842:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3312
00000100:00080000:1.0:1787828148.371846:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828148.371851:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787828148.371857:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787828148.371869:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a3c00 x1874670273001472/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787828148.371883:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828148.371888:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787828148.371890:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787828148.371896:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3312
00000100:00080000:1.0:1787828148.371901:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828148.371907:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787828148.371913:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787828148.371918:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828148/real 1787828148]  req@ffff9ee0056a03c0 x1874670273001088/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828173 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828148.371929:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a2940 x1874670273001600/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787828148.371942:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1787828148.371947:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a03c0 x1874670273001088/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828173 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828148.371948:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787828148.371951:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787828148.371957:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3312
00000100:00080000:1.0:1787828148.371962:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828148.371962:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828148.371967:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00080000:2.0:1787828148.371968:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000008:00100000:1.0:1787828148.371973:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828148.371974:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273001088:192.168.203.121@tcp:250:kworker.0
00000100:00100000:1.0:1787828148.371985:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1680 x1874670273001728/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787828148.371997:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828148.372001:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787828148.372004:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1787828148.372004:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273001216:192.168.203.121@tcp:38:kworker.0
00000100:00080000:1.0:1787828148.372009:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3312
00000100:00080000:1.0:1787828148.372014:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828148.372019:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787828148.372025:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:2.0:1787828148.372036:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828148.372038:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0f00 x1874670273001856/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787828148.372055:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828148/real 1787828148]  req@ffff9ee0056a12c0 x1874670273001216/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828173 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828148.372107:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a12c0 x1874670273001216/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828173 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828148.372124:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828148.372130:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828148.372136:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273001216:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787828148.372148:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273001344:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787828148.372188:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828148.372205:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828148/real 1787828148]  req@ffff9ee0056a1a40 x1874670273001344/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828173 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828148.372268:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1a40 x1874670273001344/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828173 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828148.372277:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828148.372280:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828148.372283:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273001344:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787828148.372290:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273001472:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787828148.372311:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828148.372321:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828148/real 1787828148]  req@ffff9ee0056a3c00 x1874670273001472/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828173 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828148.372356:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a3c00 x1874670273001472/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828173 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828148.372370:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828148.372373:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828148.372375:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273001472:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787828148.372381:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273001600:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787828148.372399:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828148.372409:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828148/real 1787828148]  req@ffff9ee0056a2940 x1874670273001600/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828173 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828148.372420:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a2940 x1874670273001600/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828173 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828148.372427:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828148.372430:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828148.372433:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273001600:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787828148.372438:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273001728:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787828148.372452:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828148.372460:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828148/real 1787828148]  req@ffff9ee0056a1680 x1874670273001728/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828173 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828148.372470:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1680 x1874670273001728/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828173 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828148.372477:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828148.372480:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828148.372483:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273001728:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787828148.372503:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273001856:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787828148.372518:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828148.372527:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828148/real 1787828148]  req@ffff9ee0056a0f00 x1874670273001856/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828173 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828148.372537:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0f00 x1874670273001856/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828173 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828148.372544:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828148.372547:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828148.372550:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273001856:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828149.203563:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828149.395396:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828150.227583:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828150.419400:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828151.251514:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828151.443427:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828152.275572:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828152.467428:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828153.299567:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1787828153.491457:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828153.491468:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1787828153.491472:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787828153.491484:0:8:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3317
00000100:00080000:1.0:1787828153.491497:0:8:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828153.491505:0:8:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787828153.491543:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a21c0 x1874670273001984/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787828153.491568:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828153.491572:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787828153.491574:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787828153.491578:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3317
00000100:00080000:1.0:1787828153.491582:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828153.491586:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787828153.491596:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787828153.491605:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273001984:192.168.203.121@tcp:250:kworker.0
00000100:00100000:1.0:1787828153.491633:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0f00 x1874670273002112/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787828153.491651:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828153.491655:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787828153.491658:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787828153.491664:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3317
00000100:00080000:1.0:1787828153.491670:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828153.491675:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787828153.491683:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787828153.491699:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1680 x1874670273002240/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787828153.491713:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828153.491717:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787828153.491719:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:2.0:1787828153.491729:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:1.0:1787828153.491730:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3317
00000100:00080000:1.0:1787828153.491742:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828153.491747:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787828153.491754:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787828153.491769:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a2940 x1874670273002368/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787828153.491782:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828153.491786:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787828153.491789:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787828153.491800:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3317
00000100:00100000:2.0:1787828153.491803:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828153/real 1787828153]  req@ffff9ee0056a21c0 x1874670273001984/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828178 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828153.491805:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828153.491821:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787828153.491839:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787828153.491846:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a21c0 x1874670273001984/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828178 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828153.491881:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:1.0:1787828153.491884:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a3c00 x1874670273002496/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828153.491890:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828153.491900:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273001984:192.168.203.121@tcp:250:kworker.0
00000100:00080000:1.0:1787828153.491918:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828153.491924:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787828153.491928:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1787828153.491933:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273002112:192.168.203.121@tcp:38:kworker.0
00000100:00080000:1.0:1787828153.491941:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3317
00000100:00080000:1.0:1787828153.491948:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828153.491953:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787828153.491978:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:2.0:1787828153.491997:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828153.492018:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1a40 x1874670273002624/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787828153.492032:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828153/real 1787828153]  req@ffff9ee0056a0f00 x1874670273002112/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828178 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828153.492042:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828153.492058:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787828153.492065:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787828153.492077:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3317
00000100:00080000:1.0:1787828153.492086:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828153.492093:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787828153.492099:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0f00 x1874670273002112/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828178 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:1.0:1787828153.492103:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:2.0:1787828153.492125:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:1.0:1787828153.492132:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a12c0 x1874670273002752/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828153.492138:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828153.492152:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273002112:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787828153.492174:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273002240:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787828153.492253:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828153.492266:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828153/real 1787828153]  req@ffff9ee0056a1680 x1874670273002240/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828178 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828153.492279:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1680 x1874670273002240/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828178 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828153.492306:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828153.492311:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828153.492315:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273002240:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787828153.492323:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273002368:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787828153.492411:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828153.492451:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828153/real 1787828153]  req@ffff9ee0056a2940 x1874670273002368/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828178 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828153.492460:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00100000:2.0:1787828153.492479:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a2940 x1874670273002368/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828178 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828153.492490:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828153.492496:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828153.492501:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273002368:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787828153.492511:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273002496:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787828153.492543:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828153.492561:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828153/real 1787828153]  req@ffff9ee0056a3c00 x1874670273002496/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828178 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828153.492576:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a3c00 x1874670273002496/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828178 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828153.492584:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828153.492588:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828153.492591:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273002496:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787828153.492645:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273002624:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787828153.492684:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828153.492708:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828153/real 1787828153]  req@ffff9ee0056a1a40 x1874670273002624/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828178 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828153.492749:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1a40 x1874670273002624/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828178 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828153.492760:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828153.492764:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828153.492768:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273002624:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787828153.492776:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273002752:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787828153.492804:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828153.492818:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828153/real 1787828153]  req@ffff9ee0056a12c0 x1874670273002752/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828178 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828153.492840:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a12c0 x1874670273002752/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828178 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828153.492850:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828153.492854:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828153.492858:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273002752:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828154.323588:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828154.515441:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828155.347561:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828155.539423:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828156.371577:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828156.563435:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828157.395539:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828157.587457:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828158.419512:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828158.611415:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:1.0:1787828158.611439:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828158.611449:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1787828158.611455:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787828158.611468:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3322
00000100:00080000:1.0:1787828158.611484:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828158.611493:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787828158.611541:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a03c0 x1874670273002880/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787828158.611580:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828158.611585:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787828158.611588:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787828158.611593:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3322
00000100:00080000:1.0:1787828158.611597:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828158.611603:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787828158.611616:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787828158.611633:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273002880:192.168.203.121@tcp:250:kworker.0
00000100:00100000:1.0:1787828158.611637:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1e00 x1874670273003008/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787828158.611666:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828158.611671:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787828158.611674:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787828158.611680:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3322
00000100:00080000:1.0:1787828158.611684:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828158.611690:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787828158.611699:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787828158.611722:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0b40 x1874670273003136/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1787828158.611740:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:1.0:1787828158.611751:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828158.611778:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787828158.611783:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787828158.611793:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3322
00000100:00080000:1.0:1787828158.611804:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1787828158.611811:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828158/real 1787828158]  req@ffff9ee0056a03c0 x1874670273002880/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828183 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828158.611828:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787828158.611845:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828158.611854:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a03c0 x1874670273002880/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828183 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828158.611874:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a2580 x1874670273003264/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828158.611898:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828158.611902:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828158.611909:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:1.0:1787828158.611913:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787828158.611920:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1787828158.611921:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273002880:192.168.203.121@tcp:250:kworker.0
00000100:00080000:1.0:1787828158.611936:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3322
00000100:00080000:1.0:1787828158.611945:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828158.611953:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787828158.611963:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273003008:192.168.203.121@tcp:38:kworker.0
00000008:00100000:1.0:1787828158.611964:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787828158.612003:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a3480 x1874670273003392/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1787828158.612021:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:1.0:1787828158.612038:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828158.612048:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00100000:2.0:1787828158.612049:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828158/real 1787828158]  req@ffff9ee0056a1e00 x1874670273003008/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828183 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828158.612055:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787828158.612073:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3322
00000100:00080000:1.0:1787828158.612084:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1787828158.612085:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1e00 x1874670273003008/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828183 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828158.612099:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00080000:2.0:1787828158.612113:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000008:00100000:1.0:1787828158.612117:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:2.0:1787828158.612124:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828158.612133:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273003008:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787828158.612171:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273003136:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828158.612179:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0780 x1874670273003520/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787828158.612206:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828158.612212:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787828158.612218:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:2.0:1787828158.612221:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:1.0:1787828158.612228:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3322
00000100:00080000:1.0:1787828158.612237:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828158.612245:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787828158.612253:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828158.612262:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828158/real 1787828158]  req@ffff9ee0056a0b40 x1874670273003136/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828183 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828158.612277:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0000 x1874670273003648/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787828158.612380:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0b40 x1874670273003136/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828183 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828158.612394:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828158.612401:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828158.612406:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273003136:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787828158.612416:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273003264:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787828158.612447:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828158.612462:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828158/real 1787828158]  req@ffff9ee0056a2580 x1874670273003264/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828183 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828158.612476:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a2580 x1874670273003264/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828183 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828158.612486:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828158.612490:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828158.612494:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273003264:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787828158.612517:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273003392:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787828158.612537:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828158.612549:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828158/real 1787828158]  req@ffff9ee0056a3480 x1874670273003392/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828183 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828158.612562:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a3480 x1874670273003392/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828183 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828158.612581:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828158.612585:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828158.612589:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273003392:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787828158.612596:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273003520:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787828158.612613:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828158.612623:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828158/real 1787828158]  req@ffff9ee0056a0780 x1874670273003520/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828183 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828158.612637:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0780 x1874670273003520/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828183 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828158.612647:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828158.612650:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828158.612654:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273003520:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787828158.612660:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273003648:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787828158.612677:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828158.612687:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828158/real 1787828158]  req@ffff9ee0056a0000 x1874670273003648/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828183 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828158.612700:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0000 x1874670273003648/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828183 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828158.612709:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828158.612713:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828158.612718:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273003648:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828159.443533:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828159.635473:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828160.467595:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828160.659470:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828161.491615:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828161.683440:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828162.515542:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828162.707454:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828163.539530:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828163.731474:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:1.0:1787828163.731475:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828163.731507:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1787828163.731513:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787828163.731527:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3327
00000100:00080000:1.0:1787828163.731542:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828163.731554:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787828163.731612:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a30c0 x1874670273003776/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787828163.731675:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828163.731682:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787828163.731686:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787828163.731694:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3327
00000100:00080000:1.0:1787828163.731700:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828163.731706:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787828163.731717:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273003776:192.168.203.121@tcp:250:kworker.0
00000008:00100000:1.0:1787828163.731721:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787828163.731746:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0000 x1874670273003904/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787828163.731761:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828163.731765:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787828163.731768:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787828163.731773:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3327
00000100:00080000:1.0:1787828163.731777:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828163.731782:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787828163.731788:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:2.0:1787828163.731800:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828163.731805:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0780 x1874670273004032/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787828163.731820:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828163.731824:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787828163.731826:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787828163.731829:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3327
00000100:00080000:1.0:1787828163.731834:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828163.731838:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787828163.731843:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787828163.731856:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a3480 x1874670273004160/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787828163.731865:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828163.731869:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787828163.731872:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1787828163.731879:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828163/real 1787828163]  req@ffff9ee0056a30c0 x1874670273003776/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828188 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828163.731881:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3327
00000100:00080000:1.0:1787828163.731910:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828163.731925:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787828163.731935:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787828163.731946:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a30c0 x1874670273003776/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828188 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828163.731973:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a2580 x1874670273004288/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787828163.731995:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828163.732007:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787828163.732009:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828163.732013:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828163.732016:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3327
00000100:00080000:1.0:1787828163.732045:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828163.732049:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:1.0:1787828163.732057:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787828163.732065:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828163.732071:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273003776:192.168.203.121@tcp:250:kworker.0
00000100:00100000:1.0:1787828163.732083:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0b40 x1874670273004416/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787828163.732099:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828163.732103:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787828163.732137:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787828163.732150:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3327
00000100:00100000:2.0:1787828163.732152:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273003904:192.168.203.121@tcp:38:kworker.0
00000100:00080000:1.0:1787828163.732157:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828163.732171:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787828163.732179:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787828163.732201:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1e00 x1874670273004544/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1787828163.732227:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828163.732258:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828163/real 1787828163]  req@ffff9ee0056a0000 x1874670273003904/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828188 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828163.732277:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0000 x1874670273003904/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828188 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828163.732289:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828163.732295:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828163.732300:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273003904:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787828163.732308:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273004032:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787828163.732372:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828163.732388:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828163/real 1787828163]  req@ffff9ee0056a0780 x1874670273004032/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828188 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828163.732420:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0780 x1874670273004032/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828188 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828163.732430:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828163.732434:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828163.732437:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273004032:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787828163.732444:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273004160:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787828163.732463:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828163.732473:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828163/real 1787828163]  req@ffff9ee0056a3480 x1874670273004160/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828188 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828163.732505:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a3480 x1874670273004160/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828188 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828163.732514:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828163.732518:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828163.732522:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273004160:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787828163.732529:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273004288:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787828163.732550:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828163.732562:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828163/real 1787828163]  req@ffff9ee0056a2580 x1874670273004288/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828188 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828163.732576:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a2580 x1874670273004288/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828188 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828163.732586:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828163.732589:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828163.732593:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273004288:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787828163.732600:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273004416:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787828163.732618:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828163.732629:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828163/real 1787828163]  req@ffff9ee0056a0b40 x1874670273004416/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828188 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828163.732642:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0b40 x1874670273004416/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828188 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828163.732651:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828163.732655:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828163.732658:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273004416:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787828163.732701:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273004544:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787828163.732719:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828163.732729:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828163/real 1787828163]  req@ffff9ee0056a1e00 x1874670273004544/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828188 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828163.732750:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1e00 x1874670273004544/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828188 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828163.732758:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828163.732761:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828163.732764:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273004544:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828164.563564:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828164.755467:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828165.587530:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828165.779461:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828166.611488:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828166.803438:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828167.635571:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828167.827436:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828168.659586:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1787828168.851407:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828168.851417:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1787828168.851422:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787828168.851432:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3332
00000100:00100000:2.0:1787828168.851438:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:1.0:1787828168.851443:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828168.851453:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787828168.851490:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a03c0 x1874670273004672/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787828168.851517:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828168.851520:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787828168.851522:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787828168.851525:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3332
00000100:00080000:1.0:1787828168.851528:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828168.851531:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787828168.851541:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787828168.851553:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a12c0 x1874670273004800/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787828168.851563:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1787828168.851567:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273004672:192.168.203.121@tcp:250:kworker.0
00000100:00080000:1.0:1787828168.851568:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787828168.851573:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787828168.851582:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3332
00000100:00080000:1.0:1787828168.851585:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828168.851588:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787828168.851594:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787828168.851605:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1a40 x1874670273004928/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787828168.851614:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828168.851617:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787828168.851619:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787828168.851622:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3332
00000100:00080000:1.0:1787828168.851626:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828168.851629:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787828168.851633:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:2.0:1787828168.851643:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828168.851645:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a3c00 x1874670273005056/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787828168.851656:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828168.851659:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787828168.851661:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787828168.851665:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3332
00000100:00080000:1.0:1787828168.851668:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828168.851671:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787828168.851675:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787828168.851685:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a2940 x1874670273005184/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787828168.851695:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828168/real 1787828168]  req@ffff9ee0056a03c0 x1874670273004672/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828193 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828168.851702:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828168.851718:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00100000:2.0:1787828168.851727:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a03c0 x1874670273004672/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828193 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828168.851736:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828168.851740:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828168.851748:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3332
00000100:00080000:2.0:1787828168.851749:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828168.851758:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273004672:192.168.203.121@tcp:250:kworker.0
00000100:00080000:1.0:1787828168.851761:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828168.851771:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787828168.851780:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828168.851786:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273004800:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828168.851807:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1680 x1874670273005312/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1787828168.851816:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828168.851833:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828168/real 1787828168]  req@ffff9ee0056a12c0 x1874670273004800/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828193 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828168.851834:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828168.851847:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787828168.851854:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1787828168.851866:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a12c0 x1874670273004800/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828193 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828168.851889:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828168.851892:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3332
00000100:00080000:2.0:1787828168.851896:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828168.851903:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273004800:192.168.203.121@tcp:38:kworker.0
00000100:00080000:1.0:1787828168.851904:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1787828168.851912:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273004928:192.168.203.121@tcp:8:kworker.0
00000100:00080000:1.0:1787828168.851917:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787828168.851929:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:2.0:1787828168.851936:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828168.851948:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828168/real 1787828168]  req@ffff9ee0056a1a40 x1874670273004928/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828193 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828168.851955:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0f00 x1874670273005440/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787828168.851970:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1a40 x1874670273004928/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828193 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828168.851985:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828168.851989:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828168.851993:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273004928:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787828168.851998:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273005056:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787828168.852014:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828168.852022:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828168/real 1787828168]  req@ffff9ee0056a3c00 x1874670273005056/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828193 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828168.852031:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a3c00 x1874670273005056/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828193 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828168.852043:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828168.852046:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828168.852049:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273005056:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787828168.852053:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273005184:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787828168.852065:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828168.852090:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828168/real 1787828168]  req@ffff9ee0056a2940 x1874670273005184/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828193 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828168.852102:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a2940 x1874670273005184/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828193 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828168.852117:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828168.852120:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828168.852123:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273005184:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787828168.852140:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273005312:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787828168.852158:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828168.852168:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828168/real 1787828168]  req@ffff9ee0056a1680 x1874670273005312/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828193 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828168.852185:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1680 x1874670273005312/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828193 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828168.852192:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828168.852195:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828168.852198:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273005312:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787828168.852203:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273005440:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787828168.852216:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828168.852223:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828168/real 1787828168]  req@ffff9ee0056a0f00 x1874670273005440/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828193 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828168.852232:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0f00 x1874670273005440/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828193 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828168.852239:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828168.852241:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828168.852243:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273005440:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828169.683604:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828169.875439:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828170.707607:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828170.899456:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828171.731650:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828171.923385:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828172.755526:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828172.947364:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828173.779595:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828173.971403:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:1.0:1787828173.971412:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828173.971420:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1787828173.971424:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787828173.971435:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3337
00000100:00080000:1.0:1787828173.971471:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828173.971479:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787828173.971513:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a21c0 x1874670273005568/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787828173.971534:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828173.971537:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787828173.971539:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787828173.971542:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3337
00000100:00080000:1.0:1787828173.971544:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828173.971547:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787828173.971556:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787828173.971567:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0f00 x1874670273005696/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787828173.971574:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273005568:192.168.203.121@tcp:250:kworker.0
00000100:00080000:1.0:1787828173.971580:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828173.971584:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787828173.971585:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787828173.971589:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3337
00000100:00080000:1.0:1787828173.971590:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828173.971593:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787828173.971598:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787828173.971605:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1680 x1874670273005824/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787828173.971617:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828173.971620:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787828173.971622:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787828173.971624:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3337
00000100:00080000:1.0:1787828173.971630:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828173.971632:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787828173.971635:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:2.0:1787828173.971641:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828173.971645:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a2940 x1874670273005952/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787828173.971654:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828173.971657:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787828173.971658:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787828173.971661:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3337
00000100:00080000:1.0:1787828173.971664:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828173.971667:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787828173.971670:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787828173.971677:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a3c00 x1874670273006080/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787828173.971685:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828173.971688:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787828173.971693:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1787828173.971694:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828173/real 1787828173]  req@ffff9ee0056a21c0 x1874670273005568/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828198 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828173.971697:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3337
00000100:00080000:1.0:1787828173.971703:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828173.971709:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787828173.971716:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787828173.971728:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1a40 x1874670273006208/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787828173.971733:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a21c0 x1874670273005568/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828198 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828173.971737:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828173.971744:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787828173.971749:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787828173.971758:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3337
00000100:00080000:2.0:1787828173.971760:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828173.971761:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828173.971768:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00080000:2.0:1787828173.971771:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000008:00100000:1.0:1787828173.971773:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828173.971778:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273005568:192.168.203.121@tcp:250:kworker.0
00000100:00100000:1.0:1787828173.971784:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a12c0 x1874670273006336/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787828173.971806:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273005696:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787828173.971830:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828173.971841:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828173/real 1787828173]  req@ffff9ee0056a0f00 x1874670273005696/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828198 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828173.971850:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0f00 x1874670273005696/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828198 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828173.971856:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828173.971859:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828173.971862:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273005696:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787828173.971866:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273005824:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787828173.971878:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828173.971885:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828173/real 1787828173]  req@ffff9ee0056a1680 x1874670273005824/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828198 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828173.971894:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1680 x1874670273005824/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828198 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828173.971899:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828173.971901:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828173.971903:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273005824:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787828173.971907:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273005952:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787828173.971918:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828173.971925:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828173/real 1787828173]  req@ffff9ee0056a2940 x1874670273005952/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828198 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828173.971933:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a2940 x1874670273005952/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828198 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828173.971956:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828173.971959:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828173.971961:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273005952:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787828173.971965:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273006080:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787828173.971978:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828173.971985:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828173/real 1787828173]  req@ffff9ee0056a3c00 x1874670273006080/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828198 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828173.971993:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a3c00 x1874670273006080/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828198 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828173.971999:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828173.972002:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828173.972004:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273006080:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787828173.972008:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273006208:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787828173.972020:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828173.972026:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828173/real 1787828173]  req@ffff9ee0056a1a40 x1874670273006208/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828198 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828173.972056:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1a40 x1874670273006208/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828198 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828173.972079:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828173.972082:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828173.972084:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273006208:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787828173.972089:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273006336:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787828173.972105:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828173.972112:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828173/real 1787828173]  req@ffff9ee0056a12c0 x1874670273006336/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828198 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828173.972121:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a12c0 x1874670273006336/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828198 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828173.972144:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828173.972147:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828173.972149:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273006336:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828174.803558:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828174.995487:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828175.827632:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828176.019455:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828176.851624:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828177.043436:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828177.875628:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828178.067453:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828178.899601:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828179.091427:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:2.0:1787828179.091539:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828179.091551:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787828179.091557:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828179.091570:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3342
00000100:00080000:2.0:1787828179.091586:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828179.091597:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787828179.091663:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728f00 x1874670273006464/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828179.091699:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828179.091704:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787828179.091707:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828179.091712:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3342
00000100:00080000:2.0:1787828179.091717:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828179.091722:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828179.091737:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787828179.091765:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b840 x1874670273006592/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828179.091766:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273006464:192.168.203.121@tcp:250:kworker.0
00000100:00080000:2.0:1787828179.091797:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828179.091806:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787828179.091811:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828179.091821:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3342
00000100:00080000:2.0:1787828179.091831:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828179.091841:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828179.091853:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828179.091881:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057283c0 x1874670273006720/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828179.091905:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828179.091912:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787828179.091915:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828179.091923:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3342
00000100:00080000:2.0:1787828179.091930:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828179.091948:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828179.091959:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828179.091981:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728000 x1874670273006848/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828179.092033:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828179.092041:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787828179.092045:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828179.092053:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3342
00000100:00080000:2.0:1787828179.092058:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828179.092064:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828179.092073:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787828179.092090:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a580 x1874670273006976/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828179.092103:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828179.092107:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787828179.092110:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828179.092115:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3342
00000100:00080000:2.0:1787828179.092119:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828179.092124:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828179.092130:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828179.092140:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728b40 x1874670273007104/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828179.092150:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828179.092154:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787828179.092156:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828179.092161:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3342
00000100:00080000:2.0:1787828179.092165:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828179.092170:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828179.092174:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828179.092186:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729a40 x1874670273007232/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1787828179.093731:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828179.093815:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828179/real 1787828179]  req@ffff9ee005728f00 x1874670273006464/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828204 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828179.093838:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728f00 x1874670273006464/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828204 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828179.093853:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828179.093858:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828179.093866:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273006464:192.168.203.121@tcp:250:kworker.0
00000100:00100000:1.0:1787828179.093907:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273006592:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787828179.093957:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828179.093984:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828179/real 1787828179]  req@ffff9ee00572b840 x1874670273006592/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828204 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828179.094026:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b840 x1874670273006592/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828204 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828179.094039:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828179.094044:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828179.094048:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273006592:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828179.094057:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273006720:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828179.094089:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828179.094104:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828179/real 1787828179]  req@ffff9ee0057283c0 x1874670273006720/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828204 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828179.094118:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057283c0 x1874670273006720/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828204 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828179.094129:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828179.094133:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828179.094137:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273006720:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828179.094143:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273006848:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828179.094162:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828179.094173:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828179/real 1787828179]  req@ffff9ee005728000 x1874670273006848/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828204 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828179.094188:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728000 x1874670273006848/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828204 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828179.094197:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828179.094201:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828179.094204:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273006848:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828179.094211:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273006976:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787828179.094230:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828179.094241:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828179/real 1787828179]  req@ffff9ee00572a580 x1874670273006976/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828204 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828179.094254:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a580 x1874670273006976/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828204 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828179.094264:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828179.094267:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828179.094271:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273006976:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828179.094278:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273007104:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828179.094295:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828179.094305:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828179/real 1787828179]  req@ffff9ee005728b40 x1874670273007104/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828204 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828179.094350:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728b40 x1874670273007104/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828204 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828179.094370:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828179.094375:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828179.094379:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273007104:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828179.094386:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273007232:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828179.094408:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828179.094420:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828179/real 1787828179]  req@ffff9ee005729a40 x1874670273007232/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828204 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828179.094434:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729a40 x1874670273007232/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828204 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828179.094443:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828179.094447:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828179.094450:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273007232:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828179.923561:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828180.115418:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828180.947460:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828181.139422:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828181.971610:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828182.163411:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828182.995568:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828183.187497:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828184.019526:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828184.211456:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787828184.211460:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828184.211471:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787828184.211476:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828184.211488:0:8:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3347
00000100:00080000:3.0:1787828184.211502:0:8:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828184.211511:0:8:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787828184.211552:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706580 x1874670273007360/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828184.211599:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828184.211602:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787828184.211604:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828184.211608:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3347
00000100:00080000:3.0:1787828184.211611:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828184.211615:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828184.211624:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787828184.211636:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057043c0 x1874670273007488/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828184.211646:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828184.211650:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787828184.211651:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828184.211655:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3347
00000100:00080000:3.0:1787828184.211658:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828184.211665:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787828184.211666:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273007360:192.168.203.121@tcp:250:kworker.0
00000008:00100000:3.0:1787828184.211671:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787828184.211691:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704b40 x1874670273007616/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828184.211706:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828184.211711:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787828184.211714:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828184.211719:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3347
00000100:00080000:3.0:1787828184.211725:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828184.211731:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828184.211738:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787828184.211754:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705e00 x1874670273007744/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828184.211764:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828184.211767:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787828184.211769:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828184.211773:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3347
00000100:00080000:3.0:1787828184.211777:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828184.211781:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828184.211787:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787828184.211798:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705a40 x1874670273007872/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828184.211811:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273007488:192.168.203.121@tcp:38:kworker.0
00000100:00080000:3.0:1787828184.211816:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828184.211825:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787828184.211828:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828184.211834:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3347
00000100:00080000:3.0:1787828184.211840:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828184.211844:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828184.211849:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787828184.211863:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704780 x1874670273008000/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828184.211873:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828184.211876:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787828184.211878:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1787828184.211883:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273007616:192.168.203.121@tcp:8:kworker.0
00000100:00080000:3.0:1787828184.211886:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3347
00000100:00080000:3.0:1787828184.211892:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828184.211897:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828184.211902:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787828184.211914:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707840 x1874670273008128/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828184.211936:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273007744:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828184.211990:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273007872:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828184.212022:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273008000:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828184.212057:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273008128:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828185.043475:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828185.235462:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828186.067500:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828186.259440:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828187.091488:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828187.283439:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000400:00000100:2.0:1787828187.283550:0:2354:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.203.121:988
00000400:00000100:2.0:1787828187.283582:0:2354:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.203.121@tcp at host 192.168.203.121 was unreachable: the network or that node may be down, or Lustre may be misconfigured.
00000800:00000100:2.0:1787828187.283597:0:2354:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:2.0:1787828187.283627:0:2354:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:2.0:1787828187.283634:0:2354:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:2.0:1787828187.283641:0:2354:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:2.0:1787828187.283648:0:2354:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:2.0:1787828187.283656:0:2354:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000100:00100000:1.0:1787828187.283657:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828184/real 1787828187]  req@ffff9ee005704b40 x1874670273007616/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828209 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000800:00000100:2.0:1787828187.283672:0:2354:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000100:00100000:1.0:1787828187.283681:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704b40 x1874670273007616/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828209 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828187.283691:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828187.283695:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828187.283699:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273007616:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828187.283704:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828184/real 1787828187]  req@ffff9ee005705e00 x1874670273007744/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828209 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828187.283713:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705e00 x1874670273007744/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828209 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828187.283718:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828187.283720:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828187.283722:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273007744:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828187.283726:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828184/real 1787828187]  req@ffff9ee005705a40 x1874670273007872/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828209 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828187.283733:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705a40 x1874670273007872/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828209 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828187.283743:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828187.283745:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828187.283747:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273007872:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828187.283751:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828184/real 1787828187]  req@ffff9ee005704780 x1874670273008000/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828209 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828187.283758:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704780 x1874670273008000/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828209 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828187.283762:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828187.283764:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828187.283766:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273008000:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828187.283770:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828184/real 1787828187]  req@ffff9ee005706580 x1874670273007360/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828209 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828187.283776:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706580 x1874670273007360/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828209 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828187.283781:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828187.283783:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828187.283785:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273007360:192.168.203.121@tcp:250:kworker.0
00000100:00100000:1.0:1787828187.283789:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828184/real 1787828187]  req@ffff9ee0057043c0 x1874670273007488/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828209 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828187.283799:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057043c0 x1874670273007488/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828209 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828187.283808:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828187.283812:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828187.283815:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273007488:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828187.283845:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828184/real 1787828187]  req@ffff9ee005707840 x1874670273008128/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828209 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828187.283857:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707840 x1874670273008128/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828209 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828187.283864:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828187.283867:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828187.283870:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273008128:192.168.203.121@tcp:8:kworker.0
00010000:00010000:3.0:1787828188.115452:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828188.307387:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828189.139601:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1787828189.331466:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1787828189.331469:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787828189.331484:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787828189.331490:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828189.331505:0:8:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3353
00000100:00080000:3.0:1787828189.331520:0:8:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828189.331531:0:8:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787828189.331578:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707480 x1874670273008256/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828189.331616:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828189.331621:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787828189.331624:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828189.331628:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3353
00000100:00080000:3.0:1787828189.331632:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828189.331637:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828189.331663:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787828189.331683:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273008256:192.168.203.121@tcp:250:kworker.0
00000100:00100000:3.0:1787828189.331694:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057052c0 x1874670273008384/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828189.331722:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828189.331729:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787828189.331732:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828189.331740:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3353
00000100:00080000:3.0:1787828189.331748:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828189.331756:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828189.331767:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1787828189.331793:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787828189.331798:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707c00 x1874670273008512/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828189.331824:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828189.331831:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787828189.331835:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828189.331855:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3353
00000100:00100000:1.0:1787828189.331864:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828189/real 1787828189]  req@ffff9ee005707480 x1874670273008256/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828214 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828189.331868:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828189.331887:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828189.331897:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787828189.331902:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707480 x1874670273008256/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828214 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828189.331954:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:3.0:1787828189.331959:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057061c0 x1874670273008640/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787828189.331970:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:3.0:1787828189.331985:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1787828189.331990:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273008256:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787828189.331993:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787828189.332001:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828189.332028:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3353
00000100:00080000:3.0:1787828189.332038:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828189.332047:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828189.332058:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787828189.332064:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273008384:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787828189.332089:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057070c0 x1874670273008768/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828189.332112:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828189.332120:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000800:00000100:1.0:1787828189.332128:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787828189.332130:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828189.332146:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3353
00000100:00080000:3.0:1787828189.332155:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828189.332164:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787828189.332172:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828189/real 1787828189]  req@ffff9ee0057052c0 x1874670273008384/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828214 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:3.0:1787828189.332179:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787828189.332214:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704000 x1874670273008896/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828189.332221:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057052c0 x1874670273008384/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828214 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828189.332267:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828189.332271:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787828189.332283:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787828189.332289:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00080000:3.0:1787828189.332293:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1787828189.332305:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273008384:192.168.203.121@tcp:38:kworker.0
00000100:00080000:3.0:1787828189.332308:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3353
00000100:00100000:1.0:1787828189.332371:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273008512:192.168.203.121@tcp:8:kworker.0
00000100:00080000:3.0:1787828189.332394:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828189.332406:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828189.332418:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1787828189.332429:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787828189.332452:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706d00 x1874670273009024/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828189.332465:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828189/real 1787828189]  req@ffff9ee005707c00 x1874670273008512/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828214 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828189.332505:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707c00 x1874670273008512/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828214 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828189.332522:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828189.332530:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828189.332536:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273008512:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828189.332549:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273008640:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828189.332591:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828189.332614:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828189/real 1787828189]  req@ffff9ee0057061c0 x1874670273008640/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828214 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828189.332639:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057061c0 x1874670273008640/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828214 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828189.332654:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828189.332660:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828189.332667:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273008640:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828189.332701:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273008768:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787828189.332741:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828189.332766:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828189/real 1787828189]  req@ffff9ee0057070c0 x1874670273008768/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828214 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828189.332791:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057070c0 x1874670273008768/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828214 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828189.332806:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828189.332813:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828189.332819:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273008768:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828189.332831:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273008896:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828189.332868:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828189.332891:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828189/real 1787828189]  req@ffff9ee005704000 x1874670273008896/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828214 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828189.332916:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704000 x1874670273008896/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828214 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828189.332978:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828189.332985:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828189.332991:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273008896:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828189.333003:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273009024:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828189.333044:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828189.333070:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828189/real 1787828189]  req@ffff9ee005706d00 x1874670273009024/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828214 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828189.333096:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706d00 x1874670273009024/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828214 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828189.333113:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828189.333122:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828189.333129:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273009024:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828190.163494:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828190.355396:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828191.187489:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828191.379392:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828192.211479:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828192.403389:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828193.235435:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828193.427387:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828194.259476:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828194.451432:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787828194.451453:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828194.451464:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787828194.451470:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828194.451485:0:8:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3358
00000100:00080000:3.0:1787828194.451500:0:8:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828194.451509:0:8:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787828194.451562:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705680 x1874670273009152/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828194.451597:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828194.451602:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787828194.451604:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828194.451608:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3358
00000100:00080000:3.0:1787828194.451629:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828194.451633:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828194.451644:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787828194.451651:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273009152:192.168.203.121@tcp:250:kworker.0
00000100:00100000:3.0:1787828194.451662:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706940 x1874670273009280/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828194.451674:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828194.451677:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787828194.451679:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828194.451683:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3358
00000100:00080000:3.0:1787828194.451685:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828194.451689:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828194.451712:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787828194.451732:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706d00 x1874670273009408/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1787828194.451740:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787828194.451757:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828194.451762:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787828194.451764:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828194.451769:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3358
00000100:00080000:3.0:1787828194.451776:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828194.451781:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828194.451786:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787828194.451798:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704000 x1874670273009536/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828194.451806:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828194/real 1787828194]  req@ffff9ee005705680 x1874670273009152/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828219 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828194.451890:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1787828194.451911:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705680 x1874670273009152/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828219 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828194.451921:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787828194.451930:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787828194.451956:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787828194.451960:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3358
00000100:00080000:1.0:1787828194.451966:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:3.0:1787828194.451968:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1787828194.451972:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273009152:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787828194.451975:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828194.451989:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787828194.452002:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057070c0 x1874670273009664/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828194.452009:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273009280:192.168.203.121@tcp:38:kworker.0
00000100:00080000:3.0:1787828194.452019:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828194.452024:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787828194.452026:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828194.452031:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3358
00000100:00080000:3.0:1787828194.452035:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828194.452039:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000800:00000100:1.0:1787828194.452043:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000008:00100000:3.0:1787828194.452052:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787828194.452060:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828194/real 1787828194]  req@ffff9ee005706940 x1874670273009280/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828219 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787828194.452066:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057061c0 x1874670273009792/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828194.452103:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706940 x1874670273009280/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828219 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828194.452103:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828194.452134:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787828194.452137:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787828194.452142:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00080000:3.0:1787828194.452143:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1787828194.452156:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273009280:192.168.203.121@tcp:38:kworker.0
00000100:00080000:3.0:1787828194.452157:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3358
00000100:00080000:3.0:1787828194.452172:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1787828194.452180:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273009408:192.168.203.121@tcp:8:kworker.0
00000100:00080000:3.0:1787828194.452187:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828194.452210:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1787828194.452224:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787828194.452229:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707c00 x1874670273009920/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828194.452241:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828194/real 1787828194]  req@ffff9ee005706d00 x1874670273009408/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828219 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828194.452257:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706d00 x1874670273009408/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828219 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828194.452263:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828194.452267:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828194.452273:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273009408:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828194.452282:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273009536:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828194.452294:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828194.452300:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828194/real 1787828194]  req@ffff9ee005704000 x1874670273009536/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828219 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828194.452306:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704000 x1874670273009536/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828219 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828194.452311:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828194.452313:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828194.452315:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273009536:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828194.452346:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273009664:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787828194.452359:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828194.452365:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828194/real 1787828194]  req@ffff9ee0057070c0 x1874670273009664/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828219 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828194.452373:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057070c0 x1874670273009664/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828219 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828194.452378:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828194.452380:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828194.452382:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273009664:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828194.452386:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273009792:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828194.452396:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828194.452401:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828194/real 1787828194]  req@ffff9ee0057061c0 x1874670273009792/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828219 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828194.452409:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057061c0 x1874670273009792/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828219 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828194.452414:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828194.452417:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828194.452421:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273009792:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828194.452427:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273009920:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828194.452445:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828194.452457:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828194/real 1787828194]  req@ffff9ee005707c00 x1874670273009920/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828219 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828194.452470:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707c00 x1874670273009920/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828219 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828194.452478:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828194.452482:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828194.452485:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273009920:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828195.283452:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828195.475431:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828196.307482:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828196.499408:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828197.331468:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828197.523400:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828198.355454:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828198.547439:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828199.379455:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828199.571451:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:0.0:1787828199.571545:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828199.571552:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1787828199.571557:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828199.571566:0:8:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3363
00000100:00080000:0.0:1787828199.571589:0:8:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828199.571598:0:8:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787828199.571634:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb0c0 x1874670273010048/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828199.571668:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828199.571673:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787828199.571675:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828199.571680:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3363
00000100:00080000:0.0:1787828199.571684:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828199.571689:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828199.571700:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787828199.571715:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ea940 x1874670273010176/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828199.571732:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828199.571735:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787828199.571737:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828199.571741:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3363
00000100:00080000:0.0:1787828199.571745:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828199.571749:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828199.571755:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828199.571769:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ea580 x1874670273010304/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828199.571778:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828199.571781:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787828199.571784:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828199.571788:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3363
00000100:00080000:0.0:1787828199.571793:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828199.571797:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828199.571802:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828199.571812:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ead00 x1874670273010432/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828199.571821:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828199.571824:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787828199.571826:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828199.571830:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3363
00000100:00080000:0.0:1787828199.571833:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828199.571837:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828199.571842:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787828199.571852:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9a40 x1874670273010560/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828199.571879:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828199.571883:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787828199.571884:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828199.571889:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3363
00000100:00080000:0.0:1787828199.571892:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828199.571896:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828199.571900:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828199.571911:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9680 x1874670273010688/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828199.571918:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828199.571922:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787828199.571924:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828199.571927:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3363
00000100:00080000:0.0:1787828199.571930:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828199.571933:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828199.571938:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828199.571947:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8780 x1874670273010816/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828199.572307:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273010048:192.168.203.121@tcp:250:kworker.0
00000800:00000100:1.0:1787828199.572372:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828199.572400:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828199/real 1787828199]  req@ffff9ee0056eb0c0 x1874670273010048/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828224 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828199.572412:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb0c0 x1874670273010048/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828224 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828199.572419:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828199.572422:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828199.572425:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273010048:192.168.203.121@tcp:250:kworker.0
00000100:00100000:1.0:1787828199.572429:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273010176:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787828199.572443:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828199.572450:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828199/real 1787828199]  req@ffff9ee0056ea940 x1874670273010176/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828224 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828199.572458:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ea940 x1874670273010176/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828224 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828199.572463:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828199.572465:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828199.572467:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273010176:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828199.572470:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273010304:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828199.572481:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828199.572487:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828199/real 1787828199]  req@ffff9ee0056ea580 x1874670273010304/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828224 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828199.572494:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ea580 x1874670273010304/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828224 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828199.572503:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828199.572505:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828199.572507:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273010304:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828199.572510:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273010432:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828199.572520:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828199.572525:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828199/real 1787828199]  req@ffff9ee0056ead00 x1874670273010432/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828224 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828199.572531:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ead00 x1874670273010432/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828224 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828199.572536:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828199.572538:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828199.572540:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273010432:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828199.572543:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273010560:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787828199.572552:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828199.572557:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828199/real 1787828199]  req@ffff9ee0056e9a40 x1874670273010560/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828224 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828199.572564:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9a40 x1874670273010560/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828224 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828199.572569:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828199.572571:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828199.572583:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273010560:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828199.572589:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273010688:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828199.572608:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828199.572621:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828199/real 1787828199]  req@ffff9ee0056e9680 x1874670273010688/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828224 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828199.572634:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9680 x1874670273010688/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828224 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828199.572642:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828199.572645:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828199.572649:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273010688:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828199.572655:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273010816:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828199.572675:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828199.572687:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828199/real 1787828199]  req@ffff9ee0056e8780 x1874670273010816/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828224 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828199.572700:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8780 x1874670273010816/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828224 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828199.572707:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828199.572710:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828199.572713:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273010816:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828200.403479:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828200.595406:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828201.427458:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828201.619396:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828202.451565:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828202.643422:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828203.475466:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828203.667437:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828204.499525:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828204.691415:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787828204.691459:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828204.691465:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787828204.691468:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828204.691475:0:8:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3368
00000100:00080000:3.0:1787828204.691484:0:8:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828204.691490:0:8:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787828204.691521:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057052c0 x1874670273010944/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828204.691543:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828204.691546:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787828204.691547:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828204.691550:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3368
00000100:00080000:3.0:1787828204.691552:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828204.691555:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828204.691563:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787828204.691571:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707480 x1874670273011072/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828204.691580:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273010944:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787828204.691583:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828204.691590:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787828204.691592:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828204.691597:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3368
00000100:00080000:3.0:1787828204.691600:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828204.691604:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828204.691609:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787828204.691624:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707840 x1874670273011200/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828204.691634:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828204.691638:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000800:00000100:1.0:1787828204.691643:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787828204.691643:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828204.691651:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3368
00000100:00080000:3.0:1787828204.691657:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828204.691662:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828204.691668:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787828204.691681:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057043c0 x1874670273011328/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828204.691689:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828204/real 1787828204]  req@ffff9ee0057052c0 x1874670273010944/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828229 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828204.691696:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828204.691702:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787828204.691704:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1787828204.691706:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057052c0 x1874670273010944/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828229 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828204.691714:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3368
00000100:00080000:1.0:1787828204.691719:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787828204.691721:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828204.691724:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828204.691729:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273010944:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787828204.691732:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828204.691740:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787828204.691750:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273011072:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787828204.691757:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706580 x1874670273011456/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1787828204.691770:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787828204.691771:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828204.691777:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787828204.691779:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1787828204.691782:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828204/real 1787828204]  req@ffff9ee005707480 x1874670273011072/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828229 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828204.691788:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3368
00000100:00080000:3.0:1787828204.691796:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1787828204.691797:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707480 x1874670273011072/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828229 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828204.691806:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00080000:1.0:1787828204.691811:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000008:00100000:3.0:1787828204.691814:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:1.0:1787828204.691816:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828204.691836:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273011072:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828204.691841:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273011200:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787828204.691851:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704780 x1874670273011584/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828204.691860:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828204.691862:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787828204.691866:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:1.0:1787828204.691867:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787828204.691872:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3368
00000100:00080000:3.0:1787828204.691877:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828204.691880:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828204.691884:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787828204.691887:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828204/real 1787828204]  req@ffff9ee005707840 x1874670273011200/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828229 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787828204.691894:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705a40 x1874670273011712/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828204.691912:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707840 x1874670273011200/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828229 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828204.691923:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828204.691926:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828204.691929:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273011200:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828204.691936:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273011328:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828204.691952:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828204.691960:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828204/real 1787828204]  req@ffff9ee0057043c0 x1874670273011328/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828229 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828204.691967:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057043c0 x1874670273011328/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828229 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828204.691972:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828204.691985:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828204.691987:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273011328:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828204.692002:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273011456:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787828204.692014:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828204.692021:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828204/real 1787828204]  req@ffff9ee005706580 x1874670273011456/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828229 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828204.692033:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706580 x1874670273011456/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828229 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828204.692038:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828204.692040:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828204.692043:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273011456:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828204.692046:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273011584:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828204.692055:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828204.692061:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828204/real 1787828204]  req@ffff9ee005704780 x1874670273011584/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828229 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828204.692068:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704780 x1874670273011584/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828229 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828204.692072:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828204.692074:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828204.692076:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273011584:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828204.692079:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273011712:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828204.692088:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828204.692093:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828204/real 1787828204]  req@ffff9ee005705a40 x1874670273011712/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828229 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828204.692099:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705a40 x1874670273011712/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828229 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828204.692108:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828204.692110:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828204.692112:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273011712:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828205.523452:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828205.715398:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828206.547477:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828206.739385:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828207.571476:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828207.763425:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828208.595514:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828208.787385:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828209.619499:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828209.811390:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:0.0:1787828209.811428:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828209.811436:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1787828209.811441:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828209.811450:0:8:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3373
00000100:00080000:0.0:1787828209.811462:0:8:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828209.811470:0:8:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787828209.811506:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9e00 x1874670273011840/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828209.811535:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828209.811540:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787828209.811542:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828209.811547:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3373
00000100:00080000:0.0:1787828209.811552:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828209.811558:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787828209.811563:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273011840:192.168.203.121@tcp:250:kworker.0
00000008:00100000:0.0:1787828209.811569:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787828209.811585:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8b40 x1874670273011968/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828209.811595:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828209.811599:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787828209.811601:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828209.811604:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3373
00000100:00080000:0.0:1787828209.811622:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828209.811627:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828209.811633:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1787828209.811633:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787828209.811649:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e92c0 x1874670273012096/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828209.811659:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828209.811663:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787828209.811665:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828209.811670:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3373
00000100:00100000:1.0:1787828209.811674:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828209/real 1787828209]  req@ffff9ee0056e9e00 x1874670273011840/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828234 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828209.811677:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828209.811686:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828209.811692:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787828209.811694:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9e00 x1874670273011840/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828234 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828209.811705:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:0.0:1787828209.811709:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb840 x1874670273012224/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787828209.811711:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828209.811717:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273011840:192.168.203.121@tcp:250:kworker.0
00000100:00080000:0.0:1787828209.811732:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828209.811736:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787828209.811738:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1787828209.811741:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273011968:192.168.203.121@tcp:38:kworker.0
00000100:00080000:0.0:1787828209.811746:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3373
00000100:00080000:0.0:1787828209.811752:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828209.811758:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828209.811764:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000800:00000100:1.0:1787828209.811766:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828209.811777:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828209/real 1787828209]  req@ffff9ee0056e8b40 x1874670273011968/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828234 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787828209.811782:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb480 x1874670273012352/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828209.811808:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8b40 x1874670273011968/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828234 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828209.811836:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828209.811841:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00080000:0.0:1787828209.811842:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1787828209.811845:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273011968:192.168.203.121@tcp:38:kworker.0
00000100:00080000:0.0:1787828209.811851:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00100000:1.0:1787828209.811855:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273012096:192.168.203.121@tcp:8:kworker.0
00000100:00080000:0.0:1787828209.811857:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828209.811865:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3373
00000100:00080000:0.0:1787828209.811870:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828209.811875:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000800:00000100:1.0:1787828209.811879:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000008:00100000:0.0:1787828209.811884:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787828209.811890:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828209/real 1787828209]  req@ffff9ee0056e92c0 x1874670273012096/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828234 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787828209.811900:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8000 x1874670273012480/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828209.811902:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e92c0 x1874670273012096/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828234 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828209.811927:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828209.811929:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828209.811931:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273012096:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828209.811936:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273012224:192.168.203.121@tcp:8:kworker.0
00000100:00080000:0.0:1787828209.811943:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828209.811948:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000800:00000100:1.0:1787828209.811952:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:0.0:1787828209.811953:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828209.811961:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3373
00000100:00100000:1.0:1787828209.811962:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828209/real 1787828209]  req@ffff9ee0056eb840 x1874670273012224/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828234 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828209.811969:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1787828209.811974:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb840 x1874670273012224/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828234 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828209.811978:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00080000:1.0:1787828209.811987:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000008:00100000:0.0:1787828209.811989:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:1.0:1787828209.811991:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828209.811997:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273012224:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787828209.812010:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e83c0 x1874670273012608/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828209.812013:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273012352:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787828209.812030:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828209.812041:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828209/real 1787828209]  req@ffff9ee0056eb480 x1874670273012352/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828234 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828209.812050:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb480 x1874670273012352/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828234 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828209.812055:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828209.812057:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828209.812059:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273012352:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828209.812063:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273012480:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828209.812072:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828209.812077:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828209/real 1787828209]  req@ffff9ee0056e8000 x1874670273012480/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828234 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828209.812084:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8000 x1874670273012480/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828234 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828209.812089:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828209.812090:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828209.812092:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273012480:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828209.812099:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273012608:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828209.812108:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828209.812114:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828209/real 1787828209]  req@ffff9ee0056e83c0 x1874670273012608/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828234 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828209.812121:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e83c0 x1874670273012608/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828234 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828209.812126:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828209.812127:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828209.812129:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273012608:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828210.643473:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828210.835394:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828211.667444:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828211.859380:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828212.691562:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828212.883430:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828213.715474:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828213.907398:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828214.739524:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828214.931403:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:1.0:1787828214.931449:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828214.931453:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1787828214.931457:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787828214.931464:0:8:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3378
00000100:00080000:1.0:1787828214.931473:0:8:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828214.931483:0:8:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787828214.931517:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a03c0 x1874670273012736/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787828214.931544:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828214.931548:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787828214.931551:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787828214.931556:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3378
00000100:00080000:1.0:1787828214.931560:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828214.931568:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787828214.931577:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273012736:192.168.203.121@tcp:250:kworker.0
00000008:00100000:1.0:1787828214.931597:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787828214.931621:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1e00 x1874670273012864/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787828214.931638:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828214.931642:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787828214.931645:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787828214.931653:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3378
00000100:00080000:1.0:1787828214.931660:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828214.931664:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787828214.931670:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787828214.931683:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0b40 x1874670273012992/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787828214.931691:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828214.931694:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787828214.931696:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787828214.931704:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3378
00000100:00080000:1.0:1787828214.931706:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828214.931709:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787828214.931713:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787828214.931721:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a2580 x1874670273013120/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787828214.931730:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828214.931734:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787828214.931736:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:0.0:1787828214.931743:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:1.0:1787828214.931743:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3378
00000100:00080000:1.0:1787828214.931765:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828214.931770:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787828214.931775:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787828214.931785:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a3480 x1874670273013248/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787828214.931799:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828214.931802:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787828214.931803:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787828214.931806:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3378
00000100:00080000:1.0:1787828214.931809:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828214.931812:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787828214.931817:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828214.931826:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828214/real 1787828214]  req@ffff9ee0056a03c0 x1874670273012736/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828239 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828214.931827:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0780 x1874670273013376/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787828214.931860:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828214.931863:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787828214.931865:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787828214.931870:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3378
00000100:00100000:0.0:1787828214.931871:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a03c0 x1874670273012736/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828239 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828214.931872:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828214.931879:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787828214.931887:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:0.0:1787828214.931890:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787828214.931895:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828214.931898:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0000 x1874670273013504/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787828214.931902:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273012736:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787828214.931939:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273012864:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787828214.931983:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787828214.931999:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828214/real 1787828214]  req@ffff9ee0056a1e00 x1874670273012864/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828239 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787828214.932012:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1e00 x1874670273012864/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828239 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828214.932018:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787828214.932020:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787828214.932023:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273012864:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787828214.932027:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273012992:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787828214.932044:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787828214.932051:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828214/real 1787828214]  req@ffff9ee0056a0b40 x1874670273012992/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828239 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787828214.932058:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0b40 x1874670273012992/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828239 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828214.932068:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787828214.932070:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787828214.932072:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273012992:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787828214.932076:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273013120:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787828214.932085:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787828214.932090:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828214/real 1787828214]  req@ffff9ee0056a2580 x1874670273013120/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828239 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787828214.932097:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a2580 x1874670273013120/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828239 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828214.932102:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787828214.932104:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787828214.932106:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273013120:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787828214.932109:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273013248:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787828214.932118:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787828214.932123:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828214/real 1787828214]  req@ffff9ee0056a3480 x1874670273013248/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828239 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787828214.932130:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a3480 x1874670273013248/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828239 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828214.932134:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787828214.932136:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787828214.932139:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273013248:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787828214.932142:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273013376:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787828214.932152:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787828214.932158:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828214/real 1787828214]  req@ffff9ee0056a0780 x1874670273013376/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828239 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787828214.932165:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0780 x1874670273013376/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828239 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828214.932171:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787828214.932172:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787828214.932174:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273013376:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787828214.932178:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273013504:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787828214.932188:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787828214.932194:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828214/real 1787828214]  req@ffff9ee0056a0000 x1874670273013504/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828239 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787828214.932200:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0000 x1874670273013504/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828239 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828214.932206:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787828214.932208:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787828214.932210:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273013504:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828215.763502:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828215.955421:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828216.787464:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828216.979403:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828217.811465:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828218.003384:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828218.835435:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828219.027369:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828219.859463:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1787828220.051406:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1787828220.051406:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:0.0:1787828220.051417:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1787828220.051422:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828220.051432:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3383
00000100:00080000:0.0:1787828220.051444:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828220.051452:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787828220.051488:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ebc00 x1874670273013632/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828220.051516:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828220.051520:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787828220.051522:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828220.051527:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3383
00000100:00080000:0.0:1787828220.051532:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828220.051537:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787828220.051542:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273013632:192.168.203.121@tcp:250:kworker.0
00000008:00100000:0.0:1787828220.051550:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787828220.051567:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8f00 x1874670273013760/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828220.051580:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828220.051584:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787828220.051586:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828220.051591:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3383
00000100:00080000:0.0:1787828220.051597:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828220.051602:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000800:00000100:1.0:1787828220.051607:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000008:00100000:0.0:1787828220.051612:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828220.051628:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e83c0 x1874670273013888/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828220.051640:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828220/real 1787828220]  req@ffff9ee0056ebc00 x1874670273013632/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828245 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828220.051641:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828220.051652:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787828220.051655:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828220.051660:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3383
00000100:00080000:0.0:1787828220.051666:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828220.051671:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787828220.051675:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ebc00 x1874670273013632/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828245 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:0.0:1787828220.051678:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:1.0:1787828220.051689:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828220.051693:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787828220.051698:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8000 x1874670273014016/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828220.051699:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273013632:192.168.203.121@tcp:250:kworker.0
00000100:00080000:0.0:1787828220.051729:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828220.051734:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787828220.051736:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1787828220.051739:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273013760:192.168.203.121@tcp:38:kworker.0
00000100:00080000:0.0:1787828220.051745:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3383
00000100:00080000:0.0:1787828220.051751:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828220.051757:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828220.051762:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000800:00000100:1.0:1787828220.051767:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787828220.051780:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb480 x1874670273014144/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828220.051782:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828220/real 1787828220]  req@ffff9ee0056e8f00 x1874670273013760/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828245 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828220.051816:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8f00 x1874670273013760/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828245 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828220.051818:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828220.051828:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787828220.051833:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828220.051843:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3383
00000100:00080000:1.0:1787828220.051845:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787828220.051850:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828220.051851:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828220.051854:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273013760:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828220.051858:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273013888:192.168.203.121@tcp:8:kworker.0
00000100:00080000:0.0:1787828220.051870:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000800:00000100:1.0:1787828220.051877:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000008:00100000:0.0:1787828220.051880:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787828220.051892:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828220/real 1787828220]  req@ffff9ee0056e83c0 x1874670273013888/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828245 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787828220.051897:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb840 x1874670273014272/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828220.051922:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1787828220.051926:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e83c0 x1874670273013888/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828245 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828220.051927:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787828220.051932:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828220.051940:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3383
00000100:00080000:1.0:1787828220.051942:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787828220.051945:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828220.051948:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00080000:0.0:1787828220.051955:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787828220.051955:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273013888:192.168.203.121@tcp:8:kworker.0
00000008:00100000:0.0:1787828220.051965:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787828220.051966:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273014016:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787828220.051985:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e92c0 x1874670273014400/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1787828220.051994:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828220.052006:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828220/real 1787828220]  req@ffff9ee0056e8000 x1874670273014016/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828245 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828220.052016:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8000 x1874670273014016/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828245 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828220.052022:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828220.052024:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828220.052027:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273014016:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828220.052039:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273014144:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787828220.052050:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828220.052056:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828220/real 1787828220]  req@ffff9ee0056eb480 x1874670273014144/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828245 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828220.052064:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb480 x1874670273014144/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828245 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828220.052069:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828220.052071:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828220.052073:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273014144:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828220.052076:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273014272:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828220.052086:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828220.052091:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828220/real 1787828220]  req@ffff9ee0056eb840 x1874670273014272/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828245 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828220.052098:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb840 x1874670273014272/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828245 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828220.052103:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828220.052105:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828220.052106:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273014272:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828220.052110:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273014400:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828220.052118:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828220.052124:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828220/real 1787828220]  req@ffff9ee0056e92c0 x1874670273014400/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828245 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828220.052131:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e92c0 x1874670273014400/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828245 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828220.052136:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828220.052137:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828220.052139:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273014400:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828220.883464:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828221.075403:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828221.907490:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828222.099457:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828222.931436:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828223.123417:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828223.955476:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828224.147417:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828224.979466:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1787828225.171390:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828225.171403:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1787828225.171408:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1787828225.171415:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:0.0:1787828225.171417:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3388
00000100:00080000:0.0:1787828225.171428:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828225.171436:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787828225.171466:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8b40 x1874670273014528/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828225.171487:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828225.171490:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787828225.171491:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828225.171494:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3388
00000100:00080000:0.0:1787828225.171496:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828225.171499:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828225.171511:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787828225.171520:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9e00 x1874670273014656/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828225.171532:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273014528:192.168.203.121@tcp:250:kworker.0
00000100:00080000:0.0:1787828225.171536:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828225.171540:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787828225.171542:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828225.171548:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3388
00000100:00080000:0.0:1787828225.171552:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828225.171557:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828225.171563:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828225.171576:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8780 x1874670273014784/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828225.171584:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828225.171588:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000800:00000100:1.0:1787828225.171590:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:0.0:1787828225.171591:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828225.171598:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3388
00000100:00080000:0.0:1787828225.171602:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828225.171605:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828225.171611:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828225.171620:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9680 x1874670273014912/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828225.171627:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828225.171632:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00100000:1.0:1787828225.171632:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828225/real 1787828225]  req@ffff9ee0056e8b40 x1874670273014528/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828250 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828225.171635:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828225.171641:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3388
00000100:00080000:0.0:1787828225.171643:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828225.171645:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828225.171649:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787828225.171662:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9a40 x1874670273015040/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828225.171666:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8b40 x1874670273014528/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828250 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828225.171694:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828225.171698:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787828225.171700:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787828225.171701:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787828225.171705:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3388
00000100:00080000:1.0:1787828225.171709:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:0.0:1787828225.171711:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1787828225.171715:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273014528:192.168.203.121@tcp:250:kworker.0
00000100:00080000:0.0:1787828225.171719:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828225.171726:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828225.171739:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ead00 x1874670273015168/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828225.171740:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273014656:192.168.203.121@tcp:38:kworker.0
00000100:00080000:0.0:1787828225.171756:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828225.171760:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787828225.171762:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828225.171768:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3388
00000100:00080000:0.0:1787828225.171773:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000800:00000100:1.0:1787828225.171774:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:0.0:1787828225.171780:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828225.171786:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787828225.171790:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828225/real 1787828225]  req@ffff9ee0056e9e00 x1874670273014656/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828250 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787828225.171800:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ea580 x1874670273015296/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828225.171803:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9e00 x1874670273014656/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828250 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828225.171823:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828225.171827:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828225.171830:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273014656:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828225.171836:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273014784:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828225.171850:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828225.171860:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828225/real 1787828225]  req@ffff9ee0056e8780 x1874670273014784/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828250 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828225.171868:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8780 x1874670273014784/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828250 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828225.171874:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828225.171877:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828225.171881:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273014784:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828225.171887:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273014912:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828225.171899:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828225.171904:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828225/real 1787828225]  req@ffff9ee0056e9680 x1874670273014912/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828250 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828225.171911:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9680 x1874670273014912/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828250 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828225.171916:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828225.171917:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828225.171920:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273014912:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828225.171923:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273015040:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787828225.171932:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828225.171938:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828225/real 1787828225]  req@ffff9ee0056e9a40 x1874670273015040/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828250 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828225.171944:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9a40 x1874670273015040/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828250 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828225.171949:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828225.171951:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828225.171953:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273015040:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828225.171963:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273015168:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828225.171973:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828225.171978:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828225/real 1787828225]  req@ffff9ee0056ead00 x1874670273015168/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828250 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828225.171985:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ead00 x1874670273015168/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828250 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828225.171990:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828225.171992:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828225.171994:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273015168:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828225.171997:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273015296:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828225.172006:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828225.172012:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828225/real 1787828225]  req@ffff9ee0056ea580 x1874670273015296/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828250 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828225.172019:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ea580 x1874670273015296/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828250 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828225.172023:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828225.172025:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828225.172027:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273015296:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828226.003533:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828226.195403:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828227.027469:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828227.219384:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828228.051492:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828228.243375:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828229.075487:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828229.267389:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828230.099464:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828230.291385:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:1.0:1787828230.291434:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828230.291439:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1787828230.291442:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787828230.291451:0:8:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3394
00000100:00080000:1.0:1787828230.291460:0:8:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828230.291465:0:8:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787828230.291495:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a30c0 x1874670273015424/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787828230.291517:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828230.291520:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787828230.291521:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787828230.291524:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3394
00000100:00080000:1.0:1787828230.291526:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828230.291529:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787828230.291536:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787828230.291547:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0000 x1874670273015552/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787828230.291553:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273015424:192.168.203.121@tcp:250:kworker.0
00000100:00080000:1.0:1787828230.291558:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828230.291562:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787828230.291563:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787828230.291567:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3394
00000100:00080000:1.0:1787828230.291568:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828230.291571:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787828230.291574:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787828230.291582:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0780 x1874670273015680/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787828230.291589:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828230.291591:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787828230.291593:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787828230.291595:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3394
00000100:00080000:1.0:1787828230.291604:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828230.291606:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787828230.291609:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:0.0:1787828230.291615:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828230.291618:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a3480 x1874670273015808/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787828230.291626:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828230.291628:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787828230.291630:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787828230.291632:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3394
00000100:00080000:1.0:1787828230.291639:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828230.291642:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787828230.291656:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787828230.291665:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a2580 x1874670273015936/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787828230.291671:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828230.291674:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787828230.291676:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1787828230.291678:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828230/real 1787828230]  req@ffff9ee0056a30c0 x1874670273015424/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828255 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828230.291681:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3394
00000100:00080000:1.0:1787828230.291687:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828230.291694:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787828230.291700:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828230.291707:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a30c0 x1874670273015424/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828255 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828230.291709:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0b40 x1874670273016064/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787828230.291737:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828230.291738:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828230.291743:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787828230.291747:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:1.0:1787828230.291748:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787828230.291755:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3394
00000100:00100000:0.0:1787828230.291757:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273015424:192.168.203.121@tcp:250:kworker.0
00000100:00080000:1.0:1787828230.291758:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828230.291766:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787828230.291770:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787828230.291776:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1e00 x1874670273016192/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787828230.291784:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273015552:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787828230.291820:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787828230.291836:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828230/real 1787828230]  req@ffff9ee0056a0000 x1874670273015552/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828255 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787828230.291851:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0000 x1874670273015552/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828255 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828230.291867:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787828230.291872:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787828230.291875:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273015552:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787828230.291881:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273015680:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787828230.291898:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787828230.291906:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828230/real 1787828230]  req@ffff9ee0056a0780 x1874670273015680/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828255 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787828230.291914:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0780 x1874670273015680/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828255 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828230.291919:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787828230.291921:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787828230.291923:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273015680:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787828230.291927:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273015808:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787828230.291936:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787828230.291942:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828230/real 1787828230]  req@ffff9ee0056a3480 x1874670273015808/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828255 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787828230.291949:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a3480 x1874670273015808/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828255 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828230.291962:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787828230.291964:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787828230.291967:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273015808:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787828230.291971:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273015936:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787828230.291982:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787828230.291988:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828230/real 1787828230]  req@ffff9ee0056a2580 x1874670273015936/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828255 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787828230.291996:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a2580 x1874670273015936/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828255 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828230.292000:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787828230.292002:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787828230.292004:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273015936:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787828230.292007:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273016064:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787828230.292016:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787828230.292022:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828230/real 1787828230]  req@ffff9ee0056a0b40 x1874670273016064/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828255 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787828230.292029:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0b40 x1874670273016064/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828255 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828230.292034:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787828230.292035:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787828230.292037:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273016064:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787828230.292056:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273016192:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787828230.292067:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787828230.292074:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828230/real 1787828230]  req@ffff9ee0056a1e00 x1874670273016192/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828255 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787828230.292081:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1e00 x1874670273016192/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828255 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828230.292086:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787828230.292088:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787828230.292090:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273016192:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828231.123564:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828231.315413:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828232.147456:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828232.339406:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828233.171496:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828233.363470:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828234.195586:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828234.387433:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828235.219593:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828235.411454:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787828235.411487:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828235.411502:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787828235.411512:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828235.411531:0:8:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3399
00000100:00080000:3.0:1787828235.411552:0:8:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828235.411566:0:8:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787828235.411649:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705e00 x1874670273016320/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828235.411695:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828235.411700:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787828235.411703:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828235.411709:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3399
00000100:00080000:3.0:1787828235.411714:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828235.411720:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828235.411737:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787828235.411755:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704b40 x1874670273016448/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828235.411771:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828235.411776:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787828235.411779:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828235.411784:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3399
00000100:00080000:3.0:1787828235.411789:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828235.411795:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828235.411803:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828235.411813:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273016320:192.168.203.121@tcp:250:kworker.0
00000100:00100000:3.0:1787828235.411825:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705a40 x1874670273016576/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828235.411841:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828235.411845:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787828235.411847:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828235.411853:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3399
00000100:00080000:3.0:1787828235.411858:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828235.411862:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828235.411868:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787828235.411884:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704780 x1874670273016704/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828235.411897:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828235.411901:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787828235.411905:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828235.411911:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3399
00000100:00080000:3.0:1787828235.411916:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828235.411921:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828235.411928:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000800:00000100:0.0:1787828235.411934:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787828235.411950:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706580 x1874670273016832/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828235.411967:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828235.411971:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787828235.411973:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828235.411978:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3399
00000100:00080000:3.0:1787828235.411982:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828235.411985:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828235.411991:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787828235.412004:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057043c0 x1874670273016960/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828235.412016:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828235.412020:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787828235.412023:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828235.412032:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3399
00000100:00100000:0.0:1787828235.412034:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828235/real 1787828235]  req@ffff9ee005705e00 x1874670273016320/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828260 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828235.412036:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828235.412048:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828235.412078:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828235.412081:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705e00 x1874670273016320/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828260 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828235.412106:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:3.0:1787828235.412116:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707840 x1874670273017088/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828235.412117:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787828235.412130:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273016320:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787828235.412153:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273016448:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787828235.412196:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787828235.412214:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828235/real 1787828235]  req@ffff9ee005704b40 x1874670273016448/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828260 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787828235.412230:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704b40 x1874670273016448/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828260 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828235.412241:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787828235.412246:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787828235.412250:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273016448:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787828235.412282:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273016576:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787828235.412306:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787828235.412408:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828235/real 1787828235]  req@ffff9ee005705a40 x1874670273016576/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828260 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787828235.412425:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705a40 x1874670273016576/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828260 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828235.412436:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787828235.412440:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787828235.412444:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273016576:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787828235.412452:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273016704:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787828235.412492:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787828235.412515:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828235/real 1787828235]  req@ffff9ee005704780 x1874670273016704/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828260 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787828235.412541:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704780 x1874670273016704/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828260 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828235.412558:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787828235.412565:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787828235.412573:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273016704:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787828235.412583:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273016832:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787828235.412641:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787828235.412666:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828235/real 1787828235]  req@ffff9ee005706580 x1874670273016832/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828260 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787828235.412682:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706580 x1874670273016832/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828260 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828235.412692:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787828235.412696:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787828235.412700:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273016832:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787828235.412708:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273016960:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787828235.412732:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787828235.412743:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828235/real 1787828235]  req@ffff9ee0057043c0 x1874670273016960/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828260 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787828235.412758:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057043c0 x1874670273016960/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828260 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828235.412767:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787828235.412770:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787828235.412774:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273016960:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787828235.412780:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273017088:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787828235.412799:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787828235.412811:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828235/real 1787828235]  req@ffff9ee005707840 x1874670273017088/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828260 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787828235.412825:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707840 x1874670273017088/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828260 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828235.412834:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787828235.412837:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787828235.412841:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273017088:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828236.243519:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828236.435432:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828237.267438:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828237.459417:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828238.291515:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828238.483408:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828239.315475:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828239.507409:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828240.339468:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828240.531387:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:0.0:1787828240.531414:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828240.531420:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1787828240.531423:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828240.531431:0:8:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3404
00000100:00080000:0.0:1787828240.531440:0:8:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828240.531446:0:8:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787828240.531473:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ea940 x1874670273017216/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828240.531495:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828240.531497:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787828240.531498:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828240.531501:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3404
00000100:00080000:0.0:1787828240.531504:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828240.531507:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828240.531515:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787828240.531524:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273017216:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787828240.531526:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb0c0 x1874670273017344/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828240.531538:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828240.531540:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787828240.531541:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828240.531545:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3404
00000100:00080000:0.0:1787828240.531547:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828240.531549:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828240.531552:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828240.531568:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ea580 x1874670273017472/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828240.531588:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828240.531591:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787828240.531592:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828240.531595:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3404
00000100:00080000:0.0:1787828240.531598:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000800:00000100:1.0:1787828240.531602:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:0.0:1787828240.531606:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828240.531611:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828240.531638:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ead00 x1874670273017600/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828240.531645:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828240.531648:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787828240.531649:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828240.531654:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3404
00000100:00100000:1.0:1787828240.531658:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828240/real 1787828240]  req@ffff9ee0056ea940 x1874670273017216/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828265 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828240.531661:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828240.531672:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828240.531679:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787828240.531680:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ea940 x1874670273017216/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828265 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828240.531708:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:0.0:1787828240.531711:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9a40 x1874670273017728/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787828240.531714:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828240.531721:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273017216:192.168.203.121@tcp:250:kworker.0
00000100:00080000:0.0:1787828240.531737:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828240.531741:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787828240.531744:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1787828240.531749:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273017344:192.168.203.121@tcp:38:kworker.0
00000100:00080000:0.0:1787828240.531755:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3404
00000100:00080000:0.0:1787828240.531763:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828240.531769:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828240.531776:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1787828240.531776:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828240.531790:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828240/real 1787828240]  req@ffff9ee0056eb0c0 x1874670273017344/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828265 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787828240.531796:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9680 x1874670273017856/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828240.531805:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb0c0 x1874670273017344/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828265 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828240.531821:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828240.531828:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787828240.531830:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787828240.531834:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00080000:0.0:1787828240.531836:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1787828240.531840:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273017344:192.168.203.121@tcp:38:kworker.0
00000100:00080000:0.0:1787828240.531845:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3404
00000100:00100000:1.0:1787828240.531849:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273017472:192.168.203.121@tcp:8:kworker.0
00000100:00080000:0.0:1787828240.531852:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828240.531859:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828240.531865:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1787828240.531870:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787828240.531882:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8780 x1874670273017984/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828240.531883:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828240/real 1787828240]  req@ffff9ee0056ea580 x1874670273017472/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828265 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828240.531918:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ea580 x1874670273017472/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828265 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828240.531925:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828240.531928:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828240.531932:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273017472:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828240.531938:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273017600:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828240.531950:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828240.531956:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828240/real 1787828240]  req@ffff9ee0056ead00 x1874670273017600/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828265 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828240.531964:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ead00 x1874670273017600/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828265 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828240.531970:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828240.531972:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828240.531991:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273017600:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828240.531996:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273017728:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787828240.532016:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828240.532027:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828240/real 1787828240]  req@ffff9ee0056e9a40 x1874670273017728/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828265 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828240.532058:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9a40 x1874670273017728/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828265 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828240.532077:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828240.532081:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828240.532085:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273017728:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828240.532103:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273017856:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828240.532136:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828240.532144:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828240/real 1787828240]  req@ffff9ee0056e9680 x1874670273017856/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828265 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828240.532152:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9680 x1874670273017856/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828265 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828240.532158:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828240.532160:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828240.532162:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273017856:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828240.532165:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273017984:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828240.532175:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828240.532190:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828240/real 1787828240]  req@ffff9ee0056e8780 x1874670273017984/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828265 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828240.532198:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8780 x1874670273017984/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828265 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828240.532213:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828240.532215:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828240.532217:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273017984:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828241.363622:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828241.555463:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828242.387582:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828242.579427:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828243.411660:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828243.603411:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828244.435527:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828244.627407:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828245.459533:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828245.651464:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787828245.651575:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828245.651586:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787828245.651607:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828245.651622:0:8:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3409
00000100:00080000:3.0:1787828245.651641:0:8:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828245.651656:0:8:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787828245.651717:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707480 x1874670273018112/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828245.651758:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828245.651763:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787828245.651766:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828245.651772:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3409
00000100:00080000:3.0:1787828245.651779:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828245.651787:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828245.651801:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787828245.651822:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273018112:192.168.203.121@tcp:250:kworker.0
00000100:00100000:3.0:1787828245.651832:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057052c0 x1874670273018240/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828245.651862:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828245.651870:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787828245.651875:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828245.651886:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3409
00000100:00080000:3.0:1787828245.651895:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828245.651905:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000800:00000100:1.0:1787828245.651918:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000008:00100000:3.0:1787828245.651918:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787828245.651950:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707c00 x1874670273018368/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828245.651965:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828245.651970:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787828245.651973:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828245.651983:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3409
00000100:00100000:1.0:1787828245.651987:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828245/real 1787828245]  req@ffff9ee005707480 x1874670273018112/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828270 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828245.651990:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828245.652002:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828245.652024:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787828245.652052:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707480 x1874670273018112/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828270 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787828245.652057:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057061c0 x1874670273018496/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828245.652112:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828245.652116:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787828245.652119:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787828245.652127:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787828245.652133:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:3.0:1787828245.652142:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3409
00000100:00100000:1.0:1787828245.652149:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273018112:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787828245.652157:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828245.652174:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828245.652185:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787828245.652192:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273018240:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787828245.652218:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057070c0 x1874670273018624/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828245.652244:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828245.652249:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787828245.652252:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:1.0:1787828245.652275:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787828245.652279:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3409
00000100:00080000:3.0:1787828245.652292:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828245.652312:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787828245.652353:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828245/real 1787828245]  req@ffff9ee0057052c0 x1874670273018240/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828270 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:3.0:1787828245.652388:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787828245.652398:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057052c0 x1874670273018240/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828270 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828245.652414:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:3.0:1787828245.652417:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704000 x1874670273018752/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787828245.652426:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828245.652447:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273018240:192.168.203.121@tcp:38:kworker.0
00000100:00080000:3.0:1787828245.652453:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828245.652461:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:1.0:1787828245.652465:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273018368:192.168.203.121@tcp:8:kworker.0
00000100:00080000:3.0:1787828245.652466:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828245.652483:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3409
00000100:00080000:3.0:1787828245.652491:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828245.652496:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828245.652504:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1787828245.652527:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787828245.652527:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706d00 x1874670273018880/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828245.652588:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828245/real 1787828245]  req@ffff9ee005707c00 x1874670273018368/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828270 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828245.652626:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707c00 x1874670273018368/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828270 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828245.652643:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828245.652649:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828245.652655:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273018368:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828245.652664:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273018496:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828245.652694:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828245.652708:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828245/real 1787828245]  req@ffff9ee0057061c0 x1874670273018496/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828270 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828245.652723:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057061c0 x1874670273018496/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828270 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828245.652733:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828245.652738:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828245.652742:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273018496:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828245.652762:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273018624:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787828245.652783:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828245.652794:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828245/real 1787828245]  req@ffff9ee0057070c0 x1874670273018624/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828270 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828245.652808:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057070c0 x1874670273018624/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828270 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828245.652818:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828245.652822:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828245.652825:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273018624:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828245.652842:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273018752:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828245.652861:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828245.652872:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828245/real 1787828245]  req@ffff9ee005704000 x1874670273018752/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828270 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828245.652886:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704000 x1874670273018752/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828270 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828245.652895:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828245.652898:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828245.652903:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273018752:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828245.652910:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273018880:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828245.652927:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828245.652938:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828245/real 1787828245]  req@ffff9ee005706d00 x1874670273018880/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828270 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828245.652951:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706d00 x1874670273018880/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828270 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828245.652961:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828245.652964:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828245.652968:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273018880:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828246.483528:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828246.675564:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828247.507484:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828247.699418:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828248.531483:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828248.723401:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828249.555557:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828249.747439:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828250.579568:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828250.771438:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787828250.771464:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828250.771554:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787828250.771563:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828250.771602:0:8:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3414
00000100:00080000:3.0:1787828250.771616:0:8:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828250.771626:0:8:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787828250.771670:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706940 x1874670273019008/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828250.771707:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828250.771712:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787828250.771715:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828250.771720:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3414
00000100:00080000:3.0:1787828250.771724:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828250.771730:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828250.771743:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787828250.771770:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705680 x1874670273019136/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828250.771771:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273019008:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787828250.771801:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828250.771805:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787828250.771808:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828250.771812:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3414
00000100:00080000:3.0:1787828250.771818:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828250.771822:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828250.771829:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787828250.771847:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706d00 x1874670273019264/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828250.771868:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828250.771874:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787828250.771877:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828250.771881:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3414
00000100:00080000:3.0:1787828250.771885:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828250.771889:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828250.771894:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787828250.771905:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704000 x1874670273019392/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828250.771915:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828250.771920:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787828250.771923:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828250.771927:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3414
00000100:00080000:3.0:1787828250.771931:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828250.771935:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828250.771941:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787828250.771957:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057070c0 x1874670273019520/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828250.771967:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828250.771971:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787828250.771974:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828250.771978:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3414
00000100:00080000:3.0:1787828250.771983:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828250.771990:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828250.771997:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787828250.772014:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273019136:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787828250.772025:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057061c0 x1874670273019648/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828250.772055:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828250.772062:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787828250.772067:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1787828250.772076:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273019264:192.168.203.121@tcp:8:kworker.0
00000100:00080000:3.0:1787828250.772084:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3414
00000100:00080000:3.0:1787828250.772099:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828250.772109:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828250.772122:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787828250.772127:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273019392:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787828250.772154:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707c00 x1874670273019776/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828250.772169:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273019520:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828250.772205:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273019648:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828250.772234:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273019776:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828251.603545:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828251.795441:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828252.627665:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828252.819408:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828253.651602:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828253.843459:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000400:00000100:2.0:1787828253.843678:0:2352:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.203.121:988
00000400:00000100:2.0:1787828253.843724:0:2352:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.203.121@tcp at host 192.168.203.121 was unreachable: the network or that node may be down, or Lustre may be misconfigured.
00000800:00000100:2.0:1787828253.843743:0:2352:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:2.0:1787828253.843805:0:2352:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:2.0:1787828253.843820:0:2352:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:2.0:1787828253.843832:0:2352:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:2.0:1787828253.843844:0:2352:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:2.0:1787828253.843855:0:2352:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:2.0:1787828253.843869:0:2352:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000100:00100000:1.0:1787828253.843919:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828250/real 1787828253]  req@ffff9ee0057061c0 x1874670273019648/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828275 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828253.843959:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057061c0 x1874670273019648/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828275 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828253.843977:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828253.843985:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828253.843992:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273019648:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828253.844005:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828250/real 1787828253]  req@ffff9ee005707c00 x1874670273019776/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828275 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828253.844026:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707c00 x1874670273019776/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828275 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828253.844037:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828253.844042:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828253.844048:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273019776:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828253.844060:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828250/real 1787828253]  req@ffff9ee005705680 x1874670273019136/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828275 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828253.844080:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705680 x1874670273019136/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828275 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828253.844094:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828253.844100:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828253.844105:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273019136:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828253.844114:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828250/real 1787828253]  req@ffff9ee005706d00 x1874670273019264/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828275 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828253.844132:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706d00 x1874670273019264/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828275 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828253.844154:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828253.844160:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828253.844165:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273019264:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828253.844180:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828250/real 1787828253]  req@ffff9ee005704000 x1874670273019392/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828275 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828253.844199:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704000 x1874670273019392/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828275 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828253.844212:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828253.844217:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828253.844221:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273019392:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828253.844231:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828250/real 1787828253]  req@ffff9ee0057070c0 x1874670273019520/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828275 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828253.844249:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057070c0 x1874670273019520/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828275 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828253.844264:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828253.844269:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828253.844275:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273019520:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828253.844286:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828250/real 1787828253]  req@ffff9ee005706940 x1874670273019008/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828275 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828253.844305:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706940 x1874670273019008/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828275 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828253.844344:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828253.844350:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828253.844355:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273019008:192.168.203.121@tcp:250:kworker.0
00010000:00010000:3.0:1787828254.675560:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828254.867418:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828255.699463:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828255.891428:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:2.0:1787828255.891479:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828255.891485:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787828255.891489:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828255.891498:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3419
00000100:00080000:2.0:1787828255.891519:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828255.891526:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787828255.891557:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b480 x1874670273019904/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828255.891581:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828255.891584:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787828255.891586:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828255.891589:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3419
00000100:00080000:2.0:1787828255.891591:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828255.891594:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828255.891602:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787828255.891613:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572ad00 x1874670273020032/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828255.891622:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828255.891626:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787828255.891627:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1787828255.891633:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273019904:192.168.203.121@tcp:250:kworker.0
00000100:00080000:2.0:1787828255.891633:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3419
00000100:00080000:2.0:1787828255.891639:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828255.891647:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828255.891651:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828255.891660:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b0c0 x1874670273020160/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828255.891667:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828255.891670:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787828255.891673:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828255.891678:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3419
00000100:00080000:2.0:1787828255.891682:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828255.891688:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828255.891693:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828255.891707:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729a40 x1874670273020288/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1787828255.891720:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:2.0:1787828255.891722:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828255.891728:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787828255.891731:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828255.891737:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3419
00000100:00080000:2.0:1787828255.891743:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828255.891748:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828255.891755:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787828255.891769:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728b40 x1874670273020416/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828255.891780:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1787828255.891782:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828255/real 1787828255]  req@ffff9ee00572b480 x1874670273019904/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828280 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828255.891788:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787828255.891793:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828255.891807:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3419
00000100:00080000:2.0:1787828255.891814:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828255.891822:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787828255.891824:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b480 x1874670273019904/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828280 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:2.0:1787828255.891831:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:1.0:1787828255.891847:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:2.0:1787828255.891852:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a580 x1874670273020544/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787828255.891858:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828255.891869:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273019904:192.168.203.121@tcp:250:kworker.0
00000100:00080000:2.0:1787828255.891875:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828255.891887:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787828255.891889:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828255.891896:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3419
00000100:00080000:2.0:1787828255.891900:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828255.891904:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828255.891910:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787828255.891912:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273020032:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787828255.891934:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728000 x1874670273020672/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1787828255.891950:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828255.891973:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828255/real 1787828255]  req@ffff9ee00572ad00 x1874670273020032/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828280 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828255.891989:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572ad00 x1874670273020032/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828280 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828255.892000:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828255.892005:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828255.892009:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273020032:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828255.892018:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273020160:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828255.892052:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828255.892072:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828255/real 1787828255]  req@ffff9ee00572b0c0 x1874670273020160/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828280 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828255.892086:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b0c0 x1874670273020160/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828280 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828255.892096:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828255.892100:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828255.892104:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273020160:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828255.892111:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273020288:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828255.892144:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828255.892160:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828255/real 1787828255]  req@ffff9ee005729a40 x1874670273020288/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828280 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828255.892183:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729a40 x1874670273020288/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828280 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828255.892194:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828255.892197:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828255.892201:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273020288:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828255.892208:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273020416:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787828255.892231:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828255.892243:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828255/real 1787828255]  req@ffff9ee005728b40 x1874670273020416/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828280 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828255.892257:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728b40 x1874670273020416/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828280 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828255.892268:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828255.892272:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828255.892276:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273020416:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828255.892284:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273020544:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828255.892304:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828255.892342:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828255/real 1787828255]  req@ffff9ee00572a580 x1874670273020544/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828280 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828255.892357:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a580 x1874670273020544/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828280 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828255.892376:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828255.892380:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828255.892384:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273020544:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828255.892409:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273020672:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828255.892435:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828255.892450:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828255/real 1787828255]  req@ffff9ee005728000 x1874670273020672/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828280 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828255.892483:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728000 x1874670273020672/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828280 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828255.892496:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828255.892501:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828255.892506:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273020672:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828256.723622:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828256.915499:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828257.747464:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828257.939391:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828258.771435:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828258.963429:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828259.795490:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828259.987500:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828260.819625:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828261.011468:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:0.0:1787828261.011473:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828261.011485:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1787828261.011491:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828261.011503:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3424
00000100:00080000:0.0:1787828261.011517:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828261.011527:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787828261.011577:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9e00 x1874670273020800/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828261.011606:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828261.011609:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787828261.011611:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828261.011614:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3424
00000100:00080000:0.0:1787828261.011617:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828261.011619:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828261.011630:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787828261.011640:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8b40 x1874670273020928/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828261.011650:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828261.011653:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787828261.011656:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828261.011660:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3424
00000100:00080000:0.0:1787828261.011663:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828261.011666:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828261.011670:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828261.011687:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e92c0 x1874670273021056/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828261.011688:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273020800:192.168.203.121@tcp:250:kworker.0
00000100:00080000:0.0:1787828261.011728:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828261.011735:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787828261.011737:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828261.011747:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3424
00000100:00080000:0.0:1787828261.011751:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828261.011755:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828261.011763:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828261.011783:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb840 x1874670273021184/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828261.011792:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828261.011796:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787828261.011797:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:1.0:1787828261.011823:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:0.0:1787828261.011826:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3424
00000100:00080000:0.0:1787828261.011833:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828261.011837:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828261.011843:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787828261.011855:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb480 x1874670273021312/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828261.011862:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828261.011864:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787828261.011865:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828261.011868:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3424
00000100:00080000:0.0:1787828261.011870:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828261.011872:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828261.011892:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828261.011898:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8000 x1874670273021440/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828261.011905:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828261.011907:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787828261.011909:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828261.011915:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3424
00000100:00080000:0.0:1787828261.011918:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828261.011922:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828261.011928:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828261.011938:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e83c0 x1874670273021568/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828261.011977:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828261/real 1787828261]  req@ffff9ee0056e9e00 x1874670273020800/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828286 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828261.012016:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9e00 x1874670273020800/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828286 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828261.012040:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828261.012050:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828261.012059:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273020800:192.168.203.121@tcp:250:kworker.0
00000100:00100000:1.0:1787828261.012075:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273020928:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787828261.012115:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828261.012134:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828261/real 1787828261]  req@ffff9ee0056e8b40 x1874670273020928/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828286 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828261.012150:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8b40 x1874670273020928/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828286 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828261.012160:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828261.012165:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828261.012169:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273020928:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828261.012201:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273021056:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828261.012223:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828261.012235:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828261/real 1787828261]  req@ffff9ee0056e92c0 x1874670273021056/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828286 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828261.012249:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e92c0 x1874670273021056/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828286 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828261.012259:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828261.012263:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828261.012267:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273021056:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828261.012275:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273021184:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828261.012293:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828261.012304:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828261/real 1787828261]  req@ffff9ee0056eb840 x1874670273021184/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828286 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828261.012354:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb840 x1874670273021184/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828286 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828261.012364:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828261.012368:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828261.012372:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273021184:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828261.012380:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273021312:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787828261.012403:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828261.012416:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828261/real 1787828261]  req@ffff9ee0056eb480 x1874670273021312/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828286 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828261.012457:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb480 x1874670273021312/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828286 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828261.012470:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828261.012474:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828261.012479:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273021312:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828261.012487:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273021440:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828261.012514:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828261.012529:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828261/real 1787828261]  req@ffff9ee0056e8000 x1874670273021440/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828286 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828261.012544:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8000 x1874670273021440/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828286 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828261.012553:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828261.012557:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828261.012561:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273021440:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828261.012567:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273021568:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828261.012585:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828261.012595:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828261/real 1787828261]  req@ffff9ee0056e83c0 x1874670273021568/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828286 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828261.012609:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e83c0 x1874670273021568/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828286 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828261.012618:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828261.012621:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828261.012625:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273021568:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828261.843461:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828262.035454:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828262.867631:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828263.059433:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828263.891556:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828264.083474:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828264.915494:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828265.107413:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828265.939479:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828266.131485:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:2.0:1787828266.131543:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828266.131556:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787828266.131562:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828266.131576:0:8:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3429
00000100:00080000:2.0:1787828266.131593:0:8:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828266.131603:0:8:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787828266.131680:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057283c0 x1874670273021696/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828266.131727:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828266.131732:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787828266.131736:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828266.131743:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3429
00000100:00080000:2.0:1787828266.131748:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828266.131755:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787828266.131769:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273021696:192.168.203.121@tcp:250:kworker.0
00000008:00100000:2.0:1787828266.131772:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787828266.131796:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b840 x1874670273021824/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828266.131812:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828266.131817:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787828266.131820:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828266.131825:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3429
00000100:00080000:2.0:1787828266.131832:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828266.131837:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000800:00000100:1.0:1787828266.131848:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000008:00100000:2.0:1787828266.131857:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828266.131874:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728f00 x1874670273021952/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828266.131889:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828266.131893:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787828266.131896:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828266.131905:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3429
00000100:00080000:2.0:1787828266.131913:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1787828266.131918:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828266/real 1787828266]  req@ffff9ee0057283c0 x1874670273021696/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828291 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828266.131926:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828266.131941:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787828266.131960:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057283c0 x1874670273021696/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828291 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828266.131963:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a1c0 x1874670273022080/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828266.132010:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828266.132031:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828266.132035:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787828266.132041:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:2.0:1787828266.132041:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1787828266.132053:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273021696:192.168.203.121@tcp:250:kworker.0
00000100:00080000:2.0:1787828266.132054:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3429
00000100:00080000:2.0:1787828266.132067:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828266.132074:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828266.132081:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787828266.132094:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273021824:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787828266.132102:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729e00 x1874670273022208/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828266.132121:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828266.132125:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787828266.132128:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828266.132140:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3429
00000800:00000100:1.0:1787828266.132147:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:2.0:1787828266.132149:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828266.132160:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828266.132166:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787828266.132182:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828266/real 1787828266]  req@ffff9ee00572b840 x1874670273021824/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828291 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828266.132194:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a940 x1874670273022336/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828266.132234:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1787828266.132235:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b840 x1874670273021824/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828291 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828266.132242:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787828266.132247:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828266.132263:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3429
00000100:00080000:1.0:1787828266.132266:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828266.132273:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828266.132274:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828266.132285:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273021824:192.168.203.121@tcp:38:kworker.0
00000100:00080000:2.0:1787828266.132285:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828266.132301:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787828266.132307:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273021952:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787828266.132340:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728780 x1874670273022464/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1787828266.132371:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828266.132384:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828266/real 1787828266]  req@ffff9ee005728f00 x1874670273021952/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828291 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828266.132411:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728f00 x1874670273021952/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828291 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828266.132435:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828266.132440:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828266.132466:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273021952:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828266.132476:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273022080:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828266.132510:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828266.132521:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828266/real 1787828266]  req@ffff9ee00572a1c0 x1874670273022080/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828291 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828266.132529:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a1c0 x1874670273022080/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828291 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828266.132534:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828266.132537:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828266.132539:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273022080:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828266.132556:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273022208:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787828266.132568:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828266.132573:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828266/real 1787828266]  req@ffff9ee005729e00 x1874670273022208/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828291 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828266.132581:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729e00 x1874670273022208/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828291 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828266.132586:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828266.132588:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828266.132591:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273022208:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828266.132595:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273022336:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828266.132605:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828266.132611:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828266/real 1787828266]  req@ffff9ee00572a940 x1874670273022336/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828291 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828266.132618:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a940 x1874670273022336/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828291 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828266.132623:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828266.132625:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828266.132627:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273022336:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828266.132631:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273022464:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828266.132639:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828266.132645:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828266/real 1787828266]  req@ffff9ee005728780 x1874670273022464/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828291 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828266.132651:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728780 x1874670273022464/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828291 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828266.132656:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828266.132658:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828266.132660:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273022464:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828266.963606:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828267.155446:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828267.987573:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828268.179419:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828269.011573:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828269.203433:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828270.035564:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828270.227499:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828271.059495:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828271.251439:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:0.0:1787828271.251552:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828271.251561:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1787828271.251568:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828271.251580:0:8:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3434
00000100:00080000:0.0:1787828271.251604:0:8:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828271.251614:0:8:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787828271.251675:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8f00 x1874670273022592/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828271.251711:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828271.251716:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787828271.251719:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828271.251724:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3434
00000100:00080000:0.0:1787828271.251729:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828271.251733:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828271.251746:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787828271.251764:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ebc00 x1874670273022720/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828271.251777:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273022592:192.168.203.121@tcp:250:kworker.0
00000100:00080000:0.0:1787828271.251807:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828271.251814:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787828271.251819:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828271.251831:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3434
00000100:00080000:0.0:1787828271.251868:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828271.251884:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000800:00000100:1.0:1787828271.251884:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000008:00100000:0.0:1787828271.251901:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828271.251933:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e83c0 x1874670273022848/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828271.251958:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828271.251963:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787828271.251966:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1787828271.251976:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828271/real 1787828271]  req@ffff9ee0056e8f00 x1874670273022592/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828296 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828271.251977:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3434
00000100:00080000:0.0:1787828271.252000:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828271.252010:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828271.252017:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787828271.252026:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8f00 x1874670273022592/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828296 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787828271.252040:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8000 x1874670273022976/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787828271.252088:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787828271.252102:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828271.252104:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:0.0:1787828271.252118:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00100000:1.0:1787828271.252122:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273022592:192.168.203.121@tcp:250:kworker.0
00000100:00080000:0.0:1787828271.252126:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828271.252152:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3434
00000100:00080000:0.0:1787828271.252160:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828271.252168:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828271.252178:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787828271.252202:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273022720:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787828271.252204:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb480 x1874670273023104/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828271.252230:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828271.252235:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787828271.252238:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828271.252244:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3434
00000100:00080000:0.0:1787828271.252253:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000800:00000100:1.0:1787828271.252262:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:0.0:1787828271.252263:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828271.252276:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787828271.252295:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828271/real 1787828271]  req@ffff9ee0056ebc00 x1874670273022720/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828296 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787828271.252298:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb840 x1874670273023232/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828271.252405:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ebc00 x1874670273022720/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828296 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828271.252447:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828271.252450:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787828271.252459:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787828271.252463:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00080000:0.0:1787828271.252467:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1787828271.252475:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273022720:192.168.203.121@tcp:38:kworker.0
00000100:00080000:0.0:1787828271.252483:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3434
00000100:00080000:0.0:1787828271.252493:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1787828271.252498:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273022848:192.168.203.121@tcp:8:kworker.0
00000100:00080000:0.0:1787828271.252506:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828271.252522:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828271.252557:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e92c0 x1874670273023360/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1787828271.252572:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828271.252611:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828271/real 1787828271]  req@ffff9ee0056e83c0 x1874670273022848/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828296 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828271.252641:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e83c0 x1874670273022848/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828296 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828271.252661:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828271.252669:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828271.252676:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273022848:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828271.252691:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273022976:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828271.252725:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828271.252741:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828271/real 1787828271]  req@ffff9ee0056e8000 x1874670273022976/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828296 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828271.252756:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8000 x1874670273022976/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828296 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828271.252767:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828271.252771:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828271.252775:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273022976:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828271.252798:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273023104:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787828271.252819:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828271.252831:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828271/real 1787828271]  req@ffff9ee0056eb480 x1874670273023104/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828296 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828271.252862:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb480 x1874670273023104/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828296 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828271.252872:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828271.252875:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828271.252879:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273023104:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828271.252886:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273023232:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828271.252915:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828271.252926:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828271/real 1787828271]  req@ffff9ee0056eb840 x1874670273023232/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828296 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828271.252939:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb840 x1874670273023232/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828296 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828271.252949:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828271.252952:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828271.252956:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273023232:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828271.252962:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273023360:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828271.252986:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828271.253005:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828271/real 1787828271]  req@ffff9ee0056e92c0 x1874670273023360/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828296 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828271.253029:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e92c0 x1874670273023360/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828296 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828271.253059:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828271.253066:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828271.253073:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273023360:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828272.083577:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828272.275557:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828273.107559:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828273.299466:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828274.131707:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828274.323458:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828275.155572:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828275.347420:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828276.179450:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828276.371425:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:1.0:1787828276.371442:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828276.371448:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1787828276.371452:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787828276.371460:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3440
00000100:00080000:1.0:1787828276.371469:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828276.371475:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787828276.371506:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a03c0 x1874670273023488/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787828276.371529:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828276.371532:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787828276.371534:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787828276.371536:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3440
00000100:00080000:1.0:1787828276.371539:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828276.371541:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787828276.371549:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787828276.371557:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a12c0 x1874670273023616/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787828276.371565:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828276.371569:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00100000:0.0:1787828276.371570:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273023488:192.168.203.121@tcp:250:kworker.0
00000100:00080000:1.0:1787828276.371571:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787828276.371577:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3440
00000100:00080000:1.0:1787828276.371582:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828276.371585:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787828276.371587:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787828276.371608:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1a40 x1874670273023744/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787828276.371614:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828276.371617:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787828276.371618:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787828276.371621:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3440
00000100:00080000:1.0:1787828276.371633:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828276.371635:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787828276.371638:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787828276.371645:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a3c00 x1874670273023872/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787828276.371651:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828276.371653:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787828276.371654:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787828276.371656:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3440
00000100:00080000:1.0:1787828276.371657:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828276.371659:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787828276.371662:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787828276.371667:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a2940 x1874670273024000/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787828276.371673:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828276.371675:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787828276.371676:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:0.0:1787828276.371681:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:1.0:1787828276.371684:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3440
00000100:00080000:1.0:1787828276.371687:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828276.371689:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787828276.371691:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787828276.371697:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1680 x1874670273024128/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787828276.371703:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828276.371705:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787828276.371707:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787828276.371710:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3440
00000100:00080000:1.0:1787828276.371713:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828276.371714:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787828276.371717:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787828276.371723:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0f00 x1874670273024256/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787828276.371737:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828276/real 1787828276]  req@ffff9ee0056a03c0 x1874670273023488/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828301 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787828276.371751:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a03c0 x1874670273023488/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828301 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828276.371760:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787828276.371763:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787828276.371766:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273023488:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787828276.371784:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273023616:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787828276.371800:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787828276.371809:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828276/real 1787828276]  req@ffff9ee0056a12c0 x1874670273023616/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828301 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787828276.371817:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a12c0 x1874670273023616/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828301 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828276.371822:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787828276.371824:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787828276.371826:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273023616:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787828276.371830:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273023744:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787828276.371841:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787828276.371846:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828276/real 1787828276]  req@ffff9ee0056a1a40 x1874670273023744/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828301 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787828276.371853:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1a40 x1874670273023744/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828301 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828276.371859:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787828276.371860:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787828276.371862:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273023744:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787828276.371866:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273023872:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787828276.371875:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787828276.371880:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828276/real 1787828276]  req@ffff9ee0056a3c00 x1874670273023872/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828301 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787828276.371888:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a3c00 x1874670273023872/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828301 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828276.371892:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787828276.371894:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787828276.371896:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273023872:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787828276.371899:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273024000:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787828276.371910:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787828276.371915:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828276/real 1787828276]  req@ffff9ee0056a2940 x1874670273024000/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828301 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787828276.371922:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a2940 x1874670273024000/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828301 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828276.371934:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787828276.371936:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787828276.371938:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273024000:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787828276.371942:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273024128:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787828276.371953:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787828276.371959:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828276/real 1787828276]  req@ffff9ee0056a1680 x1874670273024128/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828301 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787828276.371966:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1680 x1874670273024128/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828301 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828276.371972:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787828276.371974:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787828276.371976:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273024128:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787828276.371979:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273024256:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787828276.371988:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787828276.371993:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828276/real 1787828276]  req@ffff9ee0056a0f00 x1874670273024256/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828301 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787828276.372000:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0f00 x1874670273024256/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828301 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828276.372004:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787828276.372006:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787828276.372008:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273024256:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828277.203492:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828277.395385:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828278.227472:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828278.419444:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828279.251448:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828279.443395:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828280.275544:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828280.467393:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828281.299466:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828281.491396:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:1.0:1787828281.491419:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828281.491426:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1787828281.491431:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787828281.491441:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3445
00000100:00080000:1.0:1787828281.491451:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828281.491458:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787828281.491495:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a21c0 x1874670273024384/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787828281.491520:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828281.491524:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787828281.491526:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787828281.491530:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3445
00000100:00080000:1.0:1787828281.491535:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828281.491540:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787828281.491548:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273024384:192.168.203.121@tcp:250:kworker.0
00000008:00100000:1.0:1787828281.491551:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787828281.491570:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0f00 x1874670273024512/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787828281.491582:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828281.491585:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787828281.491587:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787828281.491591:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3445
00000800:00000100:0.0:1787828281.491606:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:1.0:1787828281.491608:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828281.491615:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787828281.491622:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787828281.491636:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1680 x1874670273024640/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787828281.491644:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828281/real 1787828281]  req@ffff9ee0056a21c0 x1874670273024384/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828306 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828281.491675:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1787828281.491679:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a21c0 x1874670273024384/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828306 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828281.491684:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787828281.491689:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828281.491693:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828281.491697:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3445
00000100:00080000:0.0:1787828281.491700:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787828281.491706:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273024384:192.168.203.121@tcp:250:kworker.0
00000100:00080000:1.0:1787828281.491707:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828281.491716:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787828281.491721:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828281.491729:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273024512:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828281.491737:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a2940 x1874670273024768/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1787828281.491748:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:1.0:1787828281.491750:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828281.491755:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787828281.491758:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1787828281.491760:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828281/real 1787828281]  req@ffff9ee0056a0f00 x1874670273024512/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828306 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828281.491766:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3445
00000100:00080000:1.0:1787828281.491774:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1787828281.491778:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0f00 x1874670273024512/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828306 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828281.491784:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00080000:0.0:1787828281.491793:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000008:00100000:1.0:1787828281.491793:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00080000:0.0:1787828281.491798:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787828281.491802:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273024512:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787828281.491811:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273024640:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828281.491812:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a3c00 x1874670273024896/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787828281.491826:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:0.0:1787828281.491830:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:1.0:1787828281.491832:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787828281.491836:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1787828281.491841:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828281/real 1787828281]  req@ffff9ee0056a1680 x1874670273024640/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828306 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828281.491843:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3445
00000100:00080000:1.0:1787828281.491851:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1787828281.491856:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1680 x1874670273024640/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828306 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828281.491858:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787828281.491868:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:0.0:1787828281.491869:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787828281.491876:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787828281.491878:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273024640:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828281.491886:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1a40 x1874670273025024/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787828281.491892:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273024768:192.168.203.121@tcp:8:kworker.0
00000100:00080000:1.0:1787828281.491907:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828281.491911:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000800:00000100:0.0:1787828281.491914:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:1.0:1787828281.491916:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787828281.491924:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3445
00000100:00100000:0.0:1787828281.491925:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828281/real 1787828281]  req@ffff9ee0056a2940 x1874670273024768/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828306 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828281.491931:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1787828281.491939:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a2940 x1874670273024768/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828306 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828281.491940:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787828281.491949:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:0.0:1787828281.491950:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787828281.491957:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787828281.491960:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273024768:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787828281.491968:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273024896:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828281.491969:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a12c0 x1874670273025152/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1787828281.491983:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787828281.491991:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828281/real 1787828281]  req@ffff9ee0056a3c00 x1874670273024896/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828306 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787828281.492000:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a3c00 x1874670273024896/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828306 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828281.492005:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787828281.492007:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787828281.492008:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273024896:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787828281.492016:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273025024:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787828281.492026:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787828281.492031:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828281/real 1787828281]  req@ffff9ee0056a1a40 x1874670273025024/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828306 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787828281.492038:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1a40 x1874670273025024/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828306 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828281.492044:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787828281.492046:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787828281.492048:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273025024:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787828281.492051:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273025152:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787828281.492060:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787828281.492065:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828281/real 1787828281]  req@ffff9ee0056a12c0 x1874670273025152/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828306 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787828281.492071:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a12c0 x1874670273025152/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828306 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828281.492076:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787828281.492078:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787828281.492080:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273025152:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828282.323568:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828282.515415:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828283.347448:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828283.539364:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828284.371460:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828284.563369:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828285.395466:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828285.587369:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828286.419490:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1787828286.611381:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1787828286.611381:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:1.0:1787828286.611392:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1787828286.611397:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787828286.611407:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3450
00000100:00080000:1.0:1787828286.611418:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828286.611427:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787828286.611460:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a03c0 x1874670273025280/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787828286.611485:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828286.611495:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787828286.611497:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787828286.611502:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3450
00000100:00080000:1.0:1787828286.611506:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828286.611511:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787828286.611521:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787828286.611522:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273025280:192.168.203.121@tcp:250:kworker.0
00000100:00100000:1.0:1787828286.611535:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1e00 x1874670273025408/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787828286.611545:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828286.611548:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787828286.611550:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787828286.611552:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3450
00000100:00080000:1.0:1787828286.611556:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828286.611558:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787828286.611562:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787828286.611570:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0b40 x1874670273025536/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787828286.611577:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:0.0:1787828286.611581:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:1.0:1787828286.611582:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787828286.611585:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787828286.611589:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3450
00000100:00080000:1.0:1787828286.611592:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828286.611595:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787828286.611599:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787828286.611607:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a2580 x1874670273025664/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787828286.611613:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828286.611616:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787828286.611617:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787828286.611622:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3450
00000100:00100000:0.0:1787828286.611624:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828286/real 1787828286]  req@ffff9ee0056a03c0 x1874670273025280/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828311 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828286.611625:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828286.611630:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787828286.611636:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787828286.611647:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a3480 x1874670273025792/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787828286.611655:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a03c0 x1874670273025280/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828311 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828286.611656:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828286.611664:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787828286.611668:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787828286.611676:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3450
00000100:00080000:0.0:1787828286.611677:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828286.611679:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828286.611684:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:1.0:1787828286.611685:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787828286.611691:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828286.611692:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273025280:192.168.203.121@tcp:250:kworker.0
00000100:00100000:1.0:1787828286.611701:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0780 x1874670273025920/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787828286.611708:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828286.611710:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787828286.611712:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787828286.611715:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3450
00000100:00100000:0.0:1787828286.611718:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273025408:192.168.203.121@tcp:38:kworker.0
00000100:00080000:1.0:1787828286.611719:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828286.611725:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787828286.611729:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787828286.611738:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0000 x1874670273026048/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1787828286.611746:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787828286.611758:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828286/real 1787828286]  req@ffff9ee0056a1e00 x1874670273025408/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828311 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787828286.611769:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1e00 x1874670273025408/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828311 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828286.611775:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787828286.611778:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787828286.611780:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273025408:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787828286.611786:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273025536:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787828286.611801:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787828286.611809:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828286/real 1787828286]  req@ffff9ee0056a0b40 x1874670273025536/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828311 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787828286.611818:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0b40 x1874670273025536/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828311 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828286.611823:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787828286.611825:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787828286.611827:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273025536:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787828286.611831:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273025664:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787828286.611860:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787828286.611868:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828286/real 1787828286]  req@ffff9ee0056a2580 x1874670273025664/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828311 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787828286.611878:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a2580 x1874670273025664/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828311 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828286.611884:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787828286.611887:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787828286.611890:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273025664:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787828286.611896:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273025792:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787828286.611911:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787828286.611919:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828286/real 1787828286]  req@ffff9ee0056a3480 x1874670273025792/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828311 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787828286.611926:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a3480 x1874670273025792/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828311 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828286.611932:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787828286.611934:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787828286.611936:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273025792:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787828286.611941:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273025920:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787828286.611956:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787828286.611963:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828286/real 1787828286]  req@ffff9ee0056a0780 x1874670273025920/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828311 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787828286.611971:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0780 x1874670273025920/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828311 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828286.611978:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787828286.611981:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787828286.611983:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273025920:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787828286.612002:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273026048:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787828286.612012:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787828286.612019:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828286/real 1787828286]  req@ffff9ee0056a0000 x1874670273026048/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828311 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787828286.612028:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0000 x1874670273026048/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828311 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828286.612034:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787828286.612036:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787828286.612038:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273026048:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828287.443483:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828287.635371:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828288.467499:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828288.659370:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828289.491502:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828289.683381:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828290.515524:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828290.707440:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828291.539479:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1787828291.731443:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828291.731451:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1787828291.731456:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1787828291.731457:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:1.0:1787828291.731466:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3455
00000100:00080000:1.0:1787828291.731477:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828291.731483:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787828291.731515:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a30c0 x1874670273026176/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787828291.731537:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828291.731540:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787828291.731542:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787828291.731544:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3455
00000100:00080000:1.0:1787828291.731546:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828291.731549:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787828291.731556:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787828291.731566:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0000 x1874670273026304/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787828291.731579:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1787828291.731582:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273026176:192.168.203.121@tcp:250:kworker.0
00000100:00080000:1.0:1787828291.731582:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787828291.731585:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787828291.731593:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3455
00000100:00080000:1.0:1787828291.731595:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828291.731597:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787828291.731601:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787828291.731609:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0780 x1874670273026432/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787828291.731615:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828291.731618:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787828291.731620:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787828291.731622:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3455
00000100:00080000:1.0:1787828291.731634:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828291.731636:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787828291.731639:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:0.0:1787828291.731643:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828291.731648:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a3480 x1874670273026560/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787828291.731656:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828291.731658:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787828291.731660:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787828291.731663:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3455
00000100:00080000:1.0:1787828291.731665:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828291.731667:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787828291.731670:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787828291.731679:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a2580 x1874670273026688/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787828291.731683:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828291/real 1787828291]  req@ffff9ee0056a30c0 x1874670273026176/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828316 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828291.731690:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828291.731697:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787828291.731700:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787828291.731704:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3455
00000100:00080000:1.0:1787828291.731707:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1787828291.731711:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a30c0 x1874670273026176/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828316 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828291.731714:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787828291.731720:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:0.0:1787828291.731727:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:1.0:1787828291.731731:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0b40 x1874670273026816/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828291.731732:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787828291.731740:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273026176:192.168.203.121@tcp:250:kworker.0
00000100:00080000:1.0:1787828291.731749:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828291.731752:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787828291.731754:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787828291.731757:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3455
00000100:00080000:1.0:1787828291.731759:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828291.731761:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787828291.731764:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828291.731767:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273026304:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828291.731774:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1e00 x1874670273026944/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1787828291.731787:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787828291.731799:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828291/real 1787828291]  req@ffff9ee0056a0000 x1874670273026304/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828316 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787828291.731809:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0000 x1874670273026304/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828316 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828291.731815:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787828291.731817:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787828291.731819:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273026304:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787828291.731823:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273026432:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787828291.731857:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787828291.731868:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828291/real 1787828291]  req@ffff9ee0056a0780 x1874670273026432/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828316 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787828291.731882:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0780 x1874670273026432/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828316 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828291.731891:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787828291.731895:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787828291.731899:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273026432:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787828291.731906:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273026560:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787828291.731925:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787828291.731934:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828291/real 1787828291]  req@ffff9ee0056a3480 x1874670273026560/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828316 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787828291.731942:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a3480 x1874670273026560/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828316 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828291.731948:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787828291.731950:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787828291.731952:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273026560:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787828291.731956:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273026688:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787828291.731984:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787828291.731991:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828291/real 1787828291]  req@ffff9ee0056a2580 x1874670273026688/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828316 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787828291.731999:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a2580 x1874670273026688/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828316 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828291.732004:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787828291.732006:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787828291.732008:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273026688:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787828291.732012:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273026816:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787828291.732022:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787828291.732028:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828291/real 1787828291]  req@ffff9ee0056a0b40 x1874670273026816/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828316 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787828291.732036:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0b40 x1874670273026816/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828316 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828291.732042:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787828291.732044:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787828291.732046:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273026816:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787828291.732061:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273026944:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787828291.732072:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787828291.732078:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828291/real 1787828291]  req@ffff9ee0056a1e00 x1874670273026944/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828316 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787828291.732086:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1e00 x1874670273026944/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828316 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828291.732092:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787828291.732093:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787828291.732095:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273026944:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828292.563434:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828292.755418:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828293.587451:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828293.779406:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828294.611472:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828294.803381:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828295.635486:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828295.827447:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828296.659488:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828296.851424:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787828296.851424:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828296.851435:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787828296.851440:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828296.851449:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3460
00000100:00080000:3.0:1787828296.851461:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828296.851468:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787828296.851498:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057052c0 x1874670273027072/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828296.851521:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828296.851524:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787828296.851525:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828296.851527:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3460
00000100:00080000:3.0:1787828296.851530:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828296.851532:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828296.851540:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787828296.851548:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707480 x1874670273027200/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828296.851556:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828296.851558:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787828296.851560:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828296.851566:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3460
00000100:00100000:0.0:1787828296.851568:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273027072:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787828296.851569:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828296.851578:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828296.851584:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787828296.851599:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707840 x1874670273027328/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828296.851610:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828296.851615:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787828296.851617:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828296.851620:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3460
00000100:00080000:3.0:1787828296.851624:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828296.851628:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828296.851634:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:0.0:1787828296.851646:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787828296.851650:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057043c0 x1874670273027456/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828296.851662:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828296.851666:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787828296.851669:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828296.851673:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3460
00000100:00080000:3.0:1787828296.851678:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828296.851682:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828296.851686:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787828296.851693:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828296/real 1787828296]  req@ffff9ee0057052c0 x1874670273027072/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828321 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787828296.851700:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706580 x1874670273027584/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828296.851710:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828296.851718:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787828296.851720:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828296.851726:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3460
00000100:00100000:0.0:1787828296.851731:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057052c0 x1874670273027072/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828321 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828296.851732:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828296.851742:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00080000:0.0:1787828296.851749:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000008:00100000:3.0:1787828296.851751:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:0.0:1787828296.851756:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787828296.851761:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273027072:192.168.203.121@tcp:250:kworker.0
00000100:00100000:3.0:1787828296.851767:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704780 x1874670273027712/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787828296.851769:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273027200:192.168.203.121@tcp:38:kworker.0
00000100:00080000:3.0:1787828296.851783:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828296.851786:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787828296.851788:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828296.851792:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3460
00000100:00080000:3.0:1787828296.851795:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000800:00000100:0.0:1787828296.851800:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787828296.851801:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828296.851809:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828296.851818:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828296/real 1787828296]  req@ffff9ee005707480 x1874670273027200/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828321 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787828296.851821:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705a40 x1874670273027840/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787828296.851864:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707480 x1874670273027200/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828321 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828296.851876:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787828296.851880:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787828296.851884:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273027200:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787828296.851904:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273027328:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787828296.851929:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787828296.851938:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828296/real 1787828296]  req@ffff9ee005707840 x1874670273027328/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828321 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787828296.851946:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707840 x1874670273027328/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828321 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828296.851951:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787828296.851953:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787828296.851956:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273027328:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787828296.851960:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273027456:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787828296.851979:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787828296.851990:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828296/real 1787828296]  req@ffff9ee0057043c0 x1874670273027456/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828321 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787828296.852003:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057043c0 x1874670273027456/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828321 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828296.852012:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787828296.852016:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787828296.852020:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273027456:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787828296.852025:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273027584:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787828296.852040:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787828296.852048:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828296/real 1787828296]  req@ffff9ee005706580 x1874670273027584/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828321 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787828296.852056:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706580 x1874670273027584/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828321 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828296.852061:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787828296.852063:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787828296.852065:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273027584:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787828296.852069:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273027712:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787828296.852078:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787828296.852084:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828296/real 1787828296]  req@ffff9ee005704780 x1874670273027712/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828321 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787828296.852091:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704780 x1874670273027712/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828321 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828296.852096:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787828296.852098:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787828296.852100:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273027712:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787828296.852103:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273027840:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787828296.852112:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787828296.852117:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828296/real 1787828296]  req@ffff9ee005705a40 x1874670273027840/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828321 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787828296.852124:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705a40 x1874670273027840/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828321 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828296.852128:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787828296.852130:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787828296.852132:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273027840:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828297.683512:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828297.875377:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828298.707498:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828298.899425:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828299.731551:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828299.923424:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828300.755481:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828300.947464:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828301.779543:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828301.971409:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:0.0:1787828301.971432:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828301.971440:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1787828301.971446:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828301.971458:0:8:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3465
00000100:00080000:0.0:1787828301.971472:0:8:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828301.971483:0:8:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787828301.971530:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8b40 x1874670273027968/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828301.971565:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828301.971570:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787828301.971572:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828301.971577:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3465
00000100:00080000:0.0:1787828301.971582:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828301.971587:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828301.971600:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787828301.971613:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273027968:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787828301.971617:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9e00 x1874670273028096/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828301.971632:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828301.971636:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787828301.971638:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828301.971643:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3465
00000100:00080000:0.0:1787828301.971647:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828301.971651:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828301.971656:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828301.971668:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8780 x1874670273028224/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828301.971679:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828301.971683:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787828301.971685:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828301.971690:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3465
00000800:00000100:1.0:1787828301.971696:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:0.0:1787828301.971697:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828301.971704:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828301.971710:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828301.971722:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9680 x1874670273028352/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828301.971733:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828301.971736:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787828301.971739:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828301.971746:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3465
00000100:00100000:1.0:1787828301.971747:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828301/real 1787828301]  req@ffff9ee0056e8b40 x1874670273027968/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828326 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828301.971753:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1787828301.971766:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8b40 x1874670273027968/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828326 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828301.971772:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00080000:1.0:1787828301.971783:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000008:00100000:0.0:1787828301.971784:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00080000:1.0:1787828301.971790:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828301.971794:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273027968:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787828301.971803:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9a40 x1874670273028480/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828301.971814:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1787828301.971819:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273028096:192.168.203.121@tcp:38:kworker.0
00000100:00080000:0.0:1787828301.971821:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787828301.971825:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828301.971831:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3465
00000100:00080000:0.0:1787828301.971835:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828301.971839:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828301.971844:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1787828301.971852:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787828301.971860:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ead00 x1874670273028608/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828301.971872:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1787828301.971873:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828301/real 1787828301]  req@ffff9ee0056e9e00 x1874670273028096/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828326 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828301.971880:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787828301.971885:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828301.971892:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3465
00000100:00100000:1.0:1787828301.971895:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9e00 x1874670273028096/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828326 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828301.971897:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828301.971905:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00080000:1.0:1787828301.971909:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000008:00100000:0.0:1787828301.971913:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:1.0:1787828301.971915:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828301.971920:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273028096:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828301.971931:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273028224:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787828301.971932:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ea580 x1874670273028736/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1787828301.971952:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828301.971961:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828301/real 1787828301]  req@ffff9ee0056e8780 x1874670273028224/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828326 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828301.971970:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8780 x1874670273028224/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828326 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828301.971977:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828301.971979:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828301.971981:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273028224:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828301.971984:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273028352:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828301.971995:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828301.972001:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828301/real 1787828301]  req@ffff9ee0056e9680 x1874670273028352/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828326 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828301.972008:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9680 x1874670273028352/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828326 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828301.972014:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828301.972015:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828301.972017:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273028352:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828301.972020:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273028480:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787828301.972030:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828301.972036:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828301/real 1787828301]  req@ffff9ee0056e9a40 x1874670273028480/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828326 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828301.972043:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9a40 x1874670273028480/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828326 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828301.972048:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828301.972051:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828301.972053:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273028480:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828301.972065:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273028608:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828301.972075:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828301.972081:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828301/real 1787828301]  req@ffff9ee0056ead00 x1874670273028608/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828326 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828301.972088:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ead00 x1874670273028608/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828326 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828301.972093:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828301.972095:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828301.972097:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273028608:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828301.972101:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273028736:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828301.972111:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828301.972117:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828301/real 1787828301]  req@ffff9ee0056ea580 x1874670273028736/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828326 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828301.972124:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ea580 x1874670273028736/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828326 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828301.972129:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828301.972131:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828301.972133:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273028736:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828302.803486:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828302.995459:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828303.827565:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828304.019379:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828304.851438:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828305.043382:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828305.875441:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828306.067426:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828306.899466:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1787828307.091381:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1787828307.091385:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:0.0:1787828307.091392:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1787828307.091396:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828307.091404:0:8:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3470
00000100:00080000:0.0:1787828307.091413:0:8:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828307.091419:0:8:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787828307.091450:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb0c0 x1874670273028864/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828307.091473:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828307.091476:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787828307.091477:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828307.091480:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3470
00000100:00080000:0.0:1787828307.091482:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828307.091489:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828307.091497:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787828307.091505:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ea940 x1874670273028992/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828307.091513:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828307.091516:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787828307.091517:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828307.091520:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3470
00000100:00080000:0.0:1787828307.091522:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828307.091528:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787828307.091528:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273028864:192.168.203.121@tcp:250:kworker.0
00000008:00100000:0.0:1787828307.091533:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828307.091544:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ea580 x1874670273029120/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828307.091551:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828307.091553:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787828307.091555:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828307.091557:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3470
00000100:00080000:0.0:1787828307.091560:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828307.091562:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828307.091566:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828307.091572:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ead00 x1874670273029248/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828307.091579:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828307.091581:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787828307.091582:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:1.0:1787828307.091586:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:0.0:1787828307.091589:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3470
00000100:00080000:0.0:1787828307.091593:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828307.091597:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828307.091600:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787828307.091608:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9a40 x1874670273029376/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828307.091614:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828307.091622:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00100000:1.0:1787828307.091623:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828307/real 1787828307]  req@ffff9ee0056eb0c0 x1874670273028864/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828332 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828307.091627:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828307.091638:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3470
00000100:00080000:0.0:1787828307.091645:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1787828307.091647:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb0c0 x1874670273028864/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828332 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828307.091653:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00080000:1.0:1787828307.091662:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000008:00100000:0.0:1787828307.091664:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:1.0:1787828307.091668:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828307.091672:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273028864:192.168.203.121@tcp:250:kworker.0
00000100:00100000:1.0:1787828307.091678:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273028992:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787828307.091683:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9680 x1874670273029504/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828307.091692:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828307.091695:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787828307.091697:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:1.0:1787828307.091701:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:0.0:1787828307.091705:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3470
00000100:00080000:0.0:1787828307.091709:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828307.091713:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828307.091718:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787828307.091719:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828307/real 1787828307]  req@ffff9ee0056ea940 x1874670273028992/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828332 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787828307.091733:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8780 x1874670273029632/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828307.091734:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ea940 x1874670273028992/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828332 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828307.091761:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828307.091768:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828307.091775:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273028992:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828307.091796:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273029120:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828307.091810:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828307.091817:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828307/real 1787828307]  req@ffff9ee0056ea580 x1874670273029120/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828332 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828307.091825:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ea580 x1874670273029120/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828332 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828307.091832:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828307.091835:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828307.091838:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273029120:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828307.091844:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273029248:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828307.091863:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828307.091874:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828307/real 1787828307]  req@ffff9ee0056ead00 x1874670273029248/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828332 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828307.091887:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ead00 x1874670273029248/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828332 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828307.091893:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828307.091895:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828307.091897:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273029248:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828307.091901:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273029376:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787828307.091916:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828307.091923:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828307/real 1787828307]  req@ffff9ee0056e9a40 x1874670273029376/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828332 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828307.091930:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9a40 x1874670273029376/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828332 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828307.091935:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828307.091937:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828307.091939:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273029376:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828307.091943:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273029504:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828307.091952:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828307.091958:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828307/real 1787828307]  req@ffff9ee0056e9680 x1874670273029504/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828332 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828307.091964:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9680 x1874670273029504/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828332 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828307.091969:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828307.091971:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828307.091973:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273029504:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828307.091976:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273029632:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828307.091985:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828307.091991:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828307/real 1787828307]  req@ffff9ee0056e8780 x1874670273029632/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828332 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828307.091997:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8780 x1874670273029632/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828332 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828307.092002:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828307.092004:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828307.092006:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273029632:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828307.923495:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828308.115513:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828308.947486:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828309.139406:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828309.971468:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828310.163394:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828310.995464:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828311.187387:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828312.019485:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828312.211403:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:2.0:1787828312.211470:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828312.211477:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787828312.211482:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828312.211493:0:8:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3475
00000100:00080000:2.0:1787828312.211505:0:8:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828312.211512:0:8:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787828312.211549:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572bc00 x1874670273029760/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828312.211577:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828312.211581:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787828312.211583:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828312.211588:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3475
00000100:00080000:2.0:1787828312.211592:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828312.211597:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828312.211608:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787828312.211625:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273029760:192.168.203.121@tcp:250:kworker.0
00000100:00100000:2.0:1787828312.211625:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057292c0 x1874670273029888/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828312.211644:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828312.211647:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787828312.211650:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828312.211654:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3475
00000100:00080000:2.0:1787828312.211658:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828312.211663:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828312.211669:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828312.211682:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729680 x1874670273030016/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828312.211716:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:1.0:1787828312.211718:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:2.0:1787828312.211721:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787828312.211725:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828312.211730:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3475
00000100:00080000:2.0:1787828312.211735:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828312.211740:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828312.211745:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828312.211758:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728780 x1874670273030144/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828312.211768:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828312.211772:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787828312.211774:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1787828312.211777:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828312/real 1787828312]  req@ffff9ee00572bc00 x1874670273029760/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828337 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828312.211782:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3475
00000100:00080000:2.0:1787828312.211810:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1787828312.211812:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572bc00 x1874670273029760/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828337 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828312.211820:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00080000:1.0:1787828312.211827:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000008:00100000:2.0:1787828312.211829:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00080000:1.0:1787828312.211833:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828312.211837:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273029760:192.168.203.121@tcp:250:kworker.0
00000100:00100000:2.0:1787828312.211847:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a940 x1874670273030272/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828312.211860:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057292c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273029888:192.168.203.121@tcp:38:kworker.0
00000100:00080000:2.0:1787828312.211861:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828312.211869:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787828312.211872:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828312.211877:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3475
00000100:00080000:2.0:1787828312.211883:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000800:00000100:1.0:1787828312.211888:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:2.0:1787828312.211890:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828312.211916:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828312.211934:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729e00 x1874670273030400/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828312.211938:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828312/real 1787828312]  req@ffff9ee0057292c0 x1874670273029888/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828337 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828312.211978:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1787828312.211985:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057292c0 x1874670273029888/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828337 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828312.211988:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787828312.211995:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787828312.212009:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828312.212010:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3475
00000100:00080000:2.0:1787828312.212023:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828312.212024:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00080000:2.0:1787828312.212047:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787828312.212050:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057292c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273029888:192.168.203.121@tcp:38:kworker.0
00000008:00100000:2.0:1787828312.212055:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787828312.212061:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273030016:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787828312.212094:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a1c0 x1874670273030528/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1787828312.212120:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828312.212136:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828312/real 1787828312]  req@ffff9ee005729680 x1874670273030016/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828337 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828312.212146:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729680 x1874670273030016/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828337 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828312.212152:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828312.212155:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828312.212184:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273030016:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828312.212190:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273030144:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828312.212210:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828312.212221:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828312/real 1787828312]  req@ffff9ee005728780 x1874670273030144/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828337 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828312.212232:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728780 x1874670273030144/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828337 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828312.212240:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828312.212243:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828312.212246:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273030144:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828312.212262:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273030272:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787828312.212293:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828312.212299:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828312/real 1787828312]  req@ffff9ee00572a940 x1874670273030272/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828337 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828312.212306:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a940 x1874670273030272/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828337 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828312.212312:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828312.212314:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828312.212316:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273030272:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828312.212320:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273030400:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828312.212329:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828312.212335:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828312/real 1787828312]  req@ffff9ee005729e00 x1874670273030400/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828337 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828312.212342:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729e00 x1874670273030400/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828337 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828312.212391:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828312.212394:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828312.212397:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273030400:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828312.212403:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273030528:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828312.212424:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828312.212434:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828312/real 1787828312]  req@ffff9ee00572a1c0 x1874670273030528/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828337 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828312.212445:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a1c0 x1874670273030528/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828337 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828312.212452:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828312.212455:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828312.212459:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273030528:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828313.043466:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828313.235455:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828314.067555:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828314.259403:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828315.091536:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828315.283415:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828316.115488:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828316.307413:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828317.139494:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828317.331394:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:2.0:1787828317.331405:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828317.331411:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787828317.331414:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828317.331422:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3481
00000100:00080000:2.0:1787828317.331436:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828317.331443:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787828317.331484:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728f00 x1874670273030656/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828317.331509:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828317.331512:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787828317.331513:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828317.331516:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3481
00000100:00080000:2.0:1787828317.331518:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828317.331520:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828317.331528:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787828317.331535:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b840 x1874670273030784/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828317.331542:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828317.331545:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787828317.331546:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828317.331549:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3481
00000100:00080000:2.0:1787828317.331551:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828317.331556:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787828317.331558:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273030656:192.168.203.121@tcp:250:kworker.0
00000008:00100000:2.0:1787828317.331560:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828317.331571:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057283c0 x1874670273030912/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828317.331579:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828317.331581:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787828317.331582:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828317.331584:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3481
00000100:00080000:2.0:1787828317.331588:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828317.331590:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828317.331593:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828317.331600:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728000 x1874670273031040/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828317.331606:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828317.331608:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787828317.331609:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828317.331611:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3481
00000100:00080000:2.0:1787828317.331614:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828317.331626:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828317.331629:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787828317.331637:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a580 x1874670273031168/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828317.331643:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828317.331646:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787828317.331647:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828317.331652:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3481
00000100:00100000:1.0:1787828317.331653:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273030784:192.168.203.121@tcp:38:kworker.0
00000100:00080000:2.0:1787828317.331655:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828317.331661:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828317.331665:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828317.331675:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728b40 x1874670273031296/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828317.331686:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828317.331688:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:1.0:1787828317.331690:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273030912:192.168.203.121@tcp:8:kworker.0
00000100:00080000:2.0:1787828317.331691:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828317.331699:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3481
00000100:00080000:2.0:1787828317.331704:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828317.331706:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828317.331710:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787828317.331717:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273031040:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787828317.331722:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729a40 x1874670273031424/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828317.331734:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273031168:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828317.331749:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273031296:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828317.331772:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273031424:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828318.163593:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828318.355416:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828319.187494:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828319.379381:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828320.211567:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828320.403417:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000400:00000100:0.0:1787828320.403605:0:2355:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.203.121:988
00000400:00000100:0.0:1787828320.403657:0:2355:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.203.121@tcp at host 192.168.203.121 was unreachable: the network or that node may be down, or Lustre may be misconfigured.
00000800:00000100:0.0:1787828320.403679:0:2355:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:0.0:1787828320.403717:0:2355:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:0.0:1787828320.403725:0:2355:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:0.0:1787828320.403733:0:2355:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:0.0:1787828320.403744:0:2355:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:0.0:1787828320.403752:0:2355:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:0.0:1787828320.403763:0:2355:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000100:00100000:1.0:1787828320.403782:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828317/real 1787828320]  req@ffff9ee0057283c0 x1874670273030912/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828342 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828320.403817:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057283c0 x1874670273030912/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828342 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828320.403830:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828320.403836:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828320.403844:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273030912:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828320.403854:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828317/real 1787828320]  req@ffff9ee005728000 x1874670273031040/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828342 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828320.403883:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728000 x1874670273031040/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828342 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828320.403903:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828320.403908:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828320.403913:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273031040:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828320.403921:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828317/real 1787828320]  req@ffff9ee00572a580 x1874670273031168/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828342 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828320.403939:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a580 x1874670273031168/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828342 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828320.403950:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828320.403955:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828320.403960:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273031168:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828320.403969:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828317/real 1787828320]  req@ffff9ee005728b40 x1874670273031296/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828342 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828320.403987:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728b40 x1874670273031296/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828342 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828320.403998:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828320.404003:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828320.404008:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273031296:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828320.404039:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828317/real 1787828320]  req@ffff9ee005728f00 x1874670273030656/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828342 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828320.404061:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728f00 x1874670273030656/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828342 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828320.404071:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828320.404076:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828320.404081:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273030656:192.168.203.121@tcp:250:kworker.0
00000100:00100000:1.0:1787828320.404090:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828317/real 1787828320]  req@ffff9ee00572b840 x1874670273030784/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828342 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828320.404105:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b840 x1874670273030784/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828342 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828320.404117:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828320.404121:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828320.404126:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273030784:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828320.404169:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828317/real 1787828320]  req@ffff9ee005729a40 x1874670273031424/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828342 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828320.404186:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729a40 x1874670273031424/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828342 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828320.404198:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828320.404203:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828320.404208:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273031424:192.168.203.121@tcp:8:kworker.0
00010000:00010000:3.0:1787828321.235570:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828321.427425:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828322.259544:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828322.451441:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:2.0:1787828322.451456:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828322.451473:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787828322.451482:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828322.451502:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3486
00000100:00080000:2.0:1787828322.451520:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828322.451530:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787828322.451581:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b0c0 x1874670273031552/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828322.451625:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828322.451631:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787828322.451635:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828322.451643:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3486
00000100:00080000:2.0:1787828322.451650:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828322.451658:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828322.451675:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787828322.451694:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572ad00 x1874670273031680/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828322.451707:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273031552:192.168.203.121@tcp:250:kworker.0
00000100:00080000:2.0:1787828322.451749:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828322.451757:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787828322.451762:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828322.451772:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3486
00000100:00080000:2.0:1787828322.451782:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828322.451792:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828322.451804:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1787828322.451832:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828322.451847:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b480 x1874670273031808/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828322.451873:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828322.451880:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787828322.451885:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828322.451895:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3486
00000100:00100000:1.0:1787828322.451904:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828322/real 1787828322]  req@ffff9ee00572b0c0 x1874670273031552/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828347 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828322.451910:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828322.451933:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828322.451951:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787828322.451958:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b0c0 x1874670273031552/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828347 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828322.451979:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828322.451991:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828322.451996:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729a40 x1874670273031936/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828322.452019:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273031552:192.168.203.121@tcp:250:kworker.0
00000100:00100000:1.0:1787828322.452068:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273031680:192.168.203.121@tcp:38:kworker.0
00000100:00080000:2.0:1787828322.452069:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828322.452088:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787828322.452093:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828322.452108:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3486
00000100:00080000:2.0:1787828322.452118:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000800:00000100:1.0:1787828322.452122:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:2.0:1787828322.452134:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828322.452148:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787828322.452152:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828322/real 1787828322]  req@ffff9ee00572ad00 x1874670273031680/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828347 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828322.452175:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572ad00 x1874670273031680/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828347 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828322.452188:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b840 x1874670273032064/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787828322.452192:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828322.452214:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828322.452231:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273031680:192.168.203.121@tcp:38:kworker.0
00000100:00080000:2.0:1787828322.452243:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1787828322.452252:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273031808:192.168.203.121@tcp:8:kworker.0
00000100:00080000:2.0:1787828322.452257:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787828322.452269:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828322.452283:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3486
00000100:00080000:2.0:1787828322.452295:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000800:00000100:1.0:1787828322.452307:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:2.0:1787828322.452376:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787828322.452386:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828322/real 1787828322]  req@ffff9ee00572b480 x1874670273031808/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828347 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:2.0:1787828322.452396:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787828322.452410:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b480 x1874670273031808/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828347 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828322.452437:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:2.0:1787828322.452439:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728f00 x1874670273032192/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787828322.452458:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828322.452480:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273031808:192.168.203.121@tcp:8:kworker.0
00000100:00080000:2.0:1787828322.452512:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828322.452520:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787828322.452525:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1787828322.452536:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273031936:192.168.203.121@tcp:8:kworker.0
00000100:00080000:2.0:1787828322.452546:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3486
00000100:00080000:2.0:1787828322.452561:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828322.452571:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000800:00000100:1.0:1787828322.452583:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000008:00100000:2.0:1787828322.452591:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787828322.452606:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828322/real 1787828322]  req@ffff9ee005729a40 x1874670273031936/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828347 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828322.452635:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728b40 x1874670273032320/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828322.452636:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729a40 x1874670273031936/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828347 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828322.452720:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828322.452732:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828322.452740:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273031936:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828322.452752:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273032064:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787828322.452785:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828322.452798:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828322/real 1787828322]  req@ffff9ee00572b840 x1874670273032064/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828347 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828322.452812:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b840 x1874670273032064/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828347 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828322.452820:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828322.452824:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828322.452828:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273032064:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828322.452835:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273032192:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828322.452856:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828322.452867:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828322/real 1787828322]  req@ffff9ee005728f00 x1874670273032192/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828347 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828322.452880:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728f00 x1874670273032192/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828347 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828322.452889:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828322.452893:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828322.452897:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273032192:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828322.452917:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273032320:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828322.452934:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828322.452943:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828322/real 1787828322]  req@ffff9ee005728b40 x1874670273032320/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828347 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828322.452956:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728b40 x1874670273032320/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828347 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828322.452971:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828322.452974:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828322.452977:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273032320:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828323.283600:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828323.475453:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828324.307503:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828324.499414:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828325.331484:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828325.523434:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828326.355522:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828326.547410:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828327.379486:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828327.571521:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:0.0:1787828327.571537:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828327.571547:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1787828327.571552:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828327.571563:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3491
00000100:00080000:0.0:1787828327.571576:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828327.571584:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787828327.571623:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9e00 x1874670273032448/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828327.571658:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828327.571662:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787828327.571664:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828327.571668:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3491
00000100:00080000:0.0:1787828327.571672:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828327.571676:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828327.571688:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787828327.571708:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8b40 x1874670273032576/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828327.571729:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1787828327.571741:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273032448:192.168.203.121@tcp:250:kworker.0
00000100:00080000:0.0:1787828327.571744:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787828327.571751:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828327.571761:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3491
00000100:00080000:0.0:1787828327.571765:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828327.571769:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828327.571777:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828327.571792:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e92c0 x1874670273032704/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828327.571803:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828327.571807:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787828327.571809:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828327.571812:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3491
00000100:00080000:0.0:1787828327.571817:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828327.571822:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828327.571826:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828327.571837:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb840 x1874670273032832/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828327.571851:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828327.571855:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787828327.571857:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828327.571861:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3491
00000100:00080000:0.0:1787828327.571864:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828327.571867:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828327.571873:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000800:00000100:1.0:1787828327.571884:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787828327.571895:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb480 x1874670273032960/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828327.571925:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828327.571929:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787828327.571932:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828327.571937:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3491
00000100:00080000:0.0:1787828327.571942:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828327.571948:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828327.571955:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828327.572038:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8000 x1874670273033088/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828327.572039:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828327/real 1787828327]  req@ffff9ee0056e9e00 x1874670273032448/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828352 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828327.572150:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828327.572166:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787828327.572169:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828327.572179:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3491
00000100:00080000:0.0:1787828327.572184:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1787828327.572190:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9e00 x1874670273032448/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828352 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828327.572197:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828327.572228:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:1.0:1787828327.572257:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:0.0:1787828327.572270:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e83c0 x1874670273033216/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787828327.572272:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828327.572288:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273032448:192.168.203.121@tcp:250:kworker.0
00000100:00100000:1.0:1787828327.572347:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273032576:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787828327.572433:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828327.572474:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828327/real 1787828327]  req@ffff9ee0056e8b40 x1874670273032576/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828352 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828327.572490:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8b40 x1874670273032576/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828352 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828327.572501:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828327.572505:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828327.572509:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273032576:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828327.572517:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273032704:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828327.572541:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828327.572553:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828327/real 1787828327]  req@ffff9ee0056e92c0 x1874670273032704/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828352 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828327.572566:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e92c0 x1874670273032704/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828352 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828327.572583:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828327.572588:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828327.572592:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273032704:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828327.572598:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273032832:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828327.572615:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828327.572625:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828327/real 1787828327]  req@ffff9ee0056eb840 x1874670273032832/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828352 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828327.572638:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb840 x1874670273032832/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828352 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828327.572647:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828327.572650:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828327.572653:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273032832:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828327.572660:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273032960:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787828327.572677:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828327.572686:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828327/real 1787828327]  req@ffff9ee0056eb480 x1874670273032960/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828352 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828327.572698:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb480 x1874670273032960/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828352 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828327.572707:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828327.572710:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828327.572714:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273032960:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828327.572721:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273033088:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828327.572739:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828327.572749:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828327/real 1787828327]  req@ffff9ee0056e8000 x1874670273033088/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828352 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828327.572767:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8000 x1874670273033088/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828352 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828327.572782:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828327.572787:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828327.572794:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273033088:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828327.572830:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273033216:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828327.572866:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828327.572882:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828327/real 1787828327]  req@ffff9ee0056e83c0 x1874670273033216/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828352 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828327.572896:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e83c0 x1874670273033216/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828352 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828327.572906:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828327.572910:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828327.572913:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273033216:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828328.403559:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828328.595400:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828329.427526:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828329.619386:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828330.451477:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828330.643449:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828331.475507:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828331.667440:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828332.499562:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828332.691434:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:0.0:1787828332.691437:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828332.691447:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1787828332.691452:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828332.691463:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3496
00000100:00080000:0.0:1787828332.691476:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828332.691485:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787828332.691533:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ebc00 x1874670273033344/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828332.691560:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828332.691563:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787828332.691564:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828332.691567:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3496
00000100:00080000:0.0:1787828332.691570:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828332.691573:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828332.691583:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787828332.691593:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8f00 x1874670273033472/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828332.691603:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828332.691606:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787828332.691608:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1787828332.691613:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273033344:192.168.203.121@tcp:250:kworker.0
00000100:00080000:0.0:1787828332.691614:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3496
00000100:00080000:0.0:1787828332.691619:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828332.691624:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828332.691628:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828332.691639:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e83c0 x1874670273033600/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828332.691646:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828332.691656:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787828332.691657:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828332.691660:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3496
00000100:00080000:0.0:1787828332.691663:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828332.691667:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828332.691671:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828332.691679:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8000 x1874670273033728/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828332.691687:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828332.691690:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787828332.691691:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828332.691693:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3496
00000100:00080000:0.0:1787828332.691696:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000800:00000100:1.0:1787828332.691700:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:0.0:1787828332.691703:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828332.691709:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787828332.691717:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb480 x1874670273033856/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828332.691725:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828332.691728:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787828332.691729:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828332.691732:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3496
00000100:00080000:0.0:1787828332.691734:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828332.691737:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828332.691740:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828332.691750:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb840 x1874670273033984/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828332.691756:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828332/real 1787828332]  req@ffff9ee0056ebc00 x1874670273033344/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828357 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828332.691760:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828332.691769:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787828332.691773:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828332.691778:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3496
00000100:00080000:0.0:1787828332.691781:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828332.691787:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787828332.691788:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ebc00 x1874670273033344/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828357 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:0.0:1787828332.691791:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828332.691803:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e92c0 x1874670273034112/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787828332.691804:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828332.691812:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828332.691820:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273033344:192.168.203.121@tcp:250:kworker.0
00000100:00100000:1.0:1787828332.691844:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273033472:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787828332.691862:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828332.691872:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828332/real 1787828332]  req@ffff9ee0056e8f00 x1874670273033472/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828357 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828332.691881:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8f00 x1874670273033472/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828357 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828332.691887:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828332.691889:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828332.691892:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273033472:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828332.691898:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273033600:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828332.691921:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828332.691947:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828332/real 1787828332]  req@ffff9ee0056e83c0 x1874670273033600/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828357 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828332.691962:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e83c0 x1874670273033600/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828357 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828332.691977:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828332.691980:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828332.691998:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273033600:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828332.692004:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273033728:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828332.692021:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828332.692030:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828332/real 1787828332]  req@ffff9ee0056e8000 x1874670273033728/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828357 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828332.692038:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8000 x1874670273033728/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828357 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828332.692044:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828332.692046:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828332.692048:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273033728:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828332.692052:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273033856:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787828332.692063:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828332.692070:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828332/real 1787828332]  req@ffff9ee0056eb480 x1874670273033856/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828357 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828332.692077:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb480 x1874670273033856/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828357 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828332.692082:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828332.692084:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828332.692094:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273033856:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828332.692098:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273033984:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828332.692111:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828332.692117:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828332/real 1787828332]  req@ffff9ee0056eb840 x1874670273033984/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828357 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828332.692125:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb840 x1874670273033984/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828357 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828332.692130:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828332.692132:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828332.692134:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273033984:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828332.692137:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273034112:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828332.692148:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828332.692154:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828332/real 1787828332]  req@ffff9ee0056e92c0 x1874670273034112/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828357 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828332.692163:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e92c0 x1874670273034112/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828357 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828332.692168:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828332.692170:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828332.692171:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273034112:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828333.523470:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828333.715401:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828334.547534:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828334.739444:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828335.571590:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828335.763448:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828336.595594:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828336.787462:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828337.619530:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828337.811454:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:2.0:1787828337.811492:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828337.811504:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787828337.811510:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828337.811524:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3501
00000100:00080000:2.0:1787828337.811539:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828337.811548:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787828337.811596:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a580 x1874670273034240/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828337.811651:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828337.811658:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787828337.811661:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828337.811669:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3501
00000100:00080000:2.0:1787828337.811676:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828337.811683:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787828337.811708:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273034240:192.168.203.121@tcp:250:kworker.0
00000008:00100000:2.0:1787828337.811709:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787828337.811735:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728000 x1874670273034368/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828337.811751:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828337.811755:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787828337.811758:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828337.811762:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3501
00000100:00080000:2.0:1787828337.811767:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828337.811771:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828337.811793:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828337.811811:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057283c0 x1874670273034496/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1787828337.811820:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:2.0:1787828337.811838:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828337.811843:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787828337.811847:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828337.811863:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3501
00000100:00080000:2.0:1787828337.811867:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828337.811873:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828337.811880:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828337.811892:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a1c0 x1874670273034624/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828337.811957:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1787828337.811960:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828337/real 1787828337]  req@ffff9ee00572a580 x1874670273034240/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828362 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828337.811964:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787828337.811971:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828337.811984:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3501
00000100:00080000:2.0:1787828337.812014:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828337.812020:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828337.812027:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787828337.812033:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a580 x1874670273034240/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828362 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828337.812049:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729e00 x1874670273034752/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828337.812093:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828337.812096:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787828337.812099:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828337.812103:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3501
00000100:00080000:2.0:1787828337.812106:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828337.812110:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828337.812123:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:1.0:1787828337.812124:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828337.812137:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828337.812144:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273034240:192.168.203.121@tcp:250:kworker.0
00000100:00100000:2.0:1787828337.812170:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a940 x1874670273034880/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828337.812202:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828337.812210:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787828337.812215:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1787828337.812217:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273034368:192.168.203.121@tcp:38:kworker.0
00000100:00080000:2.0:1787828337.812233:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3501
00000100:00080000:2.0:1787828337.812244:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828337.812251:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828337.812260:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1787828337.812269:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828337.812286:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728780 x1874670273035008/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828337.812297:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828337/real 1787828337]  req@ffff9ee005728000 x1874670273034368/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828362 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828337.812389:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728000 x1874670273034368/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828362 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828337.812400:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828337.812404:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828337.812408:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273034368:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828337.812416:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273034496:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828337.812473:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828337.812488:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828337/real 1787828337]  req@ffff9ee0057283c0 x1874670273034496/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828362 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828337.812502:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057283c0 x1874670273034496/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828362 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828337.812519:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828337.812523:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828337.812527:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273034496:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828337.812534:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273034624:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828337.812551:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828337.812561:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828337/real 1787828337]  req@ffff9ee00572a1c0 x1874670273034624/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828362 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828337.812573:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a1c0 x1874670273034624/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828362 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828337.812582:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828337.812585:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828337.812589:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273034624:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828337.812595:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273034752:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787828337.812611:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828337.812621:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828337/real 1787828337]  req@ffff9ee005729e00 x1874670273034752/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828362 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828337.812634:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729e00 x1874670273034752/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828362 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828337.812642:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828337.812645:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828337.812649:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273034752:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828337.812656:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273034880:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828337.812673:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828337.812682:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828337/real 1787828337]  req@ffff9ee00572a940 x1874670273034880/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828362 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828337.812695:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a940 x1874670273034880/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828362 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828337.812703:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828337.812723:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828337.812726:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273034880:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828337.812748:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273035008:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828337.812766:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828337.812776:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828337/real 1787828337]  req@ffff9ee005728780 x1874670273035008/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828362 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828337.812806:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728780 x1874670273035008/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828362 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828337.812815:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828337.812818:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828337.812822:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273035008:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828338.643556:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828338.835480:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828339.667523:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828339.859480:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828340.691560:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828340.883455:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828341.715473:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828341.907411:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828342.739567:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828342.931450:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:0.0:1787828342.931517:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828342.931524:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1787828342.931529:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828342.931540:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3506
00000100:00080000:0.0:1787828342.931554:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828342.931562:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787828342.931613:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8b40 x1874670273035136/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828342.931660:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828342.931665:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787828342.931667:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828342.931671:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3506
00000100:00080000:0.0:1787828342.931675:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828342.931679:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828342.931694:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787828342.931712:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9e00 x1874670273035264/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828342.931726:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273035136:192.168.203.121@tcp:250:kworker.0
00000100:00080000:0.0:1787828342.931728:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828342.931740:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787828342.931744:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828342.931749:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3506
00000100:00080000:0.0:1787828342.931752:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828342.931756:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828342.931761:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828342.931775:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8780 x1874670273035392/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828342.931784:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828342.931788:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787828342.931790:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828342.931794:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3506
00000100:00080000:0.0:1787828342.931821:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828342.931826:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828342.931831:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1787828342.931838:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787828342.931845:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9680 x1874670273035520/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828342.931856:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828342.931880:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787828342.931884:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828342.931892:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3506
00000100:00080000:0.0:1787828342.931899:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828342.931920:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828342.931926:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787828342.931942:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828342/real 1787828342]  req@ffff9ee0056e8b40 x1874670273035136/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828367 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787828342.931943:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9a40 x1874670273035648/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828342.931973:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828342.931977:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787828342.931979:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1787828342.931982:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8b40 x1874670273035136/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828367 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828342.931986:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3506
00000100:00080000:0.0:1787828342.931993:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828342.931999:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00080000:1.0:1787828342.932001:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000008:00100000:0.0:1787828342.932004:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:1.0:1787828342.932009:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828342.932014:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273035136:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787828342.932018:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ead00 x1874670273035776/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828342.932026:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828342.932029:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787828342.932031:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828342.932033:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3506
00000100:00080000:0.0:1787828342.932035:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828342.932037:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828342.932040:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787828342.932045:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273035264:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787828342.932050:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ea580 x1874670273035904/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1787828342.932072:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828342.932085:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828342/real 1787828342]  req@ffff9ee0056e9e00 x1874670273035264/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828367 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828342.932094:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9e00 x1874670273035264/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828367 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828342.932101:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828342.932103:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828342.932105:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273035264:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828342.932109:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273035392:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828342.932122:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828342.932128:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828342/real 1787828342]  req@ffff9ee0056e8780 x1874670273035392/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828367 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828342.932136:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8780 x1874670273035392/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828367 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828342.932146:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828342.932148:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828342.932151:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273035392:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828342.932154:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273035520:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828342.932164:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828342.932169:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828342/real 1787828342]  req@ffff9ee0056e9680 x1874670273035520/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828367 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828342.932176:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9680 x1874670273035520/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828367 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828342.932182:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828342.932183:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828342.932185:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273035520:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828342.932188:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273035648:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787828342.932198:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828342.932203:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828342/real 1787828342]  req@ffff9ee0056e9a40 x1874670273035648/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828367 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828342.932210:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9a40 x1874670273035648/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828367 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828342.932215:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828342.932216:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828342.932219:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273035648:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828342.932222:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273035776:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828342.932232:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828342.932237:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828342/real 1787828342]  req@ffff9ee0056ead00 x1874670273035776/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828367 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828342.932244:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ead00 x1874670273035776/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828367 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828342.932249:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828342.932250:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828342.932252:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273035776:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828342.932268:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273035904:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828342.932288:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828342.932300:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828342/real 1787828342]  req@ffff9ee0056ea580 x1874670273035904/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828367 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828342.932312:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ea580 x1874670273035904/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828367 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828342.932318:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828342.932320:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828342.932323:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273035904:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828343.763585:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828343.955431:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828344.787500:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828344.979390:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828345.811544:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828346.003436:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828346.835486:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828347.027464:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828347.859514:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828348.051394:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:0.0:1787828348.051432:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828348.051441:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1787828348.051447:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828348.051459:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3511
00000100:00080000:0.0:1787828348.051472:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828348.051482:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787828348.051549:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ea940 x1874670273036032/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828348.051609:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828348.051617:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787828348.051621:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828348.051629:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3511
00000100:00080000:0.0:1787828348.051636:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828348.051644:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828348.051675:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787828348.051690:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb0c0 x1874670273036160/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828348.051705:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828348.051710:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787828348.051713:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828348.051719:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3511
00000100:00080000:0.0:1787828348.051724:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1787828348.051729:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273036032:192.168.203.121@tcp:250:kworker.0
00000100:00080000:0.0:1787828348.051734:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828348.051744:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828348.051762:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ea580 x1874670273036288/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828348.051776:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828348.051780:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787828348.051783:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828348.051788:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3511
00000100:00080000:0.0:1787828348.051794:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000800:00000100:1.0:1787828348.051794:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:0.0:1787828348.051805:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828348.051812:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828348.051847:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ead00 x1874670273036416/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828348.051856:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828348/real 1787828348]  req@ffff9ee0056ea940 x1874670273036032/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828373 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828348.051867:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828348.051873:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787828348.051876:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1787828348.051877:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ea940 x1874670273036032/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828373 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828348.051888:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3511
00000100:00080000:1.0:1787828348.051893:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828348.051918:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828348.051923:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273036032:192.168.203.121@tcp:250:kworker.0
00000100:00080000:0.0:1787828348.051932:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1787828348.051934:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273036160:192.168.203.121@tcp:38:kworker.0
00000100:00080000:0.0:1787828348.051953:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828348.051966:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000800:00000100:1.0:1787828348.051975:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828348.051998:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828348/real 1787828348]  req@ffff9ee0056eb0c0 x1874670273036160/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828373 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787828348.052002:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9a40 x1874670273036544/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828348.052027:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb0c0 x1874670273036160/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828373 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828348.052048:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828348.052050:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828348.052060:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00080000:0.0:1787828348.052067:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00100000:1.0:1787828348.052070:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273036160:192.168.203.121@tcp:38:kworker.0
00000100:00080000:0.0:1787828348.052076:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828348.052089:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3511
00000100:00080000:0.0:1787828348.052098:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1787828348.052105:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273036288:192.168.203.121@tcp:8:kworker.0
00000100:00080000:0.0:1787828348.052113:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828348.052128:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1787828348.052137:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828348.052157:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828348/real 1787828348]  req@ffff9ee0056ea580 x1874670273036288/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828373 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787828348.052161:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9680 x1874670273036672/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828348.052199:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ea580 x1874670273036288/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828373 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828348.052240:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828348.052246:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00080000:0.0:1787828348.052249:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1787828348.052250:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273036288:192.168.203.121@tcp:8:kworker.0
00000100:00080000:0.0:1787828348.052255:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787828348.052258:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828348.052267:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3511
00000100:00100000:1.0:1787828348.052273:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273036416:192.168.203.121@tcp:8:kworker.0
00000100:00080000:0.0:1787828348.052274:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828348.052284:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828348.052292:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1787828348.052305:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787828348.052311:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8780 x1874670273036800/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828348.052355:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828348/real 1787828348]  req@ffff9ee0056ead00 x1874670273036416/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828373 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828348.052371:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ead00 x1874670273036416/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828373 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828348.052378:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828348.052381:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828348.052384:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273036416:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828348.052389:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273036544:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787828348.052407:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828348.052415:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828348/real 1787828348]  req@ffff9ee0056e9a40 x1874670273036544/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828373 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828348.052424:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9a40 x1874670273036544/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828373 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828348.052429:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828348.052432:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828348.052434:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273036544:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828348.052446:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273036672:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828348.052458:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828348.052465:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828348/real 1787828348]  req@ffff9ee0056e9680 x1874670273036672/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828373 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828348.052474:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9680 x1874670273036672/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828373 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828348.052479:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828348.052481:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828348.052484:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273036672:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828348.052487:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273036800:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828348.052515:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828348.052526:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828348/real 1787828348]  req@ffff9ee0056e8780 x1874670273036800/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828373 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828348.052538:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8780 x1874670273036800/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828373 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828348.052547:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828348.052550:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828348.052553:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273036800:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828348.883465:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828349.075396:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828349.907476:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828350.099388:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828350.931440:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828351.123367:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828351.955475:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828352.147357:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828352.979549:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828353.171387:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:2.0:1787828353.171498:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828353.171512:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787828353.171519:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828353.171534:0:8:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3516
00000100:00080000:2.0:1787828353.171554:0:8:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828353.171568:0:8:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787828353.171653:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729680 x1874670273036928/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828353.171699:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828353.171704:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787828353.171707:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828353.171712:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3516
00000100:00080000:2.0:1787828353.171719:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828353.171726:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828353.171752:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787828353.171773:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273036928:192.168.203.121@tcp:250:kworker.0
00000100:00100000:2.0:1787828353.171774:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057292c0 x1874670273037056/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828353.171839:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828353.171844:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787828353.171848:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828353.171857:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3516
00000100:00080000:2.0:1787828353.171864:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828353.171871:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000800:00000100:1.0:1787828353.171877:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000008:00100000:2.0:1787828353.171880:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828353.171903:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572bc00 x1874670273037184/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828353.171917:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828353.171922:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787828353.171924:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1787828353.171927:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828353/real 1787828353]  req@ffff9ee005729680 x1874670273036928/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828378 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828353.171933:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3516
00000100:00080000:2.0:1787828353.171950:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828353.171975:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828353.171988:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787828353.171999:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729680 x1874670273036928/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828378 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828353.172011:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728780 x1874670273037312/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787828353.172052:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828353.172059:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828353.172064:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828353.172077:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273036928:192.168.203.121@tcp:250:kworker.0
00000100:00080000:2.0:1787828353.172078:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787828353.172089:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828353.172104:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3516
00000100:00080000:2.0:1787828353.172114:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1787828353.172120:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057292c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273037056:192.168.203.121@tcp:38:kworker.0
00000100:00080000:2.0:1787828353.172131:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828353.172145:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000800:00000100:1.0:1787828353.172159:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828353.172189:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a940 x1874670273037440/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828353.172204:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828353/real 1787828353]  req@ffff9ee0057292c0 x1874670273037056/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828378 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828353.172210:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828353.172224:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787828353.172232:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828353.172244:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3516
00000100:00080000:2.0:1787828353.172253:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1787828353.172257:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057292c0 x1874670273037056/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828378 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828353.172266:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828353.172285:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:1.0:1787828353.172286:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828353.172299:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828353.172305:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729e00 x1874670273037568/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828353.172347:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057292c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273037056:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828353.172363:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273037184:192.168.203.121@tcp:8:kworker.0
00000100:00080000:2.0:1787828353.172402:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828353.172407:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787828353.172410:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828353.172419:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3516
00000100:00080000:2.0:1787828353.172429:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828353.172434:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828353.172443:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1787828353.172456:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828353.172467:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a1c0 x1874670273037696/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828353.172509:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828353/real 1787828353]  req@ffff9ee00572bc00 x1874670273037184/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828378 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828353.172529:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572bc00 x1874670273037184/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828378 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828353.172545:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828353.172549:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828353.172552:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273037184:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828353.172560:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273037312:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828353.172584:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828353.172594:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828353/real 1787828353]  req@ffff9ee005728780 x1874670273037312/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828378 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828353.172604:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728780 x1874670273037312/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828378 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828353.172611:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828353.172614:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828353.172617:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273037312:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828353.172638:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273037440:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787828353.172655:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828353.172670:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828353/real 1787828353]  req@ffff9ee00572a940 x1874670273037440/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828378 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828353.172687:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a940 x1874670273037440/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828378 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828353.172699:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828353.172705:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828353.172710:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273037440:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828353.172720:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273037568:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828353.172761:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828353.172770:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828353/real 1787828353]  req@ffff9ee005729e00 x1874670273037568/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828378 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828353.172778:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729e00 x1874670273037568/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828378 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828353.172784:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828353.172786:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828353.172788:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273037568:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828353.172810:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273037696:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828353.172825:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828353.172833:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828353/real 1787828353]  req@ffff9ee00572a1c0 x1874670273037696/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828378 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828353.172841:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a1c0 x1874670273037696/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828378 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828353.172846:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828353.172848:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828353.172850:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273037696:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828354.003577:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828354.195461:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828355.027546:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828355.219417:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828356.051505:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828356.243449:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828357.075538:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828357.267427:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828358.099577:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828358.291446:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:2.0:1787828358.291501:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828358.291515:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787828358.291521:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828358.291535:0:8:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3522
00000100:00080000:2.0:1787828358.291555:0:8:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828358.291573:0:8:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787828358.291634:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057283c0 x1874670273037824/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828358.291687:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828358.291694:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787828358.291698:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828358.291712:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3522
00000100:00080000:2.0:1787828358.291722:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828358.291731:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828358.291749:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787828358.291752:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273037824:192.168.203.121@tcp:250:kworker.0
00000100:00100000:2.0:1787828358.291809:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728000 x1874670273037952/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828358.291827:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828358.291831:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787828358.291835:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828358.291840:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3522
00000100:00080000:2.0:1787828358.291847:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828358.291853:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828358.291861:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828358.291875:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a580 x1874670273038080/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1787828358.291889:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:2.0:1787828358.291908:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828358.291914:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787828358.291919:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828358.291925:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3522
00000100:00080000:2.0:1787828358.291931:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828358.291935:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828358.291943:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828358.291960:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728b40 x1874670273038208/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828358.291972:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828358.291977:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787828358.291987:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1787828358.291988:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828358/real 1787828358]  req@ffff9ee0057283c0 x1874670273037824/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828383 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828358.292009:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3522
00000100:00080000:2.0:1787828358.292022:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828358.292034:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828358.292042:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787828358.292063:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728f00 x1874670273038336/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787828358.292068:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057283c0 x1874670273037824/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828383 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828358.292141:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828358.292153:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787828358.292163:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828358.292176:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3522
00000100:00080000:0.0:1787828358.292183:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828358.292184:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828358.292198:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00080000:0.0:1787828358.292200:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000008:00100000:2.0:1787828358.292213:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828358.292222:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273037824:192.168.203.121@tcp:250:kworker.0
00000100:00100000:2.0:1787828358.292241:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b840 x1874670273038464/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828358.292256:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828358.292262:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787828358.292266:0:8:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828358.292278:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3522
00000100:00100000:0.0:1787828358.292280:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273037952:192.168.203.121@tcp:38:kworker.0
00000100:00080000:2.0:1787828358.292297:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828358.292304:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828358.292310:0:8:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828358.292390:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729a40 x1874670273038592/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1787828358.292395:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787828358.292451:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828358/real 1787828358]  req@ffff9ee005728000 x1874670273037952/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828383 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787828358.292472:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728000 x1874670273037952/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828383 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828358.292489:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787828358.292495:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787828358.292500:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273037952:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787828358.292510:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273038080:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787828358.292534:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787828358.292547:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828358/real 1787828358]  req@ffff9ee00572a580 x1874670273038080/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828383 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787828358.292565:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a580 x1874670273038080/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828383 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828358.292574:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787828358.292578:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787828358.292582:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273038080:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787828358.292591:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273038208:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787828358.292613:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787828358.292624:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828358/real 1787828358]  req@ffff9ee005728b40 x1874670273038208/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828383 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787828358.292637:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728b40 x1874670273038208/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828383 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828358.292649:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787828358.292654:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787828358.292658:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273038208:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787828358.292665:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273038336:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787828358.292680:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787828358.292688:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828358/real 1787828358]  req@ffff9ee005728f00 x1874670273038336/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828383 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787828358.292699:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728f00 x1874670273038336/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828383 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828358.292707:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787828358.292710:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787828358.292713:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273038336:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787828358.292718:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273038464:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787828358.292733:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787828358.292741:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828358/real 1787828358]  req@ffff9ee00572b840 x1874670273038464/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828383 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787828358.292751:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b840 x1874670273038464/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828383 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828358.292782:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787828358.292786:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787828358.292790:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273038464:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787828358.292817:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273038592:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787828358.292841:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787828358.292852:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828358/real 1787828358]  req@ffff9ee005729a40 x1874670273038592/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828383 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787828358.292871:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729a40 x1874670273038592/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828383 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828358.292883:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787828358.292888:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787828358.292893:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273038592:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828359.123502:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828359.315426:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828360.147581:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828360.339463:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828361.171466:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828361.363424:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828362.195573:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828362.387420:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828363.219600:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828363.411410:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:2.0:1787828363.411413:0:27558:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828363.411424:0:27558:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787828363.411431:0:27558:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828363.411446:0:27558:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3527
00000100:00080000:2.0:1787828363.411462:0:27558:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828363.411472:0:27558:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787828363.411527:0:27558:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b480 x1874670273038720/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828363.411561:0:27558:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828363.411566:0:27558:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787828363.411568:0:27558:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828363.411573:0:27558:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3527
00000100:00080000:2.0:1787828363.411578:0:27558:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828363.411583:0:27558:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828363.411598:0:27558:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787828363.411614:0:27558:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572ad00 x1874670273038848/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828363.411629:0:27558:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828363.411635:0:27558:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787828363.411642:0:27558:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1787828363.411644:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273038720:192.168.203.121@tcp:250:kworker.0
00000100:00080000:2.0:1787828363.411657:0:27558:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3527
00000100:00080000:2.0:1787828363.411663:0:27558:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828363.411670:0:27558:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828363.411678:0:27558:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828363.411701:0:27558:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b0c0 x1874670273038976/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828363.411737:0:27558:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828363.411742:0:27558:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787828363.411744:0:27558:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:0.0:1787828363.411752:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:2.0:1787828363.411753:0:27558:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3527
00000100:00080000:2.0:1787828363.411775:0:27558:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828363.411781:0:27558:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828363.411790:0:27558:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828363.411817:0:27558:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729a40 x1874670273039104/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828363.411834:0:27558:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1787828363.411842:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828363/real 1787828363]  req@ffff9ee00572b480 x1874670273038720/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828388 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828363.411843:0:27558:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787828363.411852:0:27558:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828363.411877:0:27558:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3527
00000100:00080000:2.0:1787828363.411887:0:27558:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1787828363.411893:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b480 x1874670273038720/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828388 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828363.411904:0:27558:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00080000:0.0:1787828363.411923:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000008:00100000:2.0:1787828363.411925:0:27558:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00080000:0.0:1787828363.411932:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787828363.411944:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273038720:192.168.203.121@tcp:250:kworker.0
00000100:00100000:2.0:1787828363.411962:0:27558:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b840 x1874670273039232/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828363.411982:0:27558:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1787828363.411990:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273038848:192.168.203.121@tcp:38:kworker.0
00000100:00080000:2.0:1787828363.411993:0:27558:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787828363.412000:0:27558:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828363.412019:0:27558:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3527
00000100:00080000:2.0:1787828363.412028:0:27558:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828363.412035:0:27558:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828363.412042:0:27558:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828363.412062:0:27558:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728f00 x1874670273039360/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1787828363.412075:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:2.0:1787828363.412091:0:27558:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828363.412097:0:27558:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787828363.412100:0:27558:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828363.412107:0:27558:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3527
00000100:00100000:0.0:1787828363.412113:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828363/real 1787828363]  req@ffff9ee00572ad00 x1874670273038848/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828388 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828363.412118:0:27558:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828363.412151:0:27558:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828363.412161:0:27558:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828363.412162:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572ad00 x1874670273038848/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828388 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828363.412185:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:2.0:1787828363.412189:0:27558:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728b40 x1874670273039488/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828363.412197:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787828363.412216:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273038848:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787828363.412232:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273038976:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787828363.412272:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787828363.412288:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828363/real 1787828363]  req@ffff9ee00572b0c0 x1874670273038976/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828388 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787828363.412304:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b0c0 x1874670273038976/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828388 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828363.412316:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787828363.412321:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787828363.412326:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273038976:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787828363.412335:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273039104:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787828363.412419:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787828363.412431:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828363/real 1787828363]  req@ffff9ee005729a40 x1874670273039104/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828388 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787828363.412450:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729a40 x1874670273039104/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828388 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828363.412457:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787828363.412460:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787828363.412463:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273039104:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787828363.412482:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273039232:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787828363.412498:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787828363.412507:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828363/real 1787828363]  req@ffff9ee00572b840 x1874670273039232/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828388 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787828363.412517:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b840 x1874670273039232/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828388 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828363.412524:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787828363.412527:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787828363.412529:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273039232:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787828363.412538:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273039360:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787828363.412562:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787828363.412579:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828363/real 1787828363]  req@ffff9ee005728f00 x1874670273039360/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828388 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787828363.412592:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728f00 x1874670273039360/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828388 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828363.412606:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787828363.412609:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787828363.412612:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273039360:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787828363.412618:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273039488:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787828363.412636:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787828363.412645:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828363/real 1787828363]  req@ffff9ee005728b40 x1874670273039488/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828388 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787828363.412655:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728b40 x1874670273039488/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828388 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828363.412662:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787828363.412664:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787828363.412667:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273039488:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828364.243592:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828364.435440:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828365.267590:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828365.459525:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828366.291627:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828366.483498:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828367.315594:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828367.507505:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828368.339654:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828368.531474:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:1.0:1787828368.531551:0:27558:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828368.531571:0:27558:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1787828368.531581:0:27558:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787828368.531601:0:27558:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3532
00000100:00080000:1.0:1787828368.531639:0:27558:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828368.531653:0:27558:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787828368.531745:0:27558:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a03c0 x1874670273039616/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787828368.531805:0:27558:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828368.531812:0:27558:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787828368.531816:0:27558:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787828368.531823:0:27558:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3532
00000100:00080000:1.0:1787828368.531832:0:27558:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828368.531841:0:27558:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787828368.531862:0:27558:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787828368.531881:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273039616:192.168.203.121@tcp:250:kworker.0
00000100:00100000:1.0:1787828368.531897:0:27558:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a12c0 x1874670273039744/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787828368.531926:0:27558:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828368.531933:0:27558:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787828368.531937:0:27558:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787828368.531946:0:27558:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3532
00000100:00080000:1.0:1787828368.531955:0:27558:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828368.531965:0:27558:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787828368.531975:0:27558:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787828368.532004:0:27558:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1a40 x1874670273039872/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1787828368.532011:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:1.0:1787828368.532064:0:27558:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828368.532072:0:27558:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787828368.532077:0:27558:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1787828368.532102:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828368/real 1787828368]  req@ffff9ee0056a03c0 x1874670273039616/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828393 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828368.532111:0:27558:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3532
00000100:00080000:1.0:1787828368.532124:0:27558:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828368.532144:0:27558:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787828368.532160:0:27558:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787828368.532188:0:27558:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a3c00 x1874670273040000/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787828368.532192:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a03c0 x1874670273039616/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828393 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828368.532277:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828368.532280:0:27558:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828368.532289:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:1.0:1787828368.532299:0:27558:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00100000:0.0:1787828368.532304:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273039616:192.168.203.121@tcp:250:kworker.0
00000100:00080000:1.0:1787828368.532308:0:27558:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1787828368.532381:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273039744:192.168.203.121@tcp:38:kworker.0
00000100:00080000:1.0:1787828368.532438:0:27558:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3532
00000800:00000100:0.0:1787828368.532441:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:1.0:1787828368.532457:0:27558:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828368.532472:0:27558:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787828368.532485:0:27558:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787828368.532494:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828368/real 1787828368]  req@ffff9ee0056a12c0 x1874670273039744/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828393 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828368.532521:0:27558:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a2940 x1874670273040128/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787828368.532530:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a12c0 x1874670273039744/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828393 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828368.532589:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787828368.532601:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00080000:1.0:1787828368.532603:0:27558:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1787828368.532609:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273039744:192.168.203.121@tcp:38:kworker.0
00000100:00080000:1.0:1787828368.532631:0:27558:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00100000:0.0:1787828368.532633:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273039872:192.168.203.121@tcp:8:kworker.0
00000100:00080000:1.0:1787828368.532642:0:27558:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787828368.532658:0:27558:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3532
00000100:00080000:1.0:1787828368.532672:0:27558:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000800:00000100:0.0:1787828368.532707:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:1.0:1787828368.532734:0:27558:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787828368.532749:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828368/real 1787828368]  req@ffff9ee0056a1a40 x1874670273039872/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828393 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:1.0:1787828368.532750:0:27558:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828368.532798:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1a40 x1874670273039872/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828393 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828368.532811:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:1.0:1787828368.532817:0:27558:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1680 x1874670273040256/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828368.532819:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787828368.532835:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273039872:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787828368.532859:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273040000:192.168.203.121@tcp:8:kworker.0
00000100:00080000:1.0:1787828368.532883:0:27558:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828368.532892:0:27558:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787828368.532897:0:27558:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787828368.532909:0:27558:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3532
00000800:00000100:0.0:1787828368.532918:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:1.0:1787828368.532925:0:27558:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828368.532940:0:27558:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787828368.532951:0:27558:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828368.532957:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828368/real 1787828368]  req@ffff9ee0056a3c00 x1874670273040000/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828393 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828368.533005:0:27558:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0f00 x1874670273040384/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787828368.533010:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a3c00 x1874670273040000/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828393 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828368.533089:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787828368.533099:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787828368.533107:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273040000:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787828368.533153:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273040128:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787828368.533198:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787828368.533217:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828368/real 1787828368]  req@ffff9ee0056a2940 x1874670273040128/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828393 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787828368.533244:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a2940 x1874670273040128/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828393 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828368.533254:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787828368.533259:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787828368.533263:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273040128:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787828368.533270:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273040256:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787828368.533293:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787828368.533304:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828368/real 1787828368]  req@ffff9ee0056a1680 x1874670273040256/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828393 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787828368.533352:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1680 x1874670273040256/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828393 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828368.533363:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787828368.533367:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787828368.533371:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273040256:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787828368.533379:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273040384:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787828368.533402:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787828368.533417:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828368/real 1787828368]  req@ffff9ee0056a0f00 x1874670273040384/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828393 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787828368.533440:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0f00 x1874670273040384/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828393 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828368.533457:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787828368.533464:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787828368.533471:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273040384:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828369.363706:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828369.555492:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828370.387575:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828370.579450:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828371.411507:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828371.603440:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828372.435501:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828372.627432:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828373.459582:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1787828373.651449:0:27558:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828373.651475:0:27558:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787828373.651479:0:27558:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828373.651489:0:27558:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3537
00000100:00080000:3.0:1787828373.651501:0:27558:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1787828373.651507:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787828373.651508:0:27558:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787828373.651547:0:27558:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704b40 x1874670273040512/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828373.651577:0:27558:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828373.651581:0:27558:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787828373.651582:0:27558:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828373.651586:0:27558:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3537
00000100:00080000:3.0:1787828373.651589:0:27558:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828373.651592:0:27558:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828373.651601:0:27558:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787828373.651611:0:27558:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705e00 x1874670273040640/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828373.651631:0:27558:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828373.651634:0:27558:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787828373.651636:0:27558:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828373.651638:0:27558:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3537
00000100:00080000:3.0:1787828373.651641:0:27558:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828373.651644:0:27558:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828373.651662:0:27558:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828373.651672:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273040512:192.168.203.121@tcp:250:kworker.0
00000100:00100000:3.0:1787828373.651677:0:27558:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705a40 x1874670273040768/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828373.651691:0:27558:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828373.651694:0:27558:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787828373.651695:0:27558:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828373.651699:0:27558:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3537
00000100:00080000:3.0:1787828373.651702:0:27558:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828373.651705:0:27558:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828373.651709:0:27558:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787828373.651720:0:27558:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704780 x1874670273040896/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828373.651729:0:27558:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828373.651733:0:27558:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787828373.651735:0:27558:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828373.651740:0:27558:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3537
00000800:00000100:0.0:1787828373.651745:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787828373.651749:0:27558:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828373.651758:0:27558:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828373.651781:0:27558:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787828373.651796:0:27558:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706580 x1874670273041024/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787828373.651804:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828373/real 1787828373]  req@ffff9ee005704b40 x1874670273040512/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828398 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828373.651815:0:27558:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828373.651820:0:27558:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787828373.651822:0:27558:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1787828373.651826:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704b40 x1874670273040512/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828398 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828373.651827:0:27558:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3537
00000100:00080000:3.0:1787828373.651851:0:27558:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828373.651859:0:27558:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828373.651868:0:27558:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:0.0:1787828373.651871:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787828373.651880:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787828373.651882:0:27558:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057043c0 x1874670273041152/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787828373.651894:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273040512:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787828373.651895:0:27558:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828373.651903:0:27558:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787828373.651907:0:27558:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828373.651912:0:27558:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3537
00000100:00100000:0.0:1787828373.651916:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273040640:192.168.203.121@tcp:38:kworker.0
00000100:00080000:3.0:1787828373.651917:0:27558:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828373.651942:0:27558:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828373.651947:0:27558:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787828373.651959:0:27558:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707840 x1874670273041280/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1787828373.651969:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787828373.651983:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828373/real 1787828373]  req@ffff9ee005705e00 x1874670273040640/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828398 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787828373.652011:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705e00 x1874670273040640/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828398 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828373.652018:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787828373.652021:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787828373.652024:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273040640:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787828373.652044:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273040768:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787828373.652066:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787828373.652081:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828373/real 1787828373]  req@ffff9ee005705a40 x1874670273040768/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828398 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787828373.652096:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705a40 x1874670273040768/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828398 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828373.652122:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787828373.652125:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787828373.652128:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273040768:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787828373.652133:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273040896:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787828373.652151:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787828373.652160:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828373/real 1787828373]  req@ffff9ee005704780 x1874670273040896/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828398 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787828373.652186:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704780 x1874670273040896/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828398 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828373.652192:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787828373.652195:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787828373.652197:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273040896:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787828373.652201:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273041024:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787828373.652214:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787828373.652221:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828373/real 1787828373]  req@ffff9ee005706580 x1874670273041024/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828398 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787828373.652229:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706580 x1874670273041024/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828398 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828373.652235:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787828373.652237:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787828373.652240:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273041024:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787828373.652251:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273041152:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787828373.652262:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787828373.652268:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828373/real 1787828373]  req@ffff9ee0057043c0 x1874670273041152/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828398 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787828373.652276:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057043c0 x1874670273041152/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828398 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828373.652282:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787828373.652284:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787828373.652287:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273041152:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787828373.652291:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273041280:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787828373.652301:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787828373.652308:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828373/real 1787828373]  req@ffff9ee005707840 x1874670273041280/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828398 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787828373.652315:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707840 x1874670273041280/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828398 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828373.652321:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787828373.652323:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787828373.652325:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273041280:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828374.483661:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828374.675510:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828375.507575:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828375.699464:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828376.531589:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828376.723480:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828377.555556:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828377.747523:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828378.579514:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1787828378.771389:0:27558:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1787828378.771398:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787828378.771400:0:27558:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787828378.771408:0:27558:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828378.771420:0:27558:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3542
00000100:00080000:3.0:1787828378.771432:0:27558:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828378.771440:0:27558:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787828378.771483:0:27558:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707480 x1874670273041408/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828378.771511:0:27558:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828378.771514:0:27558:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787828378.771516:0:27558:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828378.771519:0:27558:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3542
00000100:00080000:3.0:1787828378.771521:0:27558:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828378.771524:0:27558:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828378.771534:0:27558:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787828378.771544:0:27558:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057052c0 x1874670273041536/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828378.771558:0:27558:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828378.771562:0:27558:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787828378.771564:0:27558:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1787828378.771568:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273041408:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787828378.771569:0:27558:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3542
00000100:00080000:3.0:1787828378.771575:0:27558:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828378.771579:0:27558:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828378.771583:0:27558:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787828378.771593:0:27558:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706940 x1874670273041664/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828378.771601:0:27558:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828378.771603:0:27558:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787828378.771605:0:27558:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828378.771607:0:27558:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3542
00000100:00080000:3.0:1787828378.771609:0:27558:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828378.771628:0:27558:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828378.771632:0:27558:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787828378.771641:0:27558:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057070c0 x1874670273041792/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828378.771671:0:27558:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828378.771675:0:27558:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787828378.771678:0:27558:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828378.771683:0:27558:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3542
00000100:00080000:3.0:1787828378.771690:0:27558:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000800:00000100:0.0:1787828378.771698:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787828378.771703:0:27558:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828378.771712:0:27558:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787828378.771729:0:27558:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704000 x1874670273041920/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828378.771740:0:27558:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828378.771744:0:27558:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787828378.771747:0:27558:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828378.771762:0:27558:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3542
00000100:00080000:3.0:1787828378.771769:0:27558:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828378.771773:0:27558:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828378.771780:0:27558:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828378.771787:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828378/real 1787828378]  req@ffff9ee005707480 x1874670273041408/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828403 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787828378.771800:0:27558:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706d00 x1874670273042048/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828378.771850:0:27558:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828378.771853:0:27558:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787828378.771854:0:27558:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828378.771857:0:27558:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3542
00000100:00080000:3.0:1787828378.771860:0:27558:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1787828378.771863:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707480 x1874670273041408/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828403 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828378.771866:0:27558:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828378.771874:0:27558:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:0.0:1787828378.771880:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787828378.771887:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787828378.771892:0:27558:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705680 x1874670273042176/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787828378.771895:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273041408:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787828378.771926:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273041536:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787828378.771957:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787828378.771968:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828378/real 1787828378]  req@ffff9ee0057052c0 x1874670273041536/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828403 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787828378.771977:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057052c0 x1874670273041536/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828403 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828378.771983:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787828378.771986:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787828378.771988:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273041536:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787828378.771992:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273041664:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787828378.772007:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787828378.772016:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828378/real 1787828378]  req@ffff9ee005706940 x1874670273041664/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828403 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787828378.772028:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706940 x1874670273041664/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828403 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828378.772037:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787828378.772040:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787828378.772044:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273041664:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787828378.772051:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273041792:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787828378.772082:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787828378.772091:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828378/real 1787828378]  req@ffff9ee0057070c0 x1874670273041792/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828403 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787828378.772100:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057070c0 x1874670273041792/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828403 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828378.772105:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787828378.772108:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787828378.772110:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273041792:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787828378.772113:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273041920:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787828378.772124:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787828378.772130:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828378/real 1787828378]  req@ffff9ee005704000 x1874670273041920/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828403 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787828378.772138:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704000 x1874670273041920/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828403 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828378.772143:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787828378.772144:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787828378.772146:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273041920:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787828378.772149:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273042048:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787828378.772159:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787828378.772165:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828378/real 1787828378]  req@ffff9ee005706d00 x1874670273042048/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828403 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787828378.772172:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706d00 x1874670273042048/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828403 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828378.772178:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787828378.772181:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787828378.772183:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273042048:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787828378.772188:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273042176:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787828378.772207:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787828378.772218:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828378/real 1787828378]  req@ffff9ee005705680 x1874670273042176/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828403 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787828378.772232:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705680 x1874670273042176/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828403 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828378.772241:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787828378.772243:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787828378.772245:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273042176:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828379.603667:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828379.795465:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828380.627509:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828380.819400:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828381.651456:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828381.843474:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828382.675604:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828382.867480:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828383.699619:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828383.891434:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:1.0:1787828383.891449:0:27558:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828383.891458:0:27558:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1787828383.891465:0:27558:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787828383.891499:0:27558:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3547
00000100:00080000:1.0:1787828383.891518:0:27558:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828383.891531:0:27558:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787828383.891646:0:27558:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a21c0 x1874670273042304/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787828383.891703:0:27558:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828383.891716:0:27558:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787828383.891720:0:27558:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787828383.891729:0:27558:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3547
00000100:00080000:1.0:1787828383.891769:0:27558:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828383.891777:0:27558:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787828383.891798:0:27558:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787828383.891800:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273042304:192.168.203.121@tcp:250:kworker.0
00000100:00100000:1.0:1787828383.891838:0:27558:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0f00 x1874670273042432/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787828383.891877:0:27558:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828383.891885:0:27558:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787828383.891890:0:27558:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787828383.891897:0:27558:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3547
00000100:00080000:1.0:1787828383.891906:0:27558:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828383.891913:0:27558:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787828383.891921:0:27558:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787828383.891954:0:27558:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1680 x1874670273042560/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787828383.891965:0:27558:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828383.891969:0:27558:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787828383.891972:0:27558:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787828383.891980:0:27558:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3547
00000100:00080000:1.0:1787828383.891985:0:27558:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828383.891991:0:27558:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787828383.891999:0:27558:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828383.892021:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273042432:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828383.892027:0:27558:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a2940 x1874670273042688/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787828383.892058:0:27558:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828383.892063:0:27558:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787828383.892065:0:27558:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787828383.892073:0:27558:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3547
00000100:00080000:1.0:1787828383.892078:0:27558:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828383.892084:0:27558:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787828383.892092:0:27558:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787828383.892109:0:27558:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a3c00 x1874670273042816/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787828383.892123:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273042560:192.168.203.121@tcp:8:kworker.0
00000100:00080000:1.0:1787828383.892127:0:27558:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828383.892143:0:27558:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787828383.892148:0:27558:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787828383.892156:0:27558:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3547
00000100:00080000:1.0:1787828383.892172:0:27558:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828383.892177:0:27558:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787828383.892186:0:27558:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828383.892188:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273042688:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828383.892216:0:27558:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1a40 x1874670273042944/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787828383.892238:0:27558:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828383.892245:0:27558:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787828383.892249:0:27558:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787828383.892261:0:27558:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3547
00000100:00100000:0.0:1787828383.892263:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273042816:192.168.203.121@tcp:38:kworker.0
00000100:00080000:1.0:1787828383.892281:0:27558:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828383.892295:0:27558:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787828383.892308:0:27558:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828383.892309:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273042944:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828383.892400:0:27558:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a12c0 x1874670273043072/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787828383.892439:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273043072:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828384.723531:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828384.915496:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828385.747496:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828385.939575:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828386.771547:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828386.963535:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000400:00000100:3.0:1787828386.963908:0:2353:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.203.121:988
00000400:00000100:3.0:1787828386.964009:0:2353:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.203.121@tcp at host 192.168.203.121 was unreachable: the network or that node may be down, or Lustre may be misconfigured.
00000800:00000100:3.0:1787828386.964036:0:2353:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:3.0:1787828386.964092:0:2353:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:3.0:1787828386.964108:0:2353:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:3.0:1787828386.964126:0:2353:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:3.0:1787828386.964143:0:2353:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000100:00100000:2.0:1787828386.964177:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828383/real 1787828386]  req@ffff9ee0056a2940 x1874670273042688/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828408 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000800:00000100:3.0:1787828386.964179:0:2353:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:3.0:1787828386.964207:0:2353:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000100:00100000:2.0:1787828386.964234:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a2940 x1874670273042688/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828408 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828386.964258:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828386.964276:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828386.964285:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273042688:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787828386.964413:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828383/real 1787828386]  req@ffff9ee0056a3c00 x1874670273042816/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828408 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828386.964456:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a3c00 x1874670273042816/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828408 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828386.964472:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828386.964479:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828386.964486:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273042816:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787828386.964500:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828383/real 1787828386]  req@ffff9ee0056a0f00 x1874670273042432/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828408 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828386.964536:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0f00 x1874670273042432/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828408 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828386.964552:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828386.964592:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828386.964599:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273042432:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787828386.964610:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828383/real 1787828386]  req@ffff9ee0056a1680 x1874670273042560/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828408 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828386.964630:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1680 x1874670273042560/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828408 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828386.964643:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828386.964649:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828386.964654:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273042560:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787828386.964664:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828383/real 1787828386]  req@ffff9ee0056a21c0 x1874670273042304/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828408 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828386.964687:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a21c0 x1874670273042304/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828408 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828386.964703:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828386.964713:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828386.964722:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273042304:192.168.203.121@tcp:250:kworker.0
00000100:00100000:2.0:1787828386.964785:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828383/real 1787828386]  req@ffff9ee0056a12c0 x1874670273043072/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828408 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828386.964810:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a12c0 x1874670273043072/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828408 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828386.964826:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828386.964833:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828386.964841:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273043072:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787828386.964856:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828383/real 1787828386]  req@ffff9ee0056a1a40 x1874670273042944/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828408 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828386.964877:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1a40 x1874670273042944/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828408 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828386.964901:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828386.964907:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828386.964914:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273042944:192.168.203.121@tcp:8:kworker.0
00010000:00010000:3.0:1787828387.795468:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828387.987471:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828388.819585:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1787828389.011451:0:27558:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828389.011463:0:27558:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00100000:3.0:1787828389.011466:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:1.0:1787828389.011468:0:27558:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787828389.011486:0:27558:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3552
00000100:00080000:1.0:1787828389.011517:0:27558:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828389.011525:0:27558:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787828389.011593:0:27558:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a03c0 x1874670273043200/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787828389.011621:0:27558:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828389.011625:0:27558:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787828389.011627:0:27558:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787828389.011630:0:27558:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3552
00000100:00080000:1.0:1787828389.011634:0:27558:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828389.011638:0:27558:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787828389.011648:0:27558:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787828389.011661:0:27558:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1e00 x1874670273043328/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787828389.011667:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273043200:192.168.203.121@tcp:250:kworker.0
00000100:00080000:1.0:1787828389.011694:0:27558:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828389.011700:0:27558:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787828389.011703:0:27558:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787828389.011711:0:27558:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3552
00000100:00080000:1.0:1787828389.011716:0:27558:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828389.011723:0:27558:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787828389.011731:0:27558:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:2.0:1787828389.011753:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828389.011754:0:27558:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0b40 x1874670273043456/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787828389.011768:0:27558:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828389.011772:0:27558:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787828389.011781:0:27558:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787828389.011785:0:27558:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3552
00000100:00080000:1.0:1787828389.011790:0:27558:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828389.011794:0:27558:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787828389.011799:0:27558:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787828389.011809:0:27558:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a2580 x1874670273043584/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787828389.011819:0:27558:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1787828389.011825:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828389/real 1787828389]  req@ffff9ee0056a03c0 x1874670273043200/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828414 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828389.011827:0:27558:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787828389.011833:0:27558:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787828389.011847:0:27558:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3552
00000100:00080000:1.0:1787828389.011855:0:27558:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828389.011861:0:27558:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787828389.011865:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a03c0 x1874670273043200/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828414 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:1.0:1787828389.011872:0:27558:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00080000:2.0:1787828389.011882:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828389.011893:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828389.011900:0:27558:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a3480 x1874670273043712/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787828389.011902:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273043200:192.168.203.121@tcp:250:kworker.0
00000100:00080000:1.0:1787828389.011934:0:27558:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828389.011940:0:27558:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00100000:2.0:1787828389.011943:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273043328:192.168.203.121@tcp:38:kworker.0
00000100:00080000:1.0:1787828389.011945:0:27558:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787828389.011958:0:27558:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3552
00000100:00080000:1.0:1787828389.011965:0:27558:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828389.011969:0:27558:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787828389.011976:0:27558:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:2.0:1787828389.011996:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828389.011999:0:27558:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0780 x1874670273043840/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787828389.012018:0:27558:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1787828389.012024:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828389/real 1787828389]  req@ffff9ee0056a1e00 x1874670273043328/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828414 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828389.012026:0:27558:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787828389.012031:0:27558:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787828389.012043:0:27558:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3552
00000100:00080000:1.0:1787828389.012053:0:27558:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828389.012064:0:27558:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787828389.012064:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1e00 x1874670273043328/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828414 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:1.0:1787828389.012075:0:27558:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:2.0:1787828389.012095:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:1.0:1787828389.012098:0:27558:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0000 x1874670273043968/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828389.012107:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828389.012120:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273043328:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787828389.012139:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273043456:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787828389.012182:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828389.012201:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828389/real 1787828389]  req@ffff9ee0056a0b40 x1874670273043456/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828414 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828389.012225:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0b40 x1874670273043456/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828414 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828389.012237:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828389.012242:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828389.012246:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273043456:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787828389.012265:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273043584:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787828389.012292:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828389.012309:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828389/real 1787828389]  req@ffff9ee0056a2580 x1874670273043584/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828414 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828389.012355:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a2580 x1874670273043584/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828414 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828389.012367:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828389.012371:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828389.012375:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273043584:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787828389.012385:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273043712:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787828389.012414:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828389.012430:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828389/real 1787828389]  req@ffff9ee0056a3480 x1874670273043712/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828414 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828389.012447:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a3480 x1874670273043712/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828414 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828389.012467:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828389.012472:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828389.012477:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273043712:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787828389.012507:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273043840:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787828389.012558:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828389.012577:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828389/real 1787828389]  req@ffff9ee0056a0780 x1874670273043840/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828414 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828389.012596:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0780 x1874670273043840/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828414 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828389.012610:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828389.012616:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828389.012623:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273043840:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787828389.012633:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273043968:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787828389.012664:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828389.012682:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828389/real 1787828389]  req@ffff9ee0056a0000 x1874670273043968/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828414 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828389.012703:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0000 x1874670273043968/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828414 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828389.012714:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828389.012721:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828389.012726:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273043968:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828389.843533:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828390.035522:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828390.867609:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828391.059457:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828391.891603:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828392.083412:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828392.915593:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828393.107440:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828393.939589:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828394.131438:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:2.0:1787828394.131583:0:27558:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828394.131594:0:27558:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787828394.131600:0:27558:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828394.131614:0:27558:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3557
00000100:00080000:2.0:1787828394.131629:0:27558:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828394.131639:0:27558:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787828394.131687:0:27558:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a580 x1874670273044096/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828394.131725:0:27558:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828394.131731:0:27558:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787828394.131734:0:27558:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828394.131740:0:27558:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3557
00000100:00080000:2.0:1787828394.131745:0:27558:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828394.131752:0:27558:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828394.131777:0:27558:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787828394.131800:0:27558:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728000 x1874670273044224/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828394.131810:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273044096:192.168.203.121@tcp:250:kworker.0
00000100:00080000:2.0:1787828394.131822:0:27558:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828394.131830:0:27558:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787828394.131832:0:27558:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828394.131839:0:27558:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3557
00000100:00080000:2.0:1787828394.131848:0:27558:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828394.131855:0:27558:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828394.131866:0:27558:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828394.131895:0:27558:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057283c0 x1874670273044352/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1787828394.131923:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:2.0:1787828394.131940:0:27558:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828394.131950:0:27558:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787828394.131956:0:27558:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828394.131967:0:27558:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3557
00000100:00080000:2.0:1787828394.131977:0:27558:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828394.131983:0:27558:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828394.131991:0:27558:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828394.132022:0:27558:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a1c0 x1874670273044480/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828394.132024:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828394/real 1787828394]  req@ffff9ee00572a580 x1874670273044096/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828419 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828394.132057:0:27558:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828394.132066:0:27558:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787828394.132068:0:27558:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828394.132075:0:27558:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3557
00000100:00080000:2.0:1787828394.132081:0:27558:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1787828394.132087:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a580 x1874670273044096/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828419 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828394.132094:0:27558:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828394.132108:0:27558:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00080000:1.0:1787828394.132122:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:2.0:1787828394.132132:0:27558:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729e00 x1874670273044608/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787828394.132141:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828394.132160:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273044096:192.168.203.121@tcp:250:kworker.0
00000100:00080000:2.0:1787828394.132176:0:27558:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828394.132189:0:27558:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787828394.132192:0:27558:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828394.132199:0:27558:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3557
00000100:00080000:2.0:1787828394.132203:0:27558:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828394.132208:0:27558:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828394.132214:0:27558:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787828394.132233:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273044224:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787828394.132251:0:27558:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a940 x1874670273044736/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828394.132271:0:27558:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828394.132276:0:27558:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787828394.132280:0:27558:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:1.0:1787828394.132290:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:2.0:1787828394.132297:0:27558:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3557
00000100:00080000:2.0:1787828394.132308:0:27558:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828394.132381:0:27558:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787828394.132382:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828394/real 1787828394]  req@ffff9ee005728000 x1874670273044224/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828419 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:2.0:1787828394.132394:0:27558:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787828394.132422:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728000 x1874670273044224/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828419 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828394.132429:0:27558:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728780 x1874670273044864/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787828394.132466:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828394.132477:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828394.132488:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273044224:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828394.132502:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273044352:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828394.132583:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828394.132607:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828394/real 1787828394]  req@ffff9ee0057283c0 x1874670273044352/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828419 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828394.132632:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057283c0 x1874670273044352/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828419 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828394.132648:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828394.132655:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828394.132662:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273044352:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828394.132675:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273044480:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828394.132714:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828394.132732:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828394/real 1787828394]  req@ffff9ee00572a1c0 x1874670273044480/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828419 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828394.132756:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a1c0 x1874670273044480/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828419 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828394.132784:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828394.132790:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828394.132797:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273044480:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828394.132810:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273044608:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787828394.132849:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828394.132866:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828394/real 1787828394]  req@ffff9ee005729e00 x1874670273044608/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828419 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828394.132881:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729e00 x1874670273044608/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828419 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828394.132892:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828394.132896:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828394.132900:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273044608:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828394.132926:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273044736:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828394.132957:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828394.132979:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828394/real 1787828394]  req@ffff9ee00572a940 x1874670273044736/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828419 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828394.133005:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a940 x1874670273044736/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828419 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828394.133023:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828394.133030:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828394.133037:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273044736:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828394.133049:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273044864:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828394.133081:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828394.133095:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828394/real 1787828394]  req@ffff9ee005728780 x1874670273044864/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828419 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828394.133111:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728780 x1874670273044864/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828419 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828394.133127:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828394.133133:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828394.133140:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273044864:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828394.963621:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828395.155424:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828395.987469:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828396.179393:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828397.011625:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828397.203474:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828398.035558:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828398.227393:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828399.059522:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1787828399.251571:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828399.251584:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00100000:2.0:1787828399.251587:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787828399.251591:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828399.251605:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3562
00000100:00080000:3.0:1787828399.251619:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828399.251630:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787828399.251697:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707c00 x1874670273044992/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828399.251788:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273044992:192.168.203.121@tcp:250:kworker.0
00000800:00000100:1.0:1787828399.251862:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787828399.251925:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828399.251931:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787828399.251935:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828399.251941:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3562
00000100:00080000:3.0:1787828399.251947:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828399.251955:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828399.251967:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787828399.251988:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057061c0 x1874670273045120/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828399.252062:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828399/real 1787828399]  req@ffff9ee005707c00 x1874670273044992/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828424 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828399.252097:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707c00 x1874670273044992/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828424 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828399.252112:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828399.252118:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828399.252125:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273044992:192.168.203.121@tcp:250:kworker.0
00000100:00100000:1.0:1787828399.252165:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273045120:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787828399.252209:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828399.252238:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828399/real 1787828399]  req@ffff9ee0057061c0 x1874670273045120/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828424 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828399.252257:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057061c0 x1874670273045120/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828424 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828399.252270:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828399.252275:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828399.252280:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273045120:192.168.203.121@tcp:38:kworker.0
00000100:00080000:3.0:1787828399.252407:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828399.252414:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787828399.252417:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828399.252423:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3562
00000100:00080000:3.0:1787828399.252430:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828399.252436:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828399.252444:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787828399.252466:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057061c0 x1874670273045248/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828399.252499:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828399.252504:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787828399.252507:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828399.252513:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3562
00000100:00080000:3.0:1787828399.252518:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828399.252523:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828399.252529:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787828399.252543:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707c00 x1874670273045376/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828399.252554:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828399.252558:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787828399.252560:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828399.252565:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3562
00000100:00080000:3.0:1787828399.252569:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828399.252574:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828399.252580:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787828399.252592:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705680 x1874670273045504/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828399.252605:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828399.252610:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787828399.252613:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828399.252618:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3562
00000100:00080000:3.0:1787828399.252623:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828399.252628:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828399.252635:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787828399.252650:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706d00 x1874670273045632/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828399.252662:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828399.252666:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787828399.252669:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828399.252673:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3562
00000100:00080000:3.0:1787828399.252677:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828399.252681:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828399.252698:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787828399.252709:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704000 x1874670273045760/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828399.252799:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273045248:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828399.252835:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828399.252852:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828399/real 1787828399]  req@ffff9ee0057061c0 x1874670273045248/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828424 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828399.252868:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057061c0 x1874670273045248/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828424 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828399.252879:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828399.252884:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828399.252889:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273045248:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828399.252898:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273045376:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828399.252936:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828399.252953:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828399/real 1787828399]  req@ffff9ee005707c00 x1874670273045376/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828424 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828399.252971:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707c00 x1874670273045376/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828424 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828399.252981:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828399.252985:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828399.252990:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273045376:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828399.252998:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273045504:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787828399.253022:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828399.253037:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828399/real 1787828399]  req@ffff9ee005705680 x1874670273045504/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828424 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828399.253054:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705680 x1874670273045504/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828424 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828399.253067:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828399.253071:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828399.253076:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273045504:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828399.253084:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273045632:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828399.253113:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828399.253130:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828399/real 1787828399]  req@ffff9ee005706d00 x1874670273045632/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828424 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828399.253145:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706d00 x1874670273045632/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828424 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828399.253165:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828399.253169:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828399.253173:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273045632:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828399.253181:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273045760:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828399.253204:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828399.253219:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828399/real 1787828399]  req@ffff9ee005704000 x1874670273045760/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828424 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828399.253236:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704000 x1874670273045760/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828424 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828399.253248:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828399.253253:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828399.253258:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273045760:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828400.083486:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828400.275380:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828401.107504:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828401.299499:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828402.131553:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828402.323413:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828403.155536:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828403.347410:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828404.179529:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828404.371459:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:0.0:1787828404.371468:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828404.371477:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1787828404.371482:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828404.371495:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3568
00000100:00080000:0.0:1787828404.371510:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828404.371521:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787828404.371566:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9e00 x1874670273045888/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828404.371600:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828404.371604:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787828404.371606:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828404.371611:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3568
00000100:00080000:0.0:1787828404.371615:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828404.371619:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828404.371631:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787828404.371646:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8b40 x1874670273046016/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828404.371660:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828404.371664:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787828404.371667:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828404.371671:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3568
00000100:00080000:0.0:1787828404.371674:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828404.371683:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787828404.371686:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273045888:192.168.203.121@tcp:250:kworker.0
00000008:00100000:0.0:1787828404.371689:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828404.371719:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e92c0 x1874670273046144/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828404.371734:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828404.371738:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787828404.371740:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828404.371744:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3568
00000100:00080000:0.0:1787828404.371750:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828404.371754:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828404.371760:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828404.371773:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb840 x1874670273046272/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828404.371784:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828404.371787:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787828404.371789:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828404.371795:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3568
00000100:00080000:0.0:1787828404.371802:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000800:00000100:1.0:1787828404.371802:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:0.0:1787828404.371811:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828404.371817:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787828404.371841:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb480 x1874670273046400/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828404.371853:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828404.371857:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787828404.371860:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828404.371868:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3568
00000100:00100000:1.0:1787828404.371870:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828404/real 1787828404]  req@ffff9ee0056e9e00 x1874670273045888/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828429 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828404.371876:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828404.371893:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828404.371902:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828404.371917:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8000 x1874670273046528/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828404.371924:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9e00 x1874670273045888/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828429 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828404.371936:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828404.371949:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787828404.371956:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828404.371974:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3568
00000100:00080000:1.0:1787828404.371977:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787828404.371978:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828404.371988:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00080000:1.0:1787828404.371992:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000008:00100000:0.0:1787828404.372001:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787828404.372011:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273045888:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787828404.372015:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e83c0 x1874670273046656/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828404.372033:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273046016:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787828404.372086:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828404.372102:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828404/real 1787828404]  req@ffff9ee0056e8b40 x1874670273046016/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828429 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828404.372115:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8b40 x1874670273046016/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828429 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828404.372124:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828404.372128:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828404.372131:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273046016:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828404.372162:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273046144:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828404.372181:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828404.372191:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828404/real 1787828404]  req@ffff9ee0056e92c0 x1874670273046144/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828429 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828404.372202:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e92c0 x1874670273046144/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828429 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828404.372209:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828404.372212:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828404.372215:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273046144:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828404.372220:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273046272:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828404.372238:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828404.372253:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828404/real 1787828404]  req@ffff9ee0056eb840 x1874670273046272/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828429 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828404.372285:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb840 x1874670273046272/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828429 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828404.372294:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828404.372298:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828404.372302:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273046272:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828404.372309:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273046400:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787828404.372327:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828404.372352:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828404/real 1787828404]  req@ffff9ee0056eb480 x1874670273046400/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828429 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828404.372419:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb480 x1874670273046400/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828429 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828404.372428:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828404.372431:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828404.372454:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273046400:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828404.372461:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273046528:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828404.372506:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828404.372515:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828404/real 1787828404]  req@ffff9ee0056e8000 x1874670273046528/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828429 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828404.372523:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8000 x1874670273046528/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828429 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828404.372529:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828404.372531:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828404.372533:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273046528:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828404.372537:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273046656:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828404.372550:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828404.372556:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828404/real 1787828404]  req@ffff9ee0056e83c0 x1874670273046656/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828429 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828404.372564:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e83c0 x1874670273046656/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828429 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828404.372569:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828404.372570:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828404.372573:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273046656:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828405.203524:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828405.395501:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828406.227631:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828406.419497:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828407.251544:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828407.443468:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828408.275549:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828408.467530:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828409.299572:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828409.491453:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:0.0:1787828409.491502:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828409.491512:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1787828409.491519:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828409.491531:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3573
00000100:00080000:0.0:1787828409.491546:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828409.491555:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787828409.491602:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8f00 x1874670273046784/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828409.491658:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828409.491662:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787828409.491665:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828409.491669:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3573
00000100:00080000:0.0:1787828409.491673:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828409.491678:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828409.491689:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787828409.491721:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ebc00 x1874670273046912/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828409.491736:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828409.491741:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787828409.491744:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828409.491748:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3573
00000100:00080000:0.0:1787828409.491753:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1787828409.491761:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273046784:192.168.203.121@tcp:250:kworker.0
00000100:00080000:0.0:1787828409.491763:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828409.491781:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828409.491802:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e83c0 x1874670273047040/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828409.491826:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828409.491831:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787828409.491833:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828409.491838:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3573
00000100:00080000:0.0:1787828409.491844:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828409.491848:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828409.491855:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1787828409.491861:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787828409.491888:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8000 x1874670273047168/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828409.491903:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828409.491908:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787828409.491910:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828409.491916:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3573
00000100:00080000:0.0:1787828409.491921:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828409.491926:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828409.491932:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787828409.491935:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828409/real 1787828409]  req@ffff9ee0056e8f00 x1874670273046784/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828434 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787828409.491950:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb480 x1874670273047296/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828409.491962:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828409.491978:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787828409.491983:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828409.491990:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3573
00000100:00080000:0.0:1787828409.491995:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1787828409.492000:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8f00 x1874670273046784/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828434 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828409.492018:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00080000:1.0:1787828409.492019:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000008:00100000:0.0:1787828409.492027:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:1.0:1787828409.492032:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828409.492041:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273046784:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787828409.492050:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb840 x1874670273047424/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828409.492060:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273046912:192.168.203.121@tcp:38:kworker.0
00000100:00080000:0.0:1787828409.492074:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828409.492080:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787828409.492083:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828409.492089:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3573
00000100:00080000:0.0:1787828409.492105:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000800:00000100:1.0:1787828409.492107:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:0.0:1787828409.492116:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828409.492127:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787828409.492136:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828409/real 1787828409]  req@ffff9ee0056ebc00 x1874670273046912/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828434 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787828409.492169:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e92c0 x1874670273047552/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828409.492171:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ebc00 x1874670273046912/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828434 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828409.492234:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828409.492243:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828409.492251:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273046912:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828409.492313:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273047040:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828409.492438:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828409.492465:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828409/real 1787828409]  req@ffff9ee0056e83c0 x1874670273047040/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828434 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828409.492481:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e83c0 x1874670273047040/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828434 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828409.492493:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828409.492497:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828409.492501:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273047040:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828409.492508:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273047168:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828409.492532:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828409.492543:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828409/real 1787828409]  req@ffff9ee0056e8000 x1874670273047168/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828434 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828409.492557:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8000 x1874670273047168/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828434 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828409.492566:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828409.492570:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828409.492573:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273047168:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828409.492580:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273047296:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787828409.492598:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828409.492609:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828409/real 1787828409]  req@ffff9ee0056eb480 x1874670273047296/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828434 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828409.492622:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb480 x1874670273047296/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828434 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828409.492662:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828409.492665:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828409.492669:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273047296:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828409.492675:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273047424:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828409.492694:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828409.492704:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828409/real 1787828409]  req@ffff9ee0056eb840 x1874670273047424/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828434 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828409.492716:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb840 x1874670273047424/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828434 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828409.492724:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828409.492727:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828409.492731:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273047424:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828409.492737:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273047552:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828409.492753:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828409.492762:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828409/real 1787828409]  req@ffff9ee0056e92c0 x1874670273047552/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828434 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828409.492774:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e92c0 x1874670273047552/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828434 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828409.492783:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828409.492786:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828409.492790:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273047552:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828410.323561:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828410.515416:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828411.347532:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828411.539493:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828412.371526:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828412.563493:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828413.395512:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828413.587398:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828414.419601:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1787828414.611460:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1787828414.611464:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:0.0:1787828414.611474:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1787828414.611479:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828414.611489:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3578
00000100:00080000:0.0:1787828414.611500:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828414.611508:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787828414.611546:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8b40 x1874670273047680/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828414.611575:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828414.611579:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787828414.611580:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828414.611588:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3578
00000100:00080000:0.0:1787828414.611591:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828414.611595:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828414.611621:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787828414.611646:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9e00 x1874670273047808/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828414.611657:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828414.611660:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787828414.611662:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828414.611666:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3578
00000100:00080000:0.0:1787828414.611668:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828414.611674:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787828414.611679:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273047680:192.168.203.121@tcp:250:kworker.0
00000008:00100000:0.0:1787828414.611681:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828414.611693:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8780 x1874670273047936/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828414.611703:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828414.611706:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787828414.611708:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828414.611712:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3578
00000100:00080000:0.0:1787828414.611715:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828414.611718:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828414.611723:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828414.611735:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9680 x1874670273048064/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828414.611744:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828414.611747:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787828414.611748:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828414.611752:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3578
00000100:00080000:0.0:1787828414.611756:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828414.611759:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828414.611763:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000800:00000100:1.0:1787828414.611769:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787828414.611780:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9a40 x1874670273048192/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828414.611791:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828414.611794:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787828414.611796:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828414.611799:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3578
00000100:00080000:0.0:1787828414.611802:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828414.611805:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828414.611810:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787828414.611820:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828414/real 1787828414]  req@ffff9ee0056e8b40 x1874670273047680/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828439 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787828414.611823:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ead00 x1874670273048320/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828414.611876:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828414.611879:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787828414.611882:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1787828414.611887:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8b40 x1874670273047680/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828439 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828414.611888:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3578
00000100:00080000:0.0:1787828414.611894:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828414.611902:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828414.611912:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:1.0:1787828414.611914:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828414.611921:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828414.611931:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273047680:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787828414.611932:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ea580 x1874670273048448/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828414.611942:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273047808:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787828414.611995:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828414.612007:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828414/real 1787828414]  req@ffff9ee0056e9e00 x1874670273047808/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828439 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828414.612019:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9e00 x1874670273047808/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828439 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828414.612026:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828414.612029:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828414.612033:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273047808:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828414.612087:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273047936:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828414.612107:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828414.612117:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828414/real 1787828414]  req@ffff9ee0056e8780 x1874670273047936/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828439 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828414.612127:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8780 x1874670273047936/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828439 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828414.612135:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828414.612137:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828414.612140:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273047936:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828414.612144:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273048064:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828414.612157:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828414.612164:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828414/real 1787828414]  req@ffff9ee0056e9680 x1874670273048064/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828439 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828414.612174:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9680 x1874670273048064/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828439 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828414.612180:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828414.612182:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828414.612184:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273048064:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828414.612189:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273048192:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787828414.612200:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828414.612208:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828414/real 1787828414]  req@ffff9ee0056e9a40 x1874670273048192/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828439 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828414.612216:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9a40 x1874670273048192/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828439 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828414.612223:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828414.612226:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828414.612228:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273048192:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828414.612233:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273048320:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828414.612244:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828414.612256:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828414/real 1787828414]  req@ffff9ee0056ead00 x1874670273048320/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828439 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828414.612265:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ead00 x1874670273048320/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828439 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828414.612271:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828414.612274:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828414.612277:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273048320:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828414.612281:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273048448:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828414.612311:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828414.612319:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828414/real 1787828414]  req@ffff9ee0056ea580 x1874670273048448/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828439 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828414.612328:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ea580 x1874670273048448/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828439 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828414.612335:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828414.612337:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828414.612340:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273048448:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828415.443559:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828415.635424:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828416.467618:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828416.659417:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828417.491579:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828417.683406:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828418.515516:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828418.707416:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828419.539544:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1787828419.731435:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828419.731446:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1787828419.731451:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828419.731461:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3583
00000100:00080000:0.0:1787828419.731473:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1787828419.731485:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:0.0:1787828419.731486:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787828419.731539:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb0c0 x1874670273048576/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828419.731582:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828419.731586:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787828419.731587:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828419.731591:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3583
00000100:00080000:0.0:1787828419.731594:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828419.731597:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828419.731606:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787828419.731619:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ea940 x1874670273048704/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828419.731631:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828419.731634:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787828419.731637:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828419.731644:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3583
00000100:00100000:1.0:1787828419.731644:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273048576:192.168.203.121@tcp:250:kworker.0
00000100:00080000:0.0:1787828419.731651:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828419.731659:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828419.731664:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828419.731676:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ea580 x1874670273048832/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828419.731686:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828419.731689:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787828419.731691:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828419.731694:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3583
00000100:00080000:0.0:1787828419.731708:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828419.731719:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828419.731723:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1787828419.731732:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787828419.731735:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ead00 x1874670273048960/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828419.731767:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828419.731774:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787828419.731779:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828419.731789:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3583
00000100:00080000:0.0:1787828419.731798:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828419.731824:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828419.731831:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787828419.731848:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828419/real 1787828419]  req@ffff9ee0056eb0c0 x1874670273048576/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828444 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787828419.731870:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9a40 x1874670273049088/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828419.731872:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb0c0 x1874670273048576/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828444 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828419.731930:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787828419.731936:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828419.731939:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:0.0:1787828419.731946:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787828419.731953:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1787828419.731954:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273048576:192.168.203.121@tcp:250:kworker.0
00000100:00080000:0.0:1787828419.731964:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3583
00000100:00080000:0.0:1787828419.731973:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828419.731978:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828419.731986:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787828419.731996:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273048704:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787828419.732006:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9680 x1874670273049216/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828419.732022:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828419.732026:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787828419.732039:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:1.0:1787828419.732046:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:0.0:1787828419.732061:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3583
00000100:00080000:0.0:1787828419.732068:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1787828419.732073:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828419/real 1787828419]  req@ffff9ee0056ea940 x1874670273048704/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828444 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828419.732078:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828419.732090:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787828419.732126:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ea940 x1874670273048704/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828444 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787828419.732130:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8780 x1874670273049344/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787828419.732169:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828419.732175:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828419.732180:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273048704:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828419.732187:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273048832:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828419.732207:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828419.732217:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828419/real 1787828419]  req@ffff9ee0056ea580 x1874670273048832/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828444 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828419.732227:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ea580 x1874670273048832/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828444 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828419.732233:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828419.732236:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828419.732238:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273048832:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828419.732243:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273048960:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828419.732254:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828419.732270:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828419/real 1787828419]  req@ffff9ee0056ead00 x1874670273048960/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828444 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828419.732279:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ead00 x1874670273048960/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828444 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828419.732285:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828419.732287:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828419.732289:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273048960:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828419.732293:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273049088:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787828419.732304:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828419.732311:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828419/real 1787828419]  req@ffff9ee0056e9a40 x1874670273049088/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828444 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828419.732367:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9a40 x1874670273049088/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828444 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828419.732395:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828419.732405:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828419.732410:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273049088:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828419.732433:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273049216:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828419.732460:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828419.732471:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828419/real 1787828419]  req@ffff9ee0056e9680 x1874670273049216/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828444 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828419.732481:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9680 x1874670273049216/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828444 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828419.732487:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828419.732490:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828419.732492:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273049216:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828419.732496:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273049344:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828419.732509:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828419.732516:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828419/real 1787828419]  req@ffff9ee0056e8780 x1874670273049344/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828444 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828419.732525:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8780 x1874670273049344/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828444 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828419.732530:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828419.732533:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828419.732536:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273049344:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828420.563582:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828420.755570:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828421.587500:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828421.779404:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828422.611531:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828422.803433:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828423.635444:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828423.827442:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828424.659535:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1787828424.851463:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828424.851487:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1787828424.851492:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828424.851505:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3588
00000100:00080000:0.0:1787828424.851518:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828424.851527:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787828424.851573:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9e00 x1874670273049472/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828424.851610:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828424.851615:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787828424.851618:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828424.851632:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3588
00000100:00080000:0.0:1787828424.851637:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828424.851641:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828424.851654:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787828424.851670:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8b40 x1874670273049600/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828424.851686:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828424.851695:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00100000:1.0:1787828424.851696:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273049472:192.168.203.121@tcp:250:kworker.0
00000100:00080000:0.0:1787828424.851699:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828424.851714:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3588
00000100:00080000:0.0:1787828424.851719:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828424.851724:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828424.851731:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828424.851746:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e92c0 x1874670273049728/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828424.851767:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828424.851772:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787828424.851776:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828424.851782:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3588
00000100:00080000:0.0:1787828424.851788:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828424.851793:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828424.851800:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1787828424.851808:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787828424.851823:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb840 x1874670273049856/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828424.851845:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828424.851849:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787828424.851852:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828424.851860:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3588
00000100:00080000:0.0:1787828424.851870:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828424.851875:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828424.851882:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787828424.851900:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828424/real 1787828424]  req@ffff9ee0056e9e00 x1874670273049472/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828449 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787828424.851913:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb480 x1874670273049984/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828424.851937:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1787828424.851946:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9e00 x1874670273049472/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828449 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828424.851947:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787828424.851965:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828424.851987:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3588
00000100:00100000:3.0:1787828424.851987:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:1.0:1787828424.851991:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787828424.852001:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828424.852011:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828424.852017:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:1.0:1787828424.852033:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828424.852041:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273049472:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787828424.852056:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8000 x1874670273050112/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828424.852075:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828424.852080:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787828424.852083:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828424.852091:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3588
00000100:00080000:0.0:1787828424.852099:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1787828424.852100:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273049600:192.168.203.121@tcp:38:kworker.0
00000100:00080000:0.0:1787828424.852112:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828424.852121:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828424.852154:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e83c0 x1874670273050240/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1787828424.852161:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828424.852193:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828424/real 1787828424]  req@ffff9ee0056e8b40 x1874670273049600/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828449 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828424.852216:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8b40 x1874670273049600/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828449 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828424.852229:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828424.852233:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828424.852238:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273049600:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828424.852246:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273049728:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828424.852267:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828424.852280:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828424/real 1787828424]  req@ffff9ee0056e92c0 x1874670273049728/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828449 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828424.852390:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e92c0 x1874670273049728/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828449 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828424.852402:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828424.852406:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828424.852410:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273049728:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828424.852418:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273049856:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828424.852448:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828424.852462:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828424/real 1787828424]  req@ffff9ee0056eb840 x1874670273049856/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828449 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828424.852476:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb840 x1874670273049856/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828449 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828424.852486:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828424.852490:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828424.852493:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273049856:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828424.852505:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273049984:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787828424.852537:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828424.852558:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828424/real 1787828424]  req@ffff9ee0056eb480 x1874670273049984/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828449 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828424.852583:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb480 x1874670273049984/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828449 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828424.852608:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828424.852615:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828424.852622:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273049984:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828424.852630:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273050112:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828424.852658:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828424.852672:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828424/real 1787828424]  req@ffff9ee0056e8000 x1874670273050112/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828449 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828424.852686:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8000 x1874670273050112/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828449 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828424.852696:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828424.852700:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828424.852704:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273050112:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828424.852727:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273050240:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828424.852746:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828424.852757:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828424/real 1787828424]  req@ffff9ee0056e83c0 x1874670273050240/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828449 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828424.852771:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e83c0 x1874670273050240/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828449 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828424.852780:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828424.852784:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828424.852788:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273050240:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828425.683496:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828425.875504:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828426.707513:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828426.899450:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828427.731511:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828427.923425:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828428.755571:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828428.947420:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828429.779542:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1787828429.971463:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1787828429.971464:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:0.0:1787828429.971478:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1787828429.971484:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828429.971496:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3593
00000100:00080000:0.0:1787828429.971510:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828429.971521:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787828429.971567:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ebc00 x1874670273050368/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828429.971604:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828429.971608:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787828429.971610:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828429.971615:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3593
00000100:00080000:0.0:1787828429.971619:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828429.971623:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828429.971635:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787828429.971650:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8f00 x1874670273050496/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828429.971662:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828429.971667:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787828429.971669:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828429.971674:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3593
00000100:00080000:0.0:1787828429.971677:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1787828429.971684:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273050368:192.168.203.121@tcp:250:kworker.0
00000100:00080000:0.0:1787828429.971686:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828429.971700:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828429.971718:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e83c0 x1874670273050624/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828429.971732:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828429.971736:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787828429.971739:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828429.971744:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3593
00000100:00080000:0.0:1787828429.971762:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828429.971767:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828429.971774:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1787828429.971777:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787828429.971793:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8000 x1874670273050752/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828429.971806:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828429.971810:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787828429.971812:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828429.971817:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3593
00000100:00080000:0.0:1787828429.971822:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828429.971827:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828429.971833:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787828429.971836:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828429/real 1787828429]  req@ffff9ee0056ebc00 x1874670273050368/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828454 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787828429.971852:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb480 x1874670273050880/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828429.971869:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1787828429.971869:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ebc00 x1874670273050368/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828454 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828429.971877:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787828429.971883:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828429.971897:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3593
00000100:00080000:0.0:1787828429.971907:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828429.971909:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787828429.971915:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00080000:1.0:1787828429.971922:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000008:00100000:0.0:1787828429.971924:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787828429.971933:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273050368:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787828429.971943:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb840 x1874670273051008/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828429.971950:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273050496:192.168.203.121@tcp:38:kworker.0
00000100:00080000:0.0:1787828429.971972:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828429.971976:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787828429.971979:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828429.971984:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3593
00000100:00080000:0.0:1787828429.971987:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828429.971990:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828429.971996:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828429.972011:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e92c0 x1874670273051136/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1787828429.972026:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828429.972058:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828429/real 1787828429]  req@ffff9ee0056e8f00 x1874670273050496/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828454 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828429.972090:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8f00 x1874670273050496/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828454 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828429.972110:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828429.972119:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828429.972125:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273050496:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828429.972160:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273050624:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828429.972206:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828429.972231:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828429/real 1787828429]  req@ffff9ee0056e83c0 x1874670273050624/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828454 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828429.972254:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e83c0 x1874670273050624/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828454 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828429.972300:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828429.972306:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828429.972356:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273050624:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828429.972369:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273050752:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828429.972416:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828429.972441:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828429/real 1787828429]  req@ffff9ee0056e8000 x1874670273050752/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828454 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828429.972463:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8000 x1874670273050752/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828454 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828429.972476:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828429.972481:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828429.972486:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273050752:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828429.972496:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273050880:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787828429.972527:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828429.972547:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828429/real 1787828429]  req@ffff9ee0056eb480 x1874670273050880/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828454 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828429.972562:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb480 x1874670273050880/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828454 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828429.972576:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828429.972580:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828429.972586:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273050880:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828429.972595:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273051008:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828429.972615:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828429.972627:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828429/real 1787828429]  req@ffff9ee0056eb840 x1874670273051008/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828454 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828429.972639:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb840 x1874670273051008/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828454 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828429.972648:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828429.972651:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828429.972655:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273051008:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828429.972661:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273051136:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828429.972679:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828429.972691:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828429/real 1787828429]  req@ffff9ee0056e92c0 x1874670273051136/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828454 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828429.972705:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e92c0 x1874670273051136/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828454 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828429.972714:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828429.972717:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828429.972721:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273051136:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828430.803649:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828430.995417:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828431.827629:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828432.019424:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828432.851498:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828433.043492:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828433.875525:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828434.067443:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828434.899529:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828435.091396:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:0.0:1787828435.091404:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828435.091413:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1787828435.091417:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828435.091426:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3598
00000100:00080000:0.0:1787828435.091436:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828435.091445:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787828435.091482:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8b40 x1874670273051264/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828435.091506:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828435.091509:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787828435.091511:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828435.091514:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3598
00000100:00080000:0.0:1787828435.091518:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828435.091523:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828435.091532:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787828435.091541:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273051264:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787828435.091546:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9e00 x1874670273051392/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828435.091556:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828435.091559:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787828435.091560:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828435.091563:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3598
00000100:00080000:0.0:1787828435.091566:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828435.091569:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828435.091572:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828435.091581:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8780 x1874670273051520/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828435.091598:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828435.091600:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787828435.091602:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828435.091605:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3598
00000100:00080000:0.0:1787828435.091607:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828435.091609:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828435.091612:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1787828435.091615:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787828435.091626:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9680 x1874670273051648/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828435.091634:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828435.091636:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787828435.091638:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828435.091641:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3598
00000100:00080000:0.0:1787828435.091646:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828435.091649:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787828435.091660:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828435/real 1787828435]  req@ffff9ee0056e8b40 x1874670273051264/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828460 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:0.0:1787828435.091662:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787828435.091678:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8b40 x1874670273051264/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828460 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787828435.091683:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9a40 x1874670273051776/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787828435.091699:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787828435.091700:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828435.091706:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787828435.091706:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:0.0:1787828435.091711:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1787828435.091714:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273051264:192.168.203.121@tcp:250:kworker.0
00000100:00080000:0.0:1787828435.091717:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3598
00000100:00080000:0.0:1787828435.091723:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828435.091727:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828435.091730:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828435.091738:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ead00 x1874670273051904/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828435.091742:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273051392:192.168.203.121@tcp:38:kworker.0
00000100:00080000:0.0:1787828435.091755:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828435.091758:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787828435.091759:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828435.091762:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3598
00000100:00080000:0.0:1787828435.091765:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828435.091768:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828435.091772:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1787828435.091779:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787828435.091784:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ea580 x1874670273052032/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828435.091802:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828435/real 1787828435]  req@ffff9ee0056e9e00 x1874670273051392/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828460 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828435.091814:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9e00 x1874670273051392/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828460 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828435.091821:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828435.091823:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828435.091826:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273051392:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828435.091833:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273051520:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828435.091856:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828435.091871:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828435/real 1787828435]  req@ffff9ee0056e8780 x1874670273051520/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828460 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828435.091885:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8780 x1874670273051520/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828460 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828435.091892:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828435.091894:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828435.091897:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273051520:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828435.091901:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273051648:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828435.091916:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828435.091924:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828435/real 1787828435]  req@ffff9ee0056e9680 x1874670273051648/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828460 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828435.091932:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9680 x1874670273051648/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828460 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828435.091937:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828435.091939:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828435.091941:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273051648:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828435.091945:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273051776:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787828435.091955:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828435.091961:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828435/real 1787828435]  req@ffff9ee0056e9a40 x1874670273051776/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828460 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828435.091968:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9a40 x1874670273051776/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828460 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828435.091974:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828435.091976:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828435.091979:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273051776:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828435.091992:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273051904:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828435.092002:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828435.092019:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828435/real 1787828435]  req@ffff9ee0056ead00 x1874670273051904/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828460 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828435.092027:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ead00 x1874670273051904/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828460 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828435.092049:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828435.092051:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828435.092053:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273051904:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828435.092057:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273052032:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828435.092074:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828435.092086:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828435/real 1787828435]  req@ffff9ee0056ea580 x1874670273052032/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828460 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828435.092100:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ea580 x1874670273052032/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828460 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828435.092110:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828435.092113:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828435.092118:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273052032:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828435.923496:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828436.115400:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828436.947577:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828437.139427:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828437.971514:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828438.163450:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828438.995596:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828439.187426:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828440.019481:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1787828440.211391:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828440.211411:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00100000:2.0:1787828440.211416:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787828440.211416:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828440.211428:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3603
00000100:00080000:3.0:1787828440.211438:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828440.211444:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787828440.211486:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057070c0 x1874670273052160/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828440.211505:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828440.211508:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787828440.211509:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828440.211512:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3603
00000100:00080000:3.0:1787828440.211514:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828440.211517:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828440.211524:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787828440.211532:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706940 x1874670273052288/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828440.211540:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828440.211542:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787828440.211543:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828440.211546:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3603
00000100:00080000:3.0:1787828440.211549:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828440.211552:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828440.211556:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787828440.211561:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273052160:192.168.203.121@tcp:250:kworker.0
00000100:00100000:3.0:1787828440.211568:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057052c0 x1874670273052416/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828440.211576:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828440.211578:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787828440.211580:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828440.211582:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3603
00000100:00080000:3.0:1787828440.211584:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828440.211586:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828440.211589:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787828440.211597:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707480 x1874670273052544/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828440.211603:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828440.211606:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787828440.211608:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828440.211610:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3603
00000100:00080000:3.0:1787828440.211612:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828440.211616:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000800:00000100:1.0:1787828440.211620:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000008:00100000:3.0:1787828440.211624:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787828440.211639:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707840 x1874670273052672/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828440.211656:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828440/real 1787828440]  req@ffff9ee0057070c0 x1874670273052160/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828465 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828440.211668:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1787828440.211672:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057070c0 x1874670273052160/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828465 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828440.211676:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787828440.211682:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787828440.211687:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787828440.211706:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3603
00000100:00080000:1.0:1787828440.211715:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:3.0:1787828440.211718:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1787828440.211724:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273052160:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787828440.211734:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787828440.211743:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273052288:192.168.203.121@tcp:38:kworker.0
00000008:00100000:3.0:1787828440.211746:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787828440.211782:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057043c0 x1874670273052800/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1787828440.211790:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787828440.211791:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828440.211796:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787828440.211798:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828440.211803:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3603
00000100:00100000:1.0:1787828440.211804:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828440/real 1787828440]  req@ffff9ee005706940 x1874670273052288/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828465 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828440.211807:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828440.211814:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828440.211822:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787828440.211824:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706940 x1874670273052288/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828465 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787828440.211833:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706580 x1874670273052928/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787828440.211834:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828440.211843:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828440.211850:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273052288:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828440.211872:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273052416:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828440.211886:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828440.211894:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828440/real 1787828440]  req@ffff9ee0057052c0 x1874670273052416/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828465 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828440.211902:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057052c0 x1874670273052416/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828465 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828440.211907:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828440.211910:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828440.211912:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273052416:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828440.211915:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273052544:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828440.211924:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828440.211930:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828440/real 1787828440]  req@ffff9ee005707480 x1874670273052544/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828465 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828440.211937:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707480 x1874670273052544/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828465 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828440.211942:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828440.211944:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828440.211945:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273052544:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828440.211965:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273052672:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787828440.211986:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828440.211998:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828440/real 1787828440]  req@ffff9ee005707840 x1874670273052672/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828465 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828440.212011:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707840 x1874670273052672/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828465 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828440.212021:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828440.212025:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828440.212029:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273052672:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828440.212054:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273052800:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828440.212067:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828440.212075:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828440/real 1787828440]  req@ffff9ee0057043c0 x1874670273052800/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828465 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828440.212083:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057043c0 x1874670273052800/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828465 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828440.212089:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828440.212091:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828440.212094:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273052800:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828440.212098:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273052928:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828440.212138:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828440.212149:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828440/real 1787828440]  req@ffff9ee005706580 x1874670273052928/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828465 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828440.212162:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706580 x1874670273052928/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828465 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828440.212171:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828440.212174:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828440.212179:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273052928:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828441.043554:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828441.235505:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828442.067633:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828442.259505:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828443.091449:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828443.283395:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828444.115515:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828444.307446:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828445.139612:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828445.331423:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:2.0:1787828445.331433:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828445.331441:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787828445.331446:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828445.331474:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3609
00000100:00080000:2.0:1787828445.331486:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828445.331494:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787828445.331530:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572bc00 x1874670273053056/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828445.331568:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828445.331573:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787828445.331576:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828445.331581:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3609
00000100:00080000:2.0:1787828445.331587:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828445.331592:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828445.331604:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787828445.331622:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057292c0 x1874670273053184/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828445.331635:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828445.331639:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787828445.331642:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828445.331646:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3609
00000100:00080000:2.0:1787828445.331650:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828445.331656:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828445.331661:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828445.331694:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729680 x1874670273053312/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828445.331711:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273053056:192.168.203.121@tcp:250:kworker.0
00000100:00080000:2.0:1787828445.331715:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828445.331734:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787828445.331739:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828445.331745:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3609
00000100:00080000:2.0:1787828445.331747:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828445.331749:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828445.331752:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828445.331764:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728780 x1874670273053440/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828445.331770:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828445.331772:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787828445.331774:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828445.331776:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3609
00000100:00080000:2.0:1787828445.331779:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828445.331782:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828445.331786:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787828445.331793:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a940 x1874670273053568/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828445.331799:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828445.331803:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787828445.331804:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828445.331807:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3609
00000100:00080000:2.0:1787828445.331811:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828445.331814:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828445.331816:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828445.331823:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729e00 x1874670273053696/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828445.331828:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828445.331830:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787828445.331832:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828445.331834:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3609
00000100:00080000:2.0:1787828445.331836:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828445.331838:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828445.331840:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828445.331850:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a1c0 x1874670273053824/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1787828445.331856:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828445.331942:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828445/real 1787828445]  req@ffff9ee00572bc00 x1874670273053056/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828470 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828445.331974:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572bc00 x1874670273053056/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828470 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828445.331990:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828445.331996:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828445.332001:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273053056:192.168.203.121@tcp:250:kworker.0
00000100:00100000:1.0:1787828445.332012:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057292c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273053184:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787828445.332046:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828445.332062:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828445/real 1787828445]  req@ffff9ee0057292c0 x1874670273053184/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828470 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828445.332077:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057292c0 x1874670273053184/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828470 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828445.332087:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828445.332091:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828445.332095:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057292c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273053184:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828445.332131:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273053312:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828445.332184:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828445.332206:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828445/real 1787828445]  req@ffff9ee005729680 x1874670273053312/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828470 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828445.332230:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729680 x1874670273053312/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828470 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828445.332245:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828445.332252:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828445.332258:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273053312:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828445.332271:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273053440:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828445.332305:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828445.332380:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828445/real 1787828445]  req@ffff9ee005728780 x1874670273053440/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828470 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828445.332411:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728780 x1874670273053440/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828470 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828445.332422:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828445.332432:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828445.332437:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273053440:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828445.332446:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273053568:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787828445.332471:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828445.332483:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828445/real 1787828445]  req@ffff9ee00572a940 x1874670273053568/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828470 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828445.332497:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a940 x1874670273053568/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828470 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828445.332507:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828445.332511:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828445.332514:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273053568:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828445.332521:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273053696:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828445.332539:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828445.332549:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828445/real 1787828445]  req@ffff9ee005729e00 x1874670273053696/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828470 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828445.332565:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729e00 x1874670273053696/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828470 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828445.332581:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828445.332588:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828445.332594:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273053696:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828445.332607:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273053824:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828445.332643:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828445.332665:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828445/real 1787828445]  req@ffff9ee00572a1c0 x1874670273053824/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828470 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828445.332688:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a1c0 x1874670273053824/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828470 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828445.332702:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828445.332718:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828445.332724:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273053824:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828446.163588:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828446.355383:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828447.187459:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828447.379426:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828448.211489:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828448.403400:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828449.235524:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828449.427397:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828450.259529:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828450.451396:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:0.0:1787828450.451542:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828450.451554:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1787828450.451560:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828450.451574:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3614
00000100:00080000:0.0:1787828450.451590:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828450.451603:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787828450.451680:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ea940 x1874670273053952/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828450.451711:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828450.451715:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787828450.451717:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828450.451721:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3614
00000100:00080000:0.0:1787828450.451727:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828450.451734:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828450.451747:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787828450.451767:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb0c0 x1874670273054080/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828450.451786:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1787828450.451790:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273053952:192.168.203.121@tcp:250:kworker.0
00000100:00080000:0.0:1787828450.451796:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787828450.451802:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828450.451810:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3614
00000100:00080000:0.0:1787828450.451816:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828450.451820:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828450.451827:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828450.451842:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ea580 x1874670273054208/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828450.451854:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828450.451857:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787828450.451859:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828450.451866:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3614
00000100:00080000:0.0:1787828450.451870:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828450.451874:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828450.451879:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828450.451891:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ead00 x1874670273054336/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828450.451901:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828450.451904:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787828450.451907:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828450.451911:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3614
00000100:00080000:0.0:1787828450.451914:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828450.451918:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828450.451926:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787828450.451926:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273054080:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787828450.451948:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9a40 x1874670273054464/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828450.451969:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1787828450.451969:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273054208:192.168.203.121@tcp:8:kworker.0
00000100:00080000:0.0:1787828450.451985:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787828450.451989:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828450.451999:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3614
00000100:00100000:1.0:1787828450.452004:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273054336:192.168.203.121@tcp:8:kworker.0
00000100:00080000:0.0:1787828450.452011:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828450.452022:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828450.452031:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787828450.452038:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273054464:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787828450.452062:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9680 x1874670273054592/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828450.452093:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828450.452098:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787828450.452100:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828450.452106:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3614
00000100:00080000:0.0:1787828450.452136:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828450.452144:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828450.452153:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787828450.452153:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273054592:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787828450.452184:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8780 x1874670273054720/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828450.452227:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273054720:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828451.283602:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828451.475456:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828452.307596:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828452.499418:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828453.331584:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828453.523427:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000400:00000100:2.0:1787828453.523669:0:2354:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.203.121:988
00000400:00000100:2.0:1787828453.523726:0:2354:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.203.121@tcp at host 192.168.203.121 was unreachable: the network or that node may be down, or Lustre may be misconfigured.
00000800:00000100:2.0:1787828453.523750:0:2354:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:2.0:1787828453.523808:0:2354:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:2.0:1787828453.523820:0:2354:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:2.0:1787828453.523833:0:2354:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:2.0:1787828453.523849:0:2354:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:2.0:1787828453.523872:0:2354:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000100:00100000:1.0:1787828453.523884:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828450/real 1787828453]  req@ffff9ee0056e9a40 x1874670273054464/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828475 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000800:00000100:2.0:1787828453.523889:0:2354:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000100:00100000:1.0:1787828453.523931:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9a40 x1874670273054464/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828475 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828453.523944:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828453.523950:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828453.523955:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273054464:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828453.523964:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828450/real 1787828453]  req@ffff9ee0056eb0c0 x1874670273054080/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828475 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828453.523977:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb0c0 x1874670273054080/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828475 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828453.523994:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828453.523997:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828453.524001:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273054080:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828453.524009:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828450/real 1787828453]  req@ffff9ee0056ea580 x1874670273054208/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828475 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828453.524022:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ea580 x1874670273054208/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828475 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828453.524031:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828453.524034:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828453.524038:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273054208:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828453.524045:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828450/real 1787828453]  req@ffff9ee0056ead00 x1874670273054336/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828475 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828453.524057:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ead00 x1874670273054336/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828475 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828453.524066:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828453.524070:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828453.524073:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273054336:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828453.524081:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828450/real 1787828453]  req@ffff9ee0056ea940 x1874670273053952/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828475 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828453.524111:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ea940 x1874670273053952/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828475 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828453.524120:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828453.524125:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828453.524129:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273053952:192.168.203.121@tcp:250:kworker.0
00000100:00100000:1.0:1787828453.524162:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828450/real 1787828453]  req@ffff9ee0056e8780 x1874670273054720/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828475 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828453.524176:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8780 x1874670273054720/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828475 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828453.524186:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828453.524190:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828453.524193:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273054720:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828453.524200:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828450/real 1787828453]  req@ffff9ee0056e9680 x1874670273054592/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828475 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828453.524213:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9680 x1874670273054592/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828475 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828453.524221:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828453.524225:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828453.524229:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273054592:192.168.203.121@tcp:8:kworker.0
00010000:00010000:3.0:1787828454.355503:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828454.547417:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828455.379513:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828455.571432:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:2.0:1787828455.571648:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828455.571662:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787828455.571668:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828455.571684:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3619
00000100:00080000:2.0:1787828455.571700:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828455.571712:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787828455.571780:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057283c0 x1874670273054848/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828455.571862:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828455.571871:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787828455.571875:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828455.571884:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3619
00000100:00080000:2.0:1787828455.571892:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828455.571901:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828455.571920:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787828455.571947:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728000 x1874670273054976/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828455.571982:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828455.571988:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787828455.571992:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828455.572001:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3619
00000100:00080000:2.0:1787828455.572013:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828455.572037:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787828455.572047:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273054848:192.168.203.121@tcp:250:kworker.0
00000008:00100000:2.0:1787828455.572055:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828455.572125:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a580 x1874670273055104/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828455.572149:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828455.572156:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787828455.572159:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828455.572167:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3619
00000100:00080000:2.0:1787828455.572178:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000800:00000100:1.0:1787828455.572179:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:2.0:1787828455.572196:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828455.572210:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787828455.572251:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828455/real 1787828455]  req@ffff9ee0057283c0 x1874670273054848/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828480 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828455.572253:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728b40 x1874670273055232/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828455.572299:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828455.572312:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00100000:1.0:1787828455.572378:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057283c0 x1874670273054848/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828480 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828455.572404:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828455.572406:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787828455.572425:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:2.0:1787828455.572431:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3619
00000100:00100000:1.0:1787828455.572442:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273054848:192.168.203.121@tcp:250:kworker.0
00000100:00080000:2.0:1787828455.572446:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828455.572466:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787828455.572469:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273054976:192.168.203.121@tcp:38:kworker.0
00000008:00100000:2.0:1787828455.572483:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787828455.572519:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728f00 x1874670273055360/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1787828455.572530:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:2.0:1787828455.572554:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1787828455.572559:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828455/real 1787828455]  req@ffff9ee005728000 x1874670273054976/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828480 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828455.572566:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787828455.572571:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828455.572596:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3619
00000100:00100000:1.0:1787828455.572621:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728000 x1874670273054976/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828480 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828455.572626:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828455.572644:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828455.572645:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00080000:1.0:1787828455.572665:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000008:00100000:2.0:1787828455.572667:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787828455.572681:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273054976:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787828455.572705:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b840 x1874670273055488/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828455.572727:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273055104:192.168.203.121@tcp:8:kworker.0
00000100:00080000:2.0:1787828455.572732:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828455.572743:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787828455.572748:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828455.572761:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3619
00000100:00080000:2.0:1787828455.572772:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000800:00000100:1.0:1787828455.572776:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:2.0:1787828455.572796:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828455.572810:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787828455.572813:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828455/real 1787828455]  req@ffff9ee00572a580 x1874670273055104/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828480 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828455.572847:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729a40 x1874670273055616/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828455.572849:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a580 x1874670273055104/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828480 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828455.572943:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828455.572952:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828455.572957:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273055104:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828455.572970:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273055232:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828455.573013:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828455.573028:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828455/real 1787828455]  req@ffff9ee005728b40 x1874670273055232/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828480 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828455.573040:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728b40 x1874670273055232/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828480 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828455.573047:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828455.573051:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828455.573055:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273055232:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828455.573064:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273055360:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787828455.573110:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828455.573129:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828455/real 1787828455]  req@ffff9ee005728f00 x1874670273055360/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828480 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828455.573144:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728f00 x1874670273055360/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828480 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828455.573154:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828455.573156:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828455.573160:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273055360:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828455.573186:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273055488:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828455.573213:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828455.573227:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828455/real 1787828455]  req@ffff9ee00572b840 x1874670273055488/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828480 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828455.573242:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b840 x1874670273055488/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828480 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828455.573251:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828455.573258:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828455.573261:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273055488:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828455.573283:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273055616:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828455.573302:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828455.573311:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828455/real 1787828455]  req@ffff9ee005729a40 x1874670273055616/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828480 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828455.573320:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729a40 x1874670273055616/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828480 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828455.573325:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828455.573328:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828455.573358:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273055616:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828456.403594:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828456.595408:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828457.427656:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828457.619544:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828458.451513:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828458.643407:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828459.475508:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787828459.667420:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828460.499474:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787828460.691407:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787828460.691459:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828460.691465:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787828460.691468:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828460.691475:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3624
00000100:00080000:3.0:1787828460.691484:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828460.691490:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787828460.691520:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704780 x1874670273055744/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828460.691543:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828460.691545:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787828460.691547:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828460.691549:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3624
00000100:00080000:3.0:1787828460.691552:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828460.691555:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828460.691563:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787828460.691570:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705a40 x1874670273055872/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828460.691578:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828460.691580:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787828460.691581:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828460.691584:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3624
00000100:00080000:3.0:1787828460.691586:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828460.691588:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828460.691593:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787828460.691598:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273055744:192.168.203.121@tcp:250:kworker.0
00000100:00100000:3.0:1787828460.691603:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705e00 x1874670273056000/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828460.691610:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828460.691612:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787828460.691613:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828460.691616:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3624
00000100:00080000:3.0:1787828460.691618:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828460.691620:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828460.691623:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787828460.691630:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704b40 x1874670273056128/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828460.691641:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828460.691643:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787828460.691644:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828460.691647:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3624
00000100:00080000:3.0:1787828460.691649:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828460.691651:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828460.691654:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000800:00000100:1.0:1787828460.691657:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787828460.691666:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706580 x1874670273056256/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828460.691673:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828460.691675:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787828460.691677:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828460.691679:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3624
00000100:00080000:3.0:1787828460.691682:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828460.691684:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828460.691687:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787828460.691695:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828460/real 1787828460]  req@ffff9ee005704780 x1874670273055744/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828485 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787828460.691697:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057043c0 x1874670273056384/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828460.691728:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828460.691731:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787828460.691733:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828460.691736:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3624
00000100:00100000:1.0:1787828460.691740:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704780 x1874670273055744/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828485 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828460.691740:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828460.691747:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828460.691753:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:1.0:1787828460.691759:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:3.0:1787828460.691763:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707840 x1874670273056512/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787828460.691767:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828460.691774:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273055744:192.168.203.121@tcp:250:kworker.0
00000100:00100000:1.0:1787828460.691782:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273055872:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787828460.691799:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828460.691809:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828460/real 1787828460]  req@ffff9ee005705a40 x1874670273055872/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828485 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828460.691817:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705a40 x1874670273055872/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828485 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828460.691822:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828460.691825:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828460.691827:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273055872:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828460.691844:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273056000:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828460.691855:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828460.691862:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828460/real 1787828460]  req@ffff9ee005705e00 x1874670273056000/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828485 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828460.691869:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705e00 x1874670273056000/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828485 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828460.691879:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828460.691881:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828460.691883:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273056000:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828460.691886:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273056128:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828460.691895:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828460.691900:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828460/real 1787828460]  req@ffff9ee005704b40 x1874670273056128/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828485 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828460.691907:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704b40 x1874670273056128/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828485 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828460.691912:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828460.691913:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828460.691915:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273056128:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828460.691918:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273056256:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787828460.691927:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828460.691932:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828460/real 1787828460]  req@ffff9ee005706580 x1874670273056256/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828485 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828460.691938:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706580 x1874670273056256/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828485 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828460.691943:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828460.691945:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828460.691947:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273056256:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828460.691951:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273056384:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828460.691961:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828460.691966:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828460/real 1787828460]  req@ffff9ee0057043c0 x1874670273056384/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828485 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828460.691973:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057043c0 x1874670273056384/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828485 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828460.691977:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828460.691979:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828460.691981:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273056384:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828460.691984:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273056512:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828460.691992:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828460.691997:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828460/real 1787828460]  req@ffff9ee005707840 x1874670273056512/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828485 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828460.692004:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707840 x1874670273056512/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828485 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828460.692008:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828460.692010:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828460.692011:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273056512:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828461.523458:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787828461.715414:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828462.547493:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787828462.739435:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828463.571483:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787828463.763420:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828464.595657:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787828464.787511:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828465.619606:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828465.811451:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787828465.811572:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828465.811581:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787828465.811587:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828465.811607:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3629
00000100:00080000:3.0:1787828465.811651:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828465.811665:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787828465.811748:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707480 x1874670273056640/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828465.811792:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828465.811798:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787828465.811806:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828465.811813:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3629
00000100:00080000:3.0:1787828465.811835:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1787828465.811848:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273056640:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787828465.811865:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000800:00000100:1.0:1787828465.811931:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000008:00100000:3.0:1787828465.811973:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787828465.811991:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828465/real 1787828465]  req@ffff9ee005707480 x1874670273056640/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828490 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828465.812029:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707480 x1874670273056640/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828490 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828465.812040:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828465.812044:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828465.812048:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273056640:192.168.203.121@tcp:250:kworker.0
00000100:00100000:3.0:1787828465.812276:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057052c0 x1874670273056768/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828465.812297:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828465.812301:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787828465.812303:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828465.812306:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3629
00000100:00080000:3.0:1787828465.812311:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828465.812342:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828465.812350:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787828465.812364:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273056768:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787828465.812366:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706940 x1874670273056896/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828465.812384:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828465.812388:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787828465.812391:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828465.812396:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3629
00000100:00080000:3.0:1787828465.812400:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828465.812406:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000800:00000100:1.0:1787828465.812407:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000008:00100000:3.0:1787828465.812413:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787828465.812429:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057070c0 x1874670273057024/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828465.812430:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828465/real 1787828465]  req@ffff9ee0057052c0 x1874670273056768/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828490 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828465.812458:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828465.812460:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787828465.812462:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828465.812470:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3629
00000100:00080000:3.0:1787828465.812475:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1787828465.812478:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057052c0 x1874670273056768/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828490 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828465.812483:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828465.812494:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00080000:1.0:1787828465.812498:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828465.812505:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787828465.812507:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704000 x1874670273057152/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828465.812512:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273056768:192.168.203.121@tcp:38:kworker.0
00000100:00080000:3.0:1787828465.812528:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828465.812532:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787828465.812534:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1787828465.812537:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273056896:192.168.203.121@tcp:8:kworker.0
00000100:00080000:3.0:1787828465.812542:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3629
00000100:00080000:3.0:1787828465.812546:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828465.812550:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828465.812554:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1787828465.812567:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787828465.812569:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706d00 x1874670273057280/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828465.812582:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828465/real 1787828465]  req@ffff9ee005706940 x1874670273056896/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828490 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828465.812582:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828465.812592:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787828465.812596:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828465.812605:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3629
00000100:00080000:3.0:1787828465.812610:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1787828465.812611:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706940 x1874670273056896/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828490 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828465.812616:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828465.812625:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:1.0:1787828465.812638:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:3.0:1787828465.812639:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705680 x1874670273057408/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787828465.812648:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828465.812658:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273056896:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828465.812673:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273057024:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828465.812691:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828465.812701:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828465/real 1787828465]  req@ffff9ee0057070c0 x1874670273057024/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828490 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828465.812710:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057070c0 x1874670273057024/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828490 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828465.812716:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828465.812718:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828465.812721:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273057024:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828465.812726:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273057152:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787828465.812746:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828465.812760:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828465/real 1787828465]  req@ffff9ee005704000 x1874670273057152/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828490 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828465.812777:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704000 x1874670273057152/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828490 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828465.812788:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828465.812792:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828465.812797:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273057152:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828465.812818:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273057280:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828465.812844:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828465.812858:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828465/real 1787828465]  req@ffff9ee005706d00 x1874670273057280/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828490 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828465.812868:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706d00 x1874670273057280/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828490 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828465.812875:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828465.812878:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828465.812881:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273057280:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828465.812885:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273057408:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828465.812901:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828465.812909:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828465/real 1787828465]  req@ffff9ee005705680 x1874670273057408/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828490 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828465.812918:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705680 x1874670273057408/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828490 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828465.812924:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828465.812926:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828465.812928:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273057408:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828466.643492:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828466.835490:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828467.667500:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828467.859407:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828468.691486:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828468.883483:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828469.715579:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828469.907455:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828470.739513:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828470.931452:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:0.0:1787828470.931468:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828470.931477:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1787828470.931482:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828470.931494:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3634
00000100:00080000:0.0:1787828470.931507:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828470.931516:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787828470.931559:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9e00 x1874670273057536/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828470.931593:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828470.931597:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787828470.931599:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828470.931603:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3634
00000100:00080000:0.0:1787828470.931607:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828470.931611:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828470.931623:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787828470.931644:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8b40 x1874670273057664/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828470.931666:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273057536:192.168.203.121@tcp:250:kworker.0
00000100:00080000:0.0:1787828470.931686:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828470.931693:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787828470.931698:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828470.931731:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3634
00000100:00080000:0.0:1787828470.931736:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828470.931741:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828470.931748:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828470.931760:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e92c0 x1874670273057792/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1787828470.931769:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:0.0:1787828470.931772:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828470.931776:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787828470.931778:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828470.931783:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3634
00000100:00080000:0.0:1787828470.931808:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828470.931812:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828470.931816:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787828470.931844:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828470/real 1787828470]  req@ffff9ee0056e9e00 x1874670273057536/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828495 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787828470.931852:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb840 x1874670273057920/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828470.931891:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828470.931895:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00100000:1.0:1787828470.931900:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9e00 x1874670273057536/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828495 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828470.931901:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828470.931915:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3634
00000100:00080000:0.0:1787828470.931925:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828470.931932:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787828470.931933:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828470.931948:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00080000:1.0:1787828470.931949:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828470.931963:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273057536:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787828470.931966:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb480 x1874670273058048/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828470.932018:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828470.932021:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787828470.932023:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828470.932027:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3634
00000100:00080000:0.0:1787828470.932040:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828470.932044:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828470.932048:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787828470.932051:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273057664:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787828470.932060:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8000 x1874670273058176/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828470.932068:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828470.932072:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787828470.932073:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828470.932076:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3634
00000100:00080000:0.0:1787828470.932080:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828470.932083:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000800:00000100:1.0:1787828470.932088:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000008:00100000:0.0:1787828470.932090:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828470.932102:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e83c0 x1874670273058304/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828470.932106:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828470/real 1787828470]  req@ffff9ee0056e8b40 x1874670273057664/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828495 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828470.932139:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8b40 x1874670273057664/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828495 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828470.932147:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828470.932150:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828470.932154:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273057664:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828470.932159:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273057792:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828470.932176:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828470.932183:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828470/real 1787828470]  req@ffff9ee0056e92c0 x1874670273057792/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828495 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828470.932192:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e92c0 x1874670273057792/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828495 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828470.932203:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828470.932206:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828470.932208:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273057792:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828470.932212:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273057920:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828470.932222:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828470.932229:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828470/real 1787828470]  req@ffff9ee0056eb840 x1874670273057920/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828495 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828470.932236:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb840 x1874670273057920/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828495 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828470.932242:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828470.932244:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828470.932246:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273057920:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828470.932250:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273058048:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787828470.932260:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828470.932266:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828470/real 1787828470]  req@ffff9ee0056eb480 x1874670273058048/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828495 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828470.932273:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb480 x1874670273058048/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828495 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828470.932279:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828470.932281:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828470.932301:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273058048:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828470.932321:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273058176:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828470.932399:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828470.932421:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828470/real 1787828470]  req@ffff9ee0056e8000 x1874670273058176/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828495 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828470.932444:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8000 x1874670273058176/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828495 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828470.932460:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828470.932466:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828470.932473:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273058176:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828470.932485:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273058304:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828470.932512:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828470.932526:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828470/real 1787828470]  req@ffff9ee0056e83c0 x1874670273058304/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828495 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828470.932539:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e83c0 x1874670273058304/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828495 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828470.932549:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828470.932553:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828470.932559:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273058304:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828471.763521:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828471.955415:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828472.787525:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828472.979494:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828473.811502:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828474.003424:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828474.835496:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828475.027535:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828475.859563:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828476.051459:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:0.0:1787828476.051495:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828476.051509:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1787828476.051517:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828476.051534:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3639
00000100:00080000:0.0:1787828476.051567:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828476.051577:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787828476.051617:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8f00 x1874670273058432/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828476.051647:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828476.051651:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787828476.051653:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828476.051656:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3639
00000100:00080000:0.0:1787828476.051660:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828476.051663:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828476.051674:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787828476.051703:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ebc00 x1874670273058560/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828476.051721:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1787828476.051722:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273058432:192.168.203.121@tcp:250:kworker.0
00000100:00080000:0.0:1787828476.051736:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787828476.051742:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828476.051748:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3639
00000100:00080000:0.0:1787828476.051753:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828476.051759:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828476.051766:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828476.051783:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e83c0 x1874670273058688/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828476.051795:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828476.051799:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787828476.051802:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828476.051806:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3639
00000100:00080000:0.0:1787828476.051823:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828476.051832:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000800:00000100:1.0:1787828476.051833:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000008:00100000:0.0:1787828476.051841:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828476.051860:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8000 x1874670273058816/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828476.051873:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828476.051877:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787828476.051879:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828476.051885:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3639
00000100:00080000:0.0:1787828476.051891:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1787828476.051897:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828476/real 1787828476]  req@ffff9ee0056e8f00 x1874670273058432/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828501 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828476.051902:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828476.051915:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787828476.051978:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb480 x1874670273058944/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828476.051990:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8f00 x1874670273058432/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828501 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828476.052009:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828476.052020:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787828476.052042:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787828476.052051:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787828476.052052:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3639
00000100:00080000:0.0:1787828476.052063:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828476.052072:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:0.0:1787828476.052073:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828476.052085:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787828476.052091:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273058432:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787828476.052108:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb840 x1874670273059072/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828476.052122:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828476.052127:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787828476.052130:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1787828476.052135:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273058560:192.168.203.121@tcp:38:kworker.0
00000100:00080000:0.0:1787828476.052141:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3639
00000100:00080000:0.0:1787828476.052151:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828476.052154:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828476.052160:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828476.052196:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e92c0 x1874670273059200/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1787828476.052210:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828476.052229:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828476/real 1787828476]  req@ffff9ee0056ebc00 x1874670273058560/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828501 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828476.052264:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ebc00 x1874670273058560/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828501 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828476.052277:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828476.052282:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828476.052286:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273058560:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828476.052294:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273058688:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828476.052318:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828476.052392:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828476/real 1787828476]  req@ffff9ee0056e83c0 x1874670273058688/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828501 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828476.052425:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e83c0 x1874670273058688/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828501 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828476.052462:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828476.052467:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828476.052472:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273058688:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828476.052480:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273058816:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828476.052512:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828476.052527:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828476/real 1787828476]  req@ffff9ee0056e8000 x1874670273058816/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828501 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828476.052559:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8000 x1874670273058816/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828501 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828476.052567:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828476.052570:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828476.052573:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273058816:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828476.052578:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273058944:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787828476.052594:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828476.052602:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828476/real 1787828476]  req@ffff9ee0056eb480 x1874670273058944/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828501 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828476.052612:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb480 x1874670273058944/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828501 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828476.052619:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828476.052622:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828476.052625:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273058944:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828476.052630:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273059072:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828476.052644:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828476.052652:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828476/real 1787828476]  req@ffff9ee0056eb840 x1874670273059072/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828501 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828476.052662:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb840 x1874670273059072/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828501 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828476.052689:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828476.052693:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828476.052696:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273059072:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828476.052721:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273059200:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828476.052742:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828476.052754:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828476/real 1787828476]  req@ffff9ee0056e92c0 x1874670273059200/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828501 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828476.052767:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e92c0 x1874670273059200/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828501 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828476.052776:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828476.052779:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828476.052783:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273059200:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828476.883562:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828477.075469:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828477.907630:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828478.099461:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828478.931606:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828479.123431:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828479.955690:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787828480.147511:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828480.979523:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1787828481.171422:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828481.171433:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00100000:3.0:1787828481.171437:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:0.0:1787828481.171440:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828481.171454:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3644
00000100:00080000:0.0:1787828481.171467:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828481.171476:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787828481.171522:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8b40 x1874670273059328/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828481.171544:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828481.171548:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787828481.171549:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828481.171568:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3644
00000100:00080000:0.0:1787828481.171571:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828481.171574:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828481.171585:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787828481.171595:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273059328:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787828481.171597:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9e00 x1874670273059456/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828481.171610:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828481.171612:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787828481.171614:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828481.171616:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3644
00000100:00080000:0.0:1787828481.171619:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828481.171621:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828481.171625:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828481.171632:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9680 x1874670273059584/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828481.171644:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828481.171647:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787828481.171648:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828481.171650:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3644
00000100:00080000:0.0:1787828481.171661:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828481.171664:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828481.171667:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1787828481.171673:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787828481.171677:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8780 x1874670273059712/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828481.171686:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828481.171688:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787828481.171690:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828481.171693:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3644
00000100:00080000:0.0:1787828481.171699:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828481.171702:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828481.171705:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787828481.171715:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ea940 x1874670273059840/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828481.171722:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828481/real 1787828481]  req@ffff9ee0056e8b40 x1874670273059328/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828506 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828481.171724:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828481.171730:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787828481.171750:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828481.171757:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3644
00000100:00080000:0.0:1787828481.171762:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828481.171766:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787828481.171770:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8b40 x1874670273059328/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828506 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:0.0:1787828481.171772:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828481.171788:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ead00 x1874670273059968/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787828481.171788:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828481.171797:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828481.171806:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273059328:192.168.203.121@tcp:250:kworker.0
00000100:00080000:0.0:1787828481.171807:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828481.171816:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787828481.171826:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828481.171830:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3644
00000100:00080000:0.0:1787828481.171833:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828481.171836:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828481.171839:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828481.171845:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ea580 x1874670273060096/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828481.171852:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273059456:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787828481.171878:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828481.171888:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828481/real 1787828481]  req@ffff9ee0056e9e00 x1874670273059456/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828506 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828481.171898:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9e00 x1874670273059456/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828506 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828481.171929:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828481.171932:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828481.171935:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273059456:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828481.171940:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273059584:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828481.171997:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828481.172013:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828481/real 1787828481]  req@ffff9ee0056e9680 x1874670273059584/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828506 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828481.172025:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9680 x1874670273059584/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828506 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828481.172039:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828481.172042:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828481.172045:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273059584:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828481.172050:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273059712:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828481.172066:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828481.172074:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828481/real 1787828481]  req@ffff9ee0056e8780 x1874670273059712/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828506 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828481.172085:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8780 x1874670273059712/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828506 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828481.172107:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828481.172109:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828481.172111:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273059712:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828481.172114:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273059840:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787828481.172126:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828481.172132:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828481/real 1787828481]  req@ffff9ee0056ea940 x1874670273059840/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828506 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828481.172140:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ea940 x1874670273059840/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828506 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828481.172144:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828481.172146:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828481.172149:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273059840:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828481.172153:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273059968:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828481.172163:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828481.172168:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828481/real 1787828481]  req@ffff9ee0056ead00 x1874670273059968/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828506 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828481.172175:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ead00 x1874670273059968/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828506 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828481.172180:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828481.172182:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828481.172183:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273059968:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828481.172197:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273060096:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828481.172207:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828481.172213:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828481/real 1787828481]  req@ffff9ee0056ea580 x1874670273060096/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828506 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828481.172219:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ea580 x1874670273060096/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828506 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828481.172224:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828481.172226:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828481.172228:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273060096:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828482.003567:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828482.195384:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828483.027541:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828483.219381:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828484.051487:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828484.243382:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828485.075488:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828485.267378:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828486.099628:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828486.291371:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:2.0:1787828486.292401:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828486.292407:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787828486.292412:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828486.292423:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3650
00000100:00080000:2.0:1787828486.292437:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828486.292452:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787828486.292507:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572ad00 x1874670273060224/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828486.292533:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828486.292536:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787828486.292538:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828486.292542:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3650
00000100:00080000:2.0:1787828486.292545:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828486.292549:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828486.292560:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787828486.292570:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b480 x1874670273060352/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828486.292580:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828486.292584:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787828486.292586:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1787828486.292587:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273060224:192.168.203.121@tcp:250:kworker.0
00000100:00080000:2.0:1787828486.292590:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3650
00000100:00080000:2.0:1787828486.292596:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828486.292600:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828486.292604:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828486.292613:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b0c0 x1874670273060480/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828486.292621:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828486.292623:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787828486.292624:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828486.292627:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3650
00000100:00080000:2.0:1787828486.292629:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828486.292631:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828486.292634:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828486.292641:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729a40 x1874670273060608/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828486.292648:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828486.292651:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787828486.292652:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828486.292655:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3650
00000100:00080000:2.0:1787828486.292658:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828486.292661:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828486.292664:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787828486.292670:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b840 x1874670273060736/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828486.292681:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828486.292686:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000800:00000100:1.0:1787828486.292687:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:2.0:1787828486.292688:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828486.292695:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3650
00000100:00080000:2.0:1787828486.292698:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828486.292701:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828486.292704:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828486.292712:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728f00 x1874670273060864/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828486.292718:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828486.292721:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787828486.292723:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828486.292726:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3650
00000100:00080000:2.0:1787828486.292728:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828486.292731:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828486.292734:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787828486.292740:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828486/real 1787828486]  req@ffff9ee00572ad00 x1874670273060224/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828511 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828486.292744:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728b40 x1874670273060992/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828486.292782:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572ad00 x1874670273060224/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828511 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828486.292793:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828486.292797:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828486.292800:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273060224:192.168.203.121@tcp:250:kworker.0
00000100:00100000:1.0:1787828486.292829:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273060352:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787828486.292848:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828486.292858:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828486/real 1787828486]  req@ffff9ee00572b480 x1874670273060352/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828511 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828486.292883:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b480 x1874670273060352/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828511 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828486.292890:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828486.292893:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828486.292896:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273060352:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828486.292917:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273060480:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828486.292936:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828486.292944:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828486/real 1787828486]  req@ffff9ee00572b0c0 x1874670273060480/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828511 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828486.292953:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b0c0 x1874670273060480/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828511 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828486.292964:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828486.292966:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828486.292969:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273060480:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828486.292973:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273060608:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828486.292984:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828486.292990:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828486/real 1787828486]  req@ffff9ee005729a40 x1874670273060608/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828511 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828486.292998:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729a40 x1874670273060608/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828511 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828486.293003:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828486.293005:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828486.293007:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273060608:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828486.293011:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273060736:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787828486.293022:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828486.293029:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828486/real 1787828486]  req@ffff9ee00572b840 x1874670273060736/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828511 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828486.293036:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b840 x1874670273060736/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828511 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828486.293041:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828486.293043:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828486.293046:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273060736:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828486.293050:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273060864:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828486.293061:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828486.293067:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828486/real 1787828486]  req@ffff9ee005728f00 x1874670273060864/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828511 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828486.293074:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728f00 x1874670273060864/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828511 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828486.293080:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828486.293082:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828486.293084:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273060864:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828486.293087:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273060992:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828486.293097:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828486.293102:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828486/real 1787828486]  req@ffff9ee005728b40 x1874670273060992/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828511 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828486.293109:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728b40 x1874670273060992/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828511 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828486.293114:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828486.293116:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828486.293119:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273060992:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828487.123513:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828487.315415:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828488.147586:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828488.339393:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828489.171590:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828489.363456:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828490.195520:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828490.387475:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828491.219500:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828491.411426:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:2.0:1787828491.411490:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828491.411503:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787828491.411509:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828491.411541:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3655
00000100:00080000:2.0:1787828491.411557:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828491.411567:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787828491.411626:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a580 x1874670273061120/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828491.411689:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828491.411693:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787828491.411695:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828491.411698:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3655
00000100:00080000:2.0:1787828491.411701:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828491.411704:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828491.411716:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787828491.411727:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728000 x1874670273061248/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828491.411736:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828491.411740:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787828491.411751:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828491.411754:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3655
00000100:00080000:2.0:1787828491.411757:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828491.411760:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828491.411765:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828491.411776:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057283c0 x1874670273061376/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828491.411794:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828491.411798:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787828491.411800:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828491.411804:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3655
00000100:00080000:2.0:1787828491.411807:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828491.411818:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787828491.411820:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273061120:192.168.203.121@tcp:250:kworker.0
00000008:00100000:2.0:1787828491.411824:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828491.411869:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a1c0 x1874670273061504/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828491.411878:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828491.411881:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787828491.411883:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828491.411887:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3655
00000100:00080000:2.0:1787828491.411891:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828491.411894:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828491.411899:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787828491.411913:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729e00 x1874670273061632/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828491.411921:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828491.411924:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787828491.411925:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828491.411928:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3655
00000100:00080000:2.0:1787828491.411932:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828491.411935:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828491.411941:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1787828491.411944:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828491.411957:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a940 x1874670273061760/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828491.411968:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828491.411971:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787828491.411972:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828491.411977:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3655
00000100:00080000:2.0:1787828491.411982:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828491.411985:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828491.411990:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787828491.411996:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828491/real 1787828491]  req@ffff9ee00572a580 x1874670273061120/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828516 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828491.412004:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728780 x1874670273061888/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828491.412036:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a580 x1874670273061120/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828516 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828491.412071:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828491.412077:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828491.412083:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273061120:192.168.203.121@tcp:250:kworker.0
00000100:00100000:1.0:1787828491.412091:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273061248:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787828491.412109:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828491.412118:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828491/real 1787828491]  req@ffff9ee005728000 x1874670273061248/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828516 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828491.412126:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728000 x1874670273061248/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828516 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828491.412131:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828491.412133:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828491.412135:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273061248:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828491.412155:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273061376:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828491.412167:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828491.412173:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828491/real 1787828491]  req@ffff9ee0057283c0 x1874670273061376/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828516 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828491.412180:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057283c0 x1874670273061376/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828516 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828491.412190:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828491.412192:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828491.412194:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273061376:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828491.412197:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273061504:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828491.412206:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828491.412212:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828491/real 1787828491]  req@ffff9ee00572a1c0 x1874670273061504/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828516 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828491.412219:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a1c0 x1874670273061504/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828516 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828491.412224:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828491.412226:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828491.412228:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273061504:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828491.412231:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273061632:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787828491.412241:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828491.412246:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828491/real 1787828491]  req@ffff9ee005729e00 x1874670273061632/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828516 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828491.412253:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729e00 x1874670273061632/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828516 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828491.412257:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828491.412260:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828491.412262:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273061632:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828491.412266:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273061760:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828491.412276:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828491.412282:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828491/real 1787828491]  req@ffff9ee00572a940 x1874670273061760/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828516 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828491.412288:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a940 x1874670273061760/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828516 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828491.412293:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828491.412295:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828491.412297:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273061760:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828491.412300:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273061888:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828491.412309:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828491.412315:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828491/real 1787828491]  req@ffff9ee005728780 x1874670273061888/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828516 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828491.412321:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728780 x1874670273061888/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828516 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828491.412326:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828491.412328:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828491.412355:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273061888:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828492.243509:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828492.435393:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828493.267573:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828493.459457:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828494.291571:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828494.483470:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828495.315531:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828495.507397:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828496.339554:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828496.531527:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:1.0:1787828496.531548:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828496.531566:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1787828496.531576:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787828496.531593:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3660
00000100:00080000:1.0:1787828496.531612:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828496.531626:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787828496.531677:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a30c0 x1874670273062016/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787828496.531733:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828496.531738:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787828496.531741:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787828496.531746:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3660
00000100:00080000:1.0:1787828496.531751:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828496.531757:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787828496.531771:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787828496.531790:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0000 x1874670273062144/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787828496.531849:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828496.531858:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00100000:2.0:1787828496.531862:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273062016:192.168.203.121@tcp:250:kworker.0
00000100:00080000:1.0:1787828496.531863:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787828496.531875:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3660
00000100:00080000:1.0:1787828496.531890:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828496.531898:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787828496.531906:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787828496.531925:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0780 x1874670273062272/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787828496.531948:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828496.531953:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787828496.531956:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787828496.531971:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3660
00000100:00080000:1.0:1787828496.531975:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828496.531979:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787828496.531986:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787828496.532010:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a3480 x1874670273062400/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787828496.532022:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828496.532033:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000800:00000100:2.0:1787828496.532036:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:1.0:1787828496.532037:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787828496.532050:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3660
00000100:00080000:1.0:1787828496.532055:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828496.532062:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787828496.532067:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787828496.532082:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a2580 x1874670273062528/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787828496.532094:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828496.532099:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787828496.532104:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787828496.532109:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3660
00000100:00080000:1.0:1787828496.532116:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828496.532123:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787828496.532131:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828496.532135:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828496/real 1787828496]  req@ffff9ee0056a30c0 x1874670273062016/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828521 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828496.532150:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0b40 x1874670273062656/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787828496.532174:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1787828496.532183:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a30c0 x1874670273062016/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828521 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828496.532184:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787828496.532193:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787828496.532216:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3660
00000100:00080000:1.0:1787828496.532243:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828496.532249:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828496.532258:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787828496.532278:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:2.0:1787828496.532287:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828496.532298:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273062016:192.168.203.121@tcp:250:kworker.0
00000100:00100000:1.0:1787828496.532304:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1e00 x1874670273062784/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787828496.532432:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273062144:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787828496.532490:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828496.532509:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828496/real 1787828496]  req@ffff9ee0056a0000 x1874670273062144/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828521 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828496.532522:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0000 x1874670273062144/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828521 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828496.532531:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828496.532535:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828496.532556:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273062144:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787828496.532565:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273062272:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787828496.532592:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828496.532606:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828496/real 1787828496]  req@ffff9ee0056a0780 x1874670273062272/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828521 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828496.532621:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0780 x1874670273062272/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828521 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828496.532631:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828496.532634:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828496.532638:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273062272:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787828496.532645:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273062400:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787828496.532696:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828496.532706:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828496/real 1787828496]  req@ffff9ee0056a3480 x1874670273062400/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828521 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828496.532717:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a3480 x1874670273062400/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828521 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828496.532725:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828496.532729:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828496.532732:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273062400:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787828496.532738:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273062528:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787828496.532753:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828496.532761:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828496/real 1787828496]  req@ffff9ee0056a2580 x1874670273062528/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828521 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828496.532772:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a2580 x1874670273062528/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828521 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828496.532780:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828496.532783:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828496.532785:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273062528:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787828496.532791:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273062656:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787828496.532853:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828496.532872:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828496/real 1787828496]  req@ffff9ee0056a0b40 x1874670273062656/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828521 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828496.532906:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0b40 x1874670273062656/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828521 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828496.532922:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828496.532929:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828496.532934:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273062656:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787828496.532979:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273062784:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787828496.533003:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828496.533016:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828496/real 1787828496]  req@ffff9ee0056a1e00 x1874670273062784/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828521 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828496.533036:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1e00 x1874670273062784/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828521 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828496.533048:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828496.533054:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828496.533059:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273062784:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828497.363550:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828497.555422:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828498.387486:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828498.579447:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828499.411441:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828499.603386:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828500.435565:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828500.627463:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828501.459490:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828501.651392:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:1.0:1787828501.651393:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828501.651401:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1787828501.651405:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787828501.651413:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3665
00000100:00080000:1.0:1787828501.651422:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828501.651428:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787828501.651459:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a03c0 x1874670273062912/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787828501.651493:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828501.651498:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787828501.651499:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787828501.651502:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3665
00000100:00080000:1.0:1787828501.651505:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828501.651507:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787828501.651514:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787828501.651525:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1a40 x1874670273063040/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787828501.651533:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828501.651536:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787828501.651538:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787828501.651540:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3665
00000100:00080000:1.0:1787828501.651542:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828501.651545:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787828501.651549:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828501.651555:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273062912:192.168.203.121@tcp:250:kworker.0
00000100:00100000:1.0:1787828501.651563:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a12c0 x1874670273063168/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787828501.651573:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828501.651576:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787828501.651578:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787828501.651581:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3665
00000100:00080000:1.0:1787828501.651583:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828501.651586:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787828501.651591:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787828501.651601:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a21c0 x1874670273063296/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787828501.651621:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828501.651624:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787828501.651626:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787828501.651629:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3665
00000100:00080000:1.0:1787828501.651632:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828501.651637:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000800:00000100:2.0:1787828501.651639:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000008:00100000:1.0:1787828501.651641:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787828501.651651:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1680 x1874670273063424/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787828501.651660:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828501.651663:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787828501.651665:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787828501.651669:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3665
00000100:00080000:1.0:1787828501.651671:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828501.651682:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787828501.651686:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828501.651694:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828501/real 1787828501]  req@ffff9ee0056a03c0 x1874670273062912/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828526 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828501.651698:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0f00 x1874670273063552/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787828501.651721:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828501.651726:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787828501.651728:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787828501.651731:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3665
00000100:00080000:1.0:1787828501.651734:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1787828501.651749:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a03c0 x1874670273062912/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828526 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828501.651750:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787828501.651756:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787828501.651776:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a3c00 x1874670273063680/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828501.651787:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828501.651795:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828501.651802:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273062912:192.168.203.121@tcp:250:kworker.0
00000100:00100000:2.0:1787828501.651812:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273063040:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787828501.651837:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828501.651850:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828501/real 1787828501]  req@ffff9ee0056a1a40 x1874670273063040/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828526 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828501.651863:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1a40 x1874670273063040/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828526 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828501.651871:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828501.651874:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828501.651877:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273063040:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787828501.651902:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273063168:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787828501.651921:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828501.651933:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828501/real 1787828501]  req@ffff9ee0056a12c0 x1874670273063168/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828526 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828501.651945:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a12c0 x1874670273063168/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828526 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828501.651953:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828501.651956:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828501.651959:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273063168:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787828501.651967:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273063296:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787828501.651986:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828501.652002:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828501/real 1787828501]  req@ffff9ee0056a21c0 x1874670273063296/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828526 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828501.652015:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a21c0 x1874670273063296/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828526 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828501.652025:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828501.652030:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828501.652036:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273063296:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787828501.652045:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273063424:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787828501.652067:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828501.652082:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828501/real 1787828501]  req@ffff9ee0056a1680 x1874670273063424/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828526 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828501.652095:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1680 x1874670273063424/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828526 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828501.652104:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828501.652107:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828501.652110:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273063424:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787828501.652116:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273063552:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787828501.652130:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828501.652141:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828501/real 1787828501]  req@ffff9ee0056a0f00 x1874670273063552/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828526 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828501.652155:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0f00 x1874670273063552/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828526 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828501.652164:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828501.652167:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828501.652170:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273063552:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787828501.652176:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273063680:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787828501.652196:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828501.652219:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828501/real 1787828501]  req@ffff9ee0056a3c00 x1874670273063680/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828526 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828501.652231:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a3c00 x1874670273063680/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828526 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828501.652239:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828501.652243:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828501.652246:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273063680:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828502.483619:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828502.675462:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828503.507661:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828503.699384:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828504.531523:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828504.723375:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828505.555438:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828505.747403:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828506.579457:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828506.771411:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:1.0:1787828506.771417:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828506.771427:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1787828506.771431:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787828506.771441:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3670
00000100:00080000:1.0:1787828506.771451:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828506.771457:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787828506.771497:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a2940 x1874670273063808/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787828506.771530:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828506.771533:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787828506.771535:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787828506.771538:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3670
00000100:00080000:1.0:1787828506.771542:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828506.771545:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787828506.771554:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787828506.771567:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a3c00 x1874670273063936/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787828506.771581:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828506.771584:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787828506.771586:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787828506.771590:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3670
00000100:00080000:1.0:1787828506.771593:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828506.771596:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787828506.771600:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787828506.771608:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0f00 x1874670273064064/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787828506.771615:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273063808:192.168.203.121@tcp:250:kworker.0
00000100:00080000:1.0:1787828506.771619:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828506.771624:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787828506.771626:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787828506.771629:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3670
00000100:00080000:1.0:1787828506.771632:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828506.771634:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787828506.771638:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787828506.771647:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1680 x1874670273064192/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787828506.771654:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828506.771657:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787828506.771659:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787828506.771662:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3670
00000100:00080000:1.0:1787828506.771665:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828506.771669:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787828506.771673:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787828506.771683:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a21c0 x1874670273064320/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1787828506.771683:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:1.0:1787828506.771695:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828506.771698:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787828506.771700:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787828506.771704:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3670
00000100:00080000:1.0:1787828506.771707:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828506.771709:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787828506.771713:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787828506.771739:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a12c0 x1874670273064448/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787828506.771748:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1787828506.771766:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828506/real 1787828506]  req@ffff9ee0056a2940 x1874670273063808/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828531 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828506.771771:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787828506.771777:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787828506.771792:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3670
00000100:00080000:1.0:1787828506.771801:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828506.771808:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787828506.771817:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828506.771817:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a2940 x1874670273063808/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828531 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828506.771840:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:1.0:1787828506.771843:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1a40 x1874670273064576/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828506.771850:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828506.771865:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273063808:192.168.203.121@tcp:250:kworker.0
00000100:00100000:2.0:1787828506.771886:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273063936:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787828506.771928:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828506.771951:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828506/real 1787828506]  req@ffff9ee0056a3c00 x1874670273063936/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828531 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828506.771976:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a3c00 x1874670273063936/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828531 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828506.771992:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828506.771998:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828506.772020:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273063936:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787828506.772046:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273064064:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787828506.772066:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828506.772102:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828506/real 1787828506]  req@ffff9ee0056a0f00 x1874670273064064/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828531 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828506.772117:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0f00 x1874670273064064/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828531 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828506.772132:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828506.772138:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828506.772144:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273064064:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787828506.772156:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273064192:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787828506.772191:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828506.772225:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828506/real 1787828506]  req@ffff9ee0056a1680 x1874670273064192/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828531 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828506.772240:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1680 x1874670273064192/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828531 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828506.772262:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828506.772267:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828506.772271:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273064192:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787828506.772279:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273064320:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787828506.772303:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828506.772340:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828506/real 1787828506]  req@ffff9ee0056a21c0 x1874670273064320/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828531 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828506.772351:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a21c0 x1874670273064320/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828531 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828506.772358:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828506.772360:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828506.772363:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273064320:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787828506.772368:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273064448:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787828506.772383:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828506.772391:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828506/real 1787828506]  req@ffff9ee0056a12c0 x1874670273064448/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828531 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828506.772400:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a12c0 x1874670273064448/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828531 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828506.772406:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828506.772409:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828506.772411:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273064448:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787828506.772415:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273064576:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787828506.772426:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828506.772433:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828506/real 1787828506]  req@ffff9ee0056a1a40 x1874670273064576/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828531 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828506.772441:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1a40 x1874670273064576/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828531 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828506.772446:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828506.772448:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828506.772451:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273064576:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828507.603538:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828507.795518:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828508.627576:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828508.819504:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828509.651539:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828509.843499:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828510.675487:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828510.867465:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828511.699527:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1787828511.891423:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1787828511.891440:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:1.0:1787828511.891446:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1787828511.891454:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787828511.891468:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3675
00000100:00080000:1.0:1787828511.891483:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828511.891493:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787828511.891548:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a03c0 x1874670273064704/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787828511.891596:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828511.891600:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787828511.891602:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787828511.891605:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3675
00000100:00080000:1.0:1787828511.891607:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828511.891610:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787828511.891621:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787828511.891632:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1e00 x1874670273064832/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787828511.891641:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828511.891644:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787828511.891646:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787828511.891651:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3675
00000100:00080000:1.0:1787828511.891655:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828511.891658:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787828511.891663:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787828511.891674:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0b40 x1874670273064960/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787828511.891684:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828511.891705:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787828511.891708:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787828511.891713:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3675
00000100:00100000:2.0:1787828511.891715:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273064704:192.168.203.121@tcp:250:kworker.0
00000100:00080000:1.0:1787828511.891717:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828511.891725:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787828511.891736:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787828511.891750:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a2580 x1874670273065088/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787828511.891758:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828511.891763:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787828511.891764:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787828511.891770:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3675
00000100:00080000:1.0:1787828511.891773:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828511.891777:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787828511.891780:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787828511.891793:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a3480 x1874670273065216/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787828511.891799:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828511.891803:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787828511.891806:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787828511.891811:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3675
00000100:00080000:1.0:1787828511.891814:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828511.891819:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787828511.891823:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787828511.891835:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0780 x1874670273065344/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1787828511.891847:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:1.0:1787828511.891864:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828511.891874:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787828511.891877:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787828511.891884:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3675
00000100:00080000:1.0:1787828511.891888:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828511.891891:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787828511.891896:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787828511.891908:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0000 x1874670273065472/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787828511.891936:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828511/real 1787828511]  req@ffff9ee0056a03c0 x1874670273064704/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828536 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828511.891976:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a03c0 x1874670273064704/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828536 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828511.891999:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828511.892008:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828511.892014:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273064704:192.168.203.121@tcp:250:kworker.0
00000100:00100000:2.0:1787828511.892026:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273064832:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787828511.892064:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828511.892083:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828511/real 1787828511]  req@ffff9ee0056a1e00 x1874670273064832/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828536 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828511.892108:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1e00 x1874670273064832/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828536 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828511.892125:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828511.892132:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828511.892139:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273064832:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787828511.892187:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273064960:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787828511.892239:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828511.892257:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828511/real 1787828511]  req@ffff9ee0056a0b40 x1874670273064960/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828536 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828511.892273:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0b40 x1874670273064960/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828536 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828511.892284:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828511.892288:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828511.892292:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273064960:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787828511.892311:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273065088:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787828511.892393:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828511.892408:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828511/real 1787828511]  req@ffff9ee0056a2580 x1874670273065088/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828536 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828511.892423:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a2580 x1874670273065088/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828536 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828511.892433:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828511.892437:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828511.892441:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273065088:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787828511.892457:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273065216:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787828511.892477:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828511.892488:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828511/real 1787828511]  req@ffff9ee0056a3480 x1874670273065216/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828536 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828511.892502:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a3480 x1874670273065216/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828536 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828511.892512:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828511.892515:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828511.892519:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273065216:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787828511.892525:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273065344:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787828511.892544:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828511.892555:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828511/real 1787828511]  req@ffff9ee0056a0780 x1874670273065344/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828536 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828511.892579:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0780 x1874670273065344/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828536 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828511.892589:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828511.892592:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828511.892596:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273065344:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787828511.892603:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273065472:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787828511.892621:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828511.892631:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828511/real 1787828511]  req@ffff9ee0056a0000 x1874670273065472/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828536 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828511.892645:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0000 x1874670273065472/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828536 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828511.892654:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828511.892657:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828511.892661:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273065472:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828512.723623:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828512.915453:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828513.747581:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828513.939462:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828514.771506:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828514.963436:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828515.795605:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828515.987403:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828516.819712:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828517.011425:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:1.0:1787828517.011449:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828517.011459:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1787828517.011465:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787828517.011478:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3680
00000100:00080000:1.0:1787828517.011503:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828517.011513:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787828517.011569:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a30c0 x1874670273065600/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787828517.011615:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828517.011620:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787828517.011623:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787828517.011628:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3680
00000100:00080000:1.0:1787828517.011632:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828517.011637:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787828517.011649:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787828517.011701:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0000 x1874670273065728/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787828517.011730:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1787828517.011735:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273065600:192.168.203.121@tcp:250:kworker.0
00000100:00080000:1.0:1787828517.011737:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787828517.011745:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787828517.011755:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3680
00000100:00080000:1.0:1787828517.011760:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828517.011766:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787828517.011784:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787828517.011802:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0780 x1874670273065856/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787828517.011815:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828517.011819:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787828517.011822:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787828517.011828:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3680
00000100:00080000:1.0:1787828517.011834:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828517.011838:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787828517.011854:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787828517.011868:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a3480 x1874670273065984/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787828517.011880:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828517.011884:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787828517.011887:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787828517.011893:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3680
00000100:00080000:1.0:1787828517.011900:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828517.011916:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787828517.011923:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787828517.011933:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273065728:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828517.011944:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a2580 x1874670273066112/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787828517.011960:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828517.011966:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787828517.011970:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787828517.011979:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3680
00000100:00080000:1.0:1787828517.011986:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1787828517.011994:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273065856:192.168.203.121@tcp:8:kworker.0
00000100:00080000:1.0:1787828517.012002:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787828517.012019:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828517.012035:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273065984:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828517.012067:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0b40 x1874670273066240/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787828517.012083:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273066112:192.168.203.121@tcp:38:kworker.0
00000100:00080000:1.0:1787828517.012118:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828517.012123:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:2.0:1787828517.012129:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273066240:192.168.203.121@tcp:8:kworker.0
00000100:00080000:1.0:1787828517.012131:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787828517.012147:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3680
00000100:00080000:1.0:1787828517.012156:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828517.012178:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787828517.012196:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787828517.012215:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1e00 x1874670273066368/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787828517.012286:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273066368:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828517.843514:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828518.035466:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828518.867556:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828519.059560:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828519.891597:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828520.083570:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000400:00000100:2.0:1787828520.083655:0:2352:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.203.121:988
00000400:00000100:2.0:1787828520.083690:0:2352:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.203.121@tcp at host 192.168.203.121 was unreachable: the network or that node may be down, or Lustre may be misconfigured.
00000800:00000100:2.0:1787828520.083704:0:2352:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:2.0:1787828520.083736:0:2352:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:2.0:1787828520.083742:0:2352:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:2.0:1787828520.083747:0:2352:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:2.0:1787828520.083754:0:2352:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:2.0:1787828520.083761:0:2352:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:2.0:1787828520.083767:0:2352:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000100:00100000:1.0:1787828520.083788:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828517/real 1787828520]  req@ffff9ee0056a1e00 x1874670273066368/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828542 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828520.083837:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1e00 x1874670273066368/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828542 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828520.083851:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828520.083857:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828520.083862:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273066368:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828520.083871:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828517/real 1787828520]  req@ffff9ee0056a0b40 x1874670273066240/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828542 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828520.083885:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0b40 x1874670273066240/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828542 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828520.083894:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828520.083899:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828520.083918:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273066240:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828520.083925:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828517/real 1787828520]  req@ffff9ee0056a2580 x1874670273066112/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828542 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828520.083937:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a2580 x1874670273066112/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828542 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828520.083944:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828520.083947:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828520.083950:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273066112:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828520.083957:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828517/real 1787828520]  req@ffff9ee0056a0000 x1874670273065728/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828542 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828520.083968:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0000 x1874670273065728/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828542 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828520.083976:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828520.083979:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828520.083982:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273065728:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828520.083988:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828517/real 1787828520]  req@ffff9ee0056a0780 x1874670273065856/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828542 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828520.083999:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0780 x1874670273065856/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828542 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828520.084007:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828520.084011:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828520.084015:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273065856:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828520.084022:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828517/real 1787828520]  req@ffff9ee0056a3480 x1874670273065984/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828542 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828520.084034:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a3480 x1874670273065984/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828542 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828520.084042:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828520.084046:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828520.084049:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273065984:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828520.084055:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828517/real 1787828520]  req@ffff9ee0056a30c0 x1874670273065600/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828542 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828520.084068:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a30c0 x1874670273065600/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828542 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828520.084076:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828520.084079:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828520.084083:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273065600:192.168.203.121@tcp:250:kworker.0
00010000:00010000:3.0:1787828520.915552:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828521.107506:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828521.939530:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1787828522.131468:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828522.131481:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1787828522.131487:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787828522.131501:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3685
00000100:00100000:3.0:1787828522.131503:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:1.0:1787828522.131516:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828522.131530:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787828522.131576:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a30c0 x1874670273066496/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787828522.131646:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828522.131652:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787828522.131654:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787828522.131660:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3685
00000100:00080000:1.0:1787828522.131665:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828522.131669:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787828522.131683:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787828522.131701:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a3480 x1874670273066624/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787828522.131716:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1787828522.131721:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273066496:192.168.203.121@tcp:250:kworker.0
00000100:00080000:1.0:1787828522.131722:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787828522.131730:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787828522.131739:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3685
00000100:00080000:1.0:1787828522.131743:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828522.131747:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787828522.131755:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787828522.131770:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0780 x1874670273066752/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787828522.131784:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828522.131789:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787828522.131791:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787828522.131808:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3685
00000100:00080000:1.0:1787828522.131815:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828522.131820:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787828522.131827:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:2.0:1787828522.131829:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828522.131848:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0000 x1874670273066880/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787828522.131864:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828522.131871:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787828522.131875:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1787828522.131889:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828522/real 1787828522]  req@ffff9ee0056a30c0 x1874670273066496/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828547 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828522.131890:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3685
00000100:00080000:1.0:1787828522.131906:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828522.131921:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787828522.131933:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787828522.131940:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a30c0 x1874670273066496/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828547 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828522.131964:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a2580 x1874670273067008/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828522.131967:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828522.131986:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:1.0:1787828522.132011:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828522.132018:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787828522.132023:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1787828522.132033:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273066496:192.168.203.121@tcp:250:kworker.0
00000100:00080000:1.0:1787828522.132035:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3685
00000100:00080000:1.0:1787828522.132052:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828522.132064:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787828522.132073:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828522.132089:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273066624:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828522.132101:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0b40 x1874670273067136/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787828522.132134:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828522.132141:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787828522.132145:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787828522.132154:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3685
00000800:00000100:2.0:1787828522.132162:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:1.0:1787828522.132168:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828522.132181:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787828522.132193:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828522.132201:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828522/real 1787828522]  req@ffff9ee0056a3480 x1874670273066624/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828547 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828522.132225:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1e00 x1874670273067264/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787828522.132242:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a3480 x1874670273066624/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828547 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828522.132270:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828522.132277:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828522.132286:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273066624:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787828522.132302:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273066752:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787828522.132412:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828522.132439:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828522/real 1787828522]  req@ffff9ee0056a0780 x1874670273066752/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828547 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828522.132463:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0780 x1874670273066752/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828547 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828522.132480:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828522.132487:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828522.132493:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273066752:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787828522.132506:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273066880:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787828522.132548:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828522.132572:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828522/real 1787828522]  req@ffff9ee0056a0000 x1874670273066880/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828547 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828522.132595:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0000 x1874670273066880/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828547 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828522.132612:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828522.132647:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828522.132654:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273066880:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787828522.132665:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273067008:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787828522.132707:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828522.132729:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828522/real 1787828522]  req@ffff9ee0056a2580 x1874670273067008/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828547 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828522.132751:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a2580 x1874670273067008/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828547 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828522.132765:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828522.132771:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828522.132778:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273067008:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787828522.132816:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273067136:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787828522.132856:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828522.132879:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828522/real 1787828522]  req@ffff9ee0056a0b40 x1874670273067136/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828547 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828522.132905:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0b40 x1874670273067136/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828547 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828522.132933:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828522.132942:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828522.132950:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273067136:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787828522.132975:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273067264:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787828522.133012:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828522.133035:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828522/real 1787828522]  req@ffff9ee0056a1e00 x1874670273067264/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828547 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828522.133060:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1e00 x1874670273067264/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828547 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828522.133075:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828522.133082:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828522.133098:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273067264:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828522.963584:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828523.155634:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828523.987458:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828524.179458:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828525.011497:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828525.203458:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828526.035559:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828526.227403:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828527.059621:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828527.251502:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:0.0:1787828527.251505:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828527.251519:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1787828527.251525:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828527.251538:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3690
00000100:00080000:0.0:1787828527.251551:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828527.251562:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787828527.251639:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb0c0 x1874670273067392/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828527.251677:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828527.251683:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787828527.251685:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828527.251690:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3690
00000100:00080000:0.0:1787828527.251695:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828527.251701:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828527.251713:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787828527.251729:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9a40 x1874670273067520/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828527.251746:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1787828527.251752:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273067392:192.168.203.121@tcp:250:kworker.0
00000100:00080000:0.0:1787828527.251753:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787828527.251760:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828527.251782:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3690
00000100:00080000:0.0:1787828527.251787:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828527.251791:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828527.251799:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828527.251826:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ea580 x1874670273067648/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828527.251847:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828527.251854:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787828527.251858:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:2.0:1787828527.251865:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:0.0:1787828527.251875:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3690
00000100:00080000:0.0:1787828527.251886:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828527.251896:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828527.251907:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828527.251921:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828527/real 1787828527]  req@ffff9ee0056eb0c0 x1874670273067392/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828552 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787828527.251934:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ead00 x1874670273067776/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787828527.251964:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb0c0 x1874670273067392/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828552 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828527.251967:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828527.251990:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787828527.252001:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828527.252003:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787828527.252023:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3690
00000100:00080000:2.0:1787828527.252023:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828527.252035:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273067392:192.168.203.121@tcp:250:kworker.0
00000100:00080000:0.0:1787828527.252037:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828527.252051:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828527.252059:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787828527.252071:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273067520:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787828527.252082:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ea940 x1874670273067904/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828527.252099:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828527.252103:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787828527.252106:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828527.252112:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3690
00000100:00080000:0.0:1787828527.252118:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828527.252124:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000800:00000100:2.0:1787828527.252134:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000008:00100000:0.0:1787828527.252142:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828527.252159:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828527/real 1787828527]  req@ffff9ee0056e9a40 x1874670273067520/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828552 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787828527.252175:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8780 x1874670273068032/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787828527.252198:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9a40 x1874670273067520/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828552 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828527.252206:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828527.252224:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787828527.252230:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828527.252241:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3690
00000100:00080000:2.0:1787828527.252242:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787828527.252249:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828527.252259:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00080000:0.0:1787828527.252264:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828527.252277:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828527.252280:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273067520:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787828527.252302:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9680 x1874670273068160/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787828527.252303:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273067648:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787828527.252400:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828527.252424:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828527/real 1787828527]  req@ffff9ee0056ea580 x1874670273067648/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828552 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828527.252441:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ea580 x1874670273067648/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828552 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828527.252452:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828527.252456:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828527.252460:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273067648:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787828527.252468:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273067776:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787828527.252490:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828527.252501:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828527/real 1787828527]  req@ffff9ee0056ead00 x1874670273067776/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828552 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828527.252515:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ead00 x1874670273067776/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828552 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828527.252525:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828527.252528:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828527.252532:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273067776:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787828527.252553:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273067904:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787828527.252616:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828527.252634:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828527/real 1787828527]  req@ffff9ee0056ea940 x1874670273067904/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828552 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828527.252648:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ea940 x1874670273067904/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828552 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828527.252659:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828527.252663:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828527.252667:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273067904:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787828527.252674:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273068032:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787828527.252698:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828527.252709:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828527/real 1787828527]  req@ffff9ee0056e8780 x1874670273068032/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828552 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828527.252733:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8780 x1874670273068032/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828552 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828527.252742:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828527.252745:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828527.252749:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273068032:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787828527.252756:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273068160:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787828527.252773:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828527.252784:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828527/real 1787828527]  req@ffff9ee0056e9680 x1874670273068160/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828552 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828527.252797:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9680 x1874670273068160/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828552 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828527.252807:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828527.252810:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828527.252814:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273068160:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828528.083513:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828528.275418:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828529.107483:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828529.299389:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828530.131642:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828530.323476:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828531.155619:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828531.347423:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828532.179535:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1787828532.371449:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1787828532.371449:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:0.0:1787828532.371464:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1787828532.371471:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828532.371495:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3696
00000100:00080000:0.0:1787828532.371510:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828532.371521:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787828532.371619:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9e00 x1874670273068288/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828532.371660:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828532.371665:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787828532.371667:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828532.371671:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3696
00000100:00080000:0.0:1787828532.371676:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828532.371680:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828532.371691:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787828532.371705:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8b40 x1874670273068416/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828532.371715:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828532.371718:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787828532.371721:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828532.371725:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3696
00000100:00080000:0.0:1787828532.371729:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828532.371733:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828532.371737:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828532.371747:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e92c0 x1874670273068544/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787828532.371762:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273068288:192.168.203.121@tcp:250:kworker.0
00000100:00080000:0.0:1787828532.371768:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828532.371773:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787828532.371775:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828532.371780:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3696
00000100:00080000:0.0:1787828532.371783:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828532.371787:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828532.371792:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828532.371805:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb840 x1874670273068672/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828532.371814:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828532.371817:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787828532.371819:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828532.371824:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3696
00000100:00080000:0.0:1787828532.371828:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828532.371831:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000800:00000100:2.0:1787828532.371839:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000008:00100000:0.0:1787828532.371841:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787828532.371855:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb480 x1874670273068800/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828532.371865:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828532.371868:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787828532.371870:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828532.371875:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3696
00000100:00080000:0.0:1787828532.371880:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828532.371884:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787828532.371891:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828532/real 1787828532]  req@ffff9ee0056e9e00 x1874670273068288/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828557 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:0.0:1787828532.371893:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828532.371911:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8000 x1874670273068928/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787828532.371922:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9e00 x1874670273068288/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828557 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828532.371924:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828532.371936:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787828532.371941:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828532.371952:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828532.371958:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:0.0:1787828532.371964:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3696
00000100:00100000:2.0:1787828532.371967:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273068288:192.168.203.121@tcp:250:kworker.0
00000100:00080000:0.0:1787828532.371969:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828532.371978:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787828532.371984:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273068416:192.168.203.121@tcp:38:kworker.0
00000008:00100000:0.0:1787828532.371985:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828532.372006:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e83c0 x1874670273069056/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1787828532.372019:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828532.372034:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828532/real 1787828532]  req@ffff9ee0056e8b40 x1874670273068416/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828557 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828532.372048:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8b40 x1874670273068416/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828557 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828532.372056:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828532.372059:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828532.372062:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273068416:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787828532.372084:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273068544:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787828532.372100:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828532.372109:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828532/real 1787828532]  req@ffff9ee0056e92c0 x1874670273068544/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828557 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828532.372120:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e92c0 x1874670273068544/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828557 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828532.372128:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828532.372130:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828532.372133:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273068544:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787828532.372139:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273068672:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787828532.372152:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828532.372179:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828532/real 1787828532]  req@ffff9ee0056eb840 x1874670273068672/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828557 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828532.372192:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb840 x1874670273068672/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828557 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828532.372201:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828532.372204:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828532.372207:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273068672:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787828532.372213:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273068800:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787828532.372230:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828532.372240:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828532/real 1787828532]  req@ffff9ee0056eb480 x1874670273068800/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828557 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828532.372252:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb480 x1874670273068800/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828557 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828532.372260:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828532.372264:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828532.372267:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273068800:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787828532.372274:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273068928:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787828532.372290:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828532.372316:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828532/real 1787828532]  req@ffff9ee0056e8000 x1874670273068928/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828557 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828532.372326:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8000 x1874670273068928/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828557 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828532.372334:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828532.372336:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828532.372339:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273068928:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787828532.372376:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273069056:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787828532.372396:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828532.372407:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828532/real 1787828532]  req@ffff9ee0056e83c0 x1874670273069056/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828557 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828532.372446:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e83c0 x1874670273069056/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828557 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828532.372456:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828532.372460:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828532.372464:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273069056:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828533.203501:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787828533.395567:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828534.227569:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787828534.419445:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828535.251464:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787828535.443386:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828536.275605:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787828536.467456:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828537.299578:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1787828537.491461:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828537.491477:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1787828537.491485:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828537.491504:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3701
00000100:00080000:0.0:1787828537.491546:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828537.491578:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787828537.491584:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00100000:0.0:1787828537.491635:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ebc00 x1874670273069184/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828537.491682:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828537.491690:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787828537.491694:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828537.491704:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3701
00000100:00080000:0.0:1787828537.491714:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828537.491724:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787828537.491736:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273069184:192.168.203.121@tcp:250:kworker.0
00000008:00100000:0.0:1787828537.491751:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787828537.491791:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8f00 x1874670273069312/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828537.491826:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828537.491833:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787828537.491836:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828537.491844:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3701
00000100:00080000:0.0:1787828537.491851:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828537.491859:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828537.491869:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828537.491895:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e83c0 x1874670273069440/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828537.491913:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828537.491919:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787828537.491923:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828537.491927:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3701
00000100:00080000:0.0:1787828537.491933:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828537.491937:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828537.491945:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828537.491964:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8000 x1874670273069568/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828537.491982:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828537.491987:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787828537.491990:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828537.491998:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3701
00000800:00000100:3.0:1787828537.492008:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:0.0:1787828537.492013:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828537.492026:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828537.492035:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787828537.492066:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb480 x1874670273069696/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828537.492082:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828537.492088:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787828537.492091:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828537.492097:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3701
00000100:00080000:0.0:1787828537.492102:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828537.492108:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828537.492115:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828537.492151:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb840 x1874670273069824/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828537.492176:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828537.492182:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787828537.492185:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828537.492191:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3701
00000100:00080000:0.0:1787828537.492196:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828537.492202:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828537.492210:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828537.492230:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e92c0 x1874670273069952/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787828537.492538:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828537/real 1787828537]  req@ffff9ee0056ebc00 x1874670273069184/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828562 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787828537.492587:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ebc00 x1874670273069184/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828562 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828537.492601:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787828537.492606:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787828537.492611:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273069184:192.168.203.121@tcp:250:kworker.0
00000100:00100000:3.0:1787828537.492661:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273069312:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787828537.492695:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787828537.492711:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828537/real 1787828537]  req@ffff9ee0056e8f00 x1874670273069312/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828562 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787828537.492724:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8f00 x1874670273069312/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828562 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828537.492734:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787828537.492738:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787828537.492742:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273069312:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787828537.492748:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273069440:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787828537.492783:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787828537.492793:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828537/real 1787828537]  req@ffff9ee0056e83c0 x1874670273069440/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828562 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787828537.492804:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e83c0 x1874670273069440/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828562 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828537.492811:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787828537.492814:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787828537.492816:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273069440:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787828537.492822:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273069568:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787828537.492855:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787828537.492865:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828537/real 1787828537]  req@ffff9ee0056e8000 x1874670273069568/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828562 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787828537.492876:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8000 x1874670273069568/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828562 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828537.492885:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787828537.492888:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787828537.492892:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273069568:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787828537.492898:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273069696:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787828537.492913:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787828537.492922:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828537/real 1787828537]  req@ffff9ee0056eb480 x1874670273069696/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828562 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787828537.492932:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb480 x1874670273069696/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828562 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828537.492940:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787828537.492943:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787828537.492946:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273069696:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787828537.492953:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273069824:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787828537.492968:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787828537.492977:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828537/real 1787828537]  req@ffff9ee0056eb840 x1874670273069824/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828562 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787828537.492987:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb840 x1874670273069824/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828562 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828537.492995:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787828537.492998:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787828537.493002:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273069824:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787828537.493009:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273069952:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787828537.493024:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787828537.493033:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828537/real 1787828537]  req@ffff9ee0056e92c0 x1874670273069952/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828562 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787828537.493044:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e92c0 x1874670273069952/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828562 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828537.493068:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787828537.493070:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787828537.493073:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273069952:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828538.323514:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828538.515389:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828539.347615:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828539.539428:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828540.371580:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828540.563480:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828541.395660:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828541.587468:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828542.419589:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828542.611556:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:0.0:1787828542.611574:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828542.611591:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1787828542.611598:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828542.611615:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3706
00000100:00080000:0.0:1787828542.611647:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828542.611657:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787828542.611726:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8b40 x1874670273070080/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828542.611776:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828542.611780:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787828542.611782:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828542.611788:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3706
00000100:00080000:0.0:1787828542.611792:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828542.611798:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828542.611813:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787828542.611846:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273070080:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787828542.611849:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9e00 x1874670273070208/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828542.611872:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828542.611876:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787828542.611879:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828542.611888:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3706
00000100:00080000:0.0:1787828542.611902:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828542.611906:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828542.611913:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828542.611937:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9680 x1874670273070336/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828542.611947:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828542.611951:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787828542.611953:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828542.611960:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3706
00000800:00000100:3.0:1787828542.611969:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:0.0:1787828542.611973:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828542.611985:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828542.612020:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828542.612039:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8780 x1874670273070464/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828542.612057:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828542.612061:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787828542.612066:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1787828542.612068:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828542/real 1787828542]  req@ffff9ee0056e8b40 x1874670273070080/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828567 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828542.612076:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3706
00000100:00100000:3.0:1787828542.612114:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8b40 x1874670273070080/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828567 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828542.612115:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828542.612132:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828542.612149:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00080000:3.0:1787828542.612151:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787828542.612182:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787828542.612188:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ea940 x1874670273070592/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787828542.612194:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273070080:192.168.203.121@tcp:250:kworker.0
00000100:00080000:0.0:1787828542.612229:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828542.612234:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787828542.612237:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828542.612242:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3706
00000100:00080000:0.0:1787828542.612247:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828542.612250:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828542.612255:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787828542.612258:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273070208:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787828542.612309:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ead00 x1874670273070720/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1787828542.612327:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:0.0:1787828542.612366:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828542.612371:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787828542.612374:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1787828542.612380:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828542/real 1787828542]  req@ffff9ee0056e9e00 x1874670273070208/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828567 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828542.612382:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3706
00000100:00080000:0.0:1787828542.612395:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828542.612406:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787828542.612413:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9e00 x1874670273070208/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828567 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:0.0:1787828542.612420:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:3.0:1787828542.612424:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787828542.612431:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787828542.612435:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273070208:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787828542.612442:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ea580 x1874670273070848/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787828542.612448:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273070336:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787828542.612533:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787828542.612546:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828542/real 1787828542]  req@ffff9ee0056e9680 x1874670273070336/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828567 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787828542.612574:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9680 x1874670273070336/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828567 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828542.612582:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787828542.612586:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787828542.612589:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273070336:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787828542.612595:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273070464:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787828542.612615:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787828542.612642:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828542/real 1787828542]  req@ffff9ee0056e8780 x1874670273070464/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828567 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787828542.612656:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8780 x1874670273070464/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828567 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828542.612665:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787828542.612668:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787828542.612671:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273070464:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787828542.612678:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273070592:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787828542.612713:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787828542.612722:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828542/real 1787828542]  req@ffff9ee0056ea940 x1874670273070592/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828567 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787828542.612732:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ea940 x1874670273070592/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828567 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828542.612740:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787828542.612742:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787828542.612745:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273070592:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787828542.612783:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273070720:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787828542.612803:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787828542.612813:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828542/real 1787828542]  req@ffff9ee0056ead00 x1874670273070720/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828567 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787828542.612848:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ead00 x1874670273070720/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828567 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828542.612854:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787828542.612856:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787828542.612858:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273070720:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787828542.612863:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273070848:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787828542.612877:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787828542.612884:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828542/real 1787828542]  req@ffff9ee0056ea580 x1874670273070848/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828567 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787828542.612913:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ea580 x1874670273070848/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828567 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828542.612921:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787828542.612924:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787828542.612927:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273070848:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828543.443716:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787828543.635482:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828544.467532:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828544.659430:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828545.491510:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828545.683415:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828546.515594:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828546.707376:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828547.539553:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828547.731454:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:2.0:1787828547.731538:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828547.731550:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787828547.731558:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828547.731572:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3711
00000100:00080000:2.0:1787828547.731589:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828547.731601:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787828547.731666:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729680 x1874670273070976/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828547.731707:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828547.731712:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787828547.731714:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828547.731718:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3711
00000100:00080000:2.0:1787828547.731724:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828547.731746:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828547.731764:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787828547.731779:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273070976:192.168.203.121@tcp:250:kworker.0
00000100:00100000:2.0:1787828547.731790:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057292c0 x1874670273071104/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828547.731810:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828547.731816:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787828547.731819:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828547.731825:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3711
00000100:00080000:2.0:1787828547.731832:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828547.731839:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828547.731857:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828547.731873:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572bc00 x1874670273071232/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1787828547.731885:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:2.0:1787828547.731915:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828547.731919:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787828547.731921:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828547.731929:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3711
00000100:00080000:2.0:1787828547.731934:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828547.731938:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828547.731944:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787828547.731960:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828547/real 1787828547]  req@ffff9ee005729680 x1874670273070976/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828572 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828547.731968:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728780 x1874670273071360/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787828547.732027:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729680 x1874670273070976/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828572 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828547.732037:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828547.732052:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828547.732053:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787828547.732067:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828547.732069:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:2.0:1787828547.732085:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3711
00000100:00100000:3.0:1787828547.732086:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273070976:192.168.203.121@tcp:250:kworker.0
00000100:00080000:2.0:1787828547.732100:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828547.732109:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787828547.732140:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057292c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273071104:192.168.203.121@tcp:38:kworker.0
00000008:00100000:2.0:1787828547.732156:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000800:00000100:3.0:1787828547.732177:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828547.732187:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a940 x1874670273071488/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787828547.732204:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828547/real 1787828547]  req@ffff9ee0057292c0 x1874670273071104/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828572 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828547.732237:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828547.732255:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787828547.732264:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828547.732285:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3711
00000100:00100000:3.0:1787828547.732302:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057292c0 x1874670273071104/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828572 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828547.732318:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828547.732329:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828547.732338:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:3.0:1787828547.732358:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787828547.732366:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787828547.732371:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057292c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273071104:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787828547.732380:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273071232:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787828547.732406:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828547.732425:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729e00 x1874670273071616/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787828547.732428:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828547/real 1787828547]  req@ffff9ee00572bc00 x1874670273071232/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828572 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828547.732567:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1787828547.732574:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572bc00 x1874670273071232/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828572 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828547.732575:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787828547.732584:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828547.732609:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3711
00000100:00080000:2.0:1787828547.732631:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828547.732631:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828547.732647:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00080000:3.0:1787828547.732652:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787828547.732661:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273071232:192.168.203.121@tcp:8:kworker.0
00000008:00100000:2.0:1787828547.732665:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787828547.732673:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273071360:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787828547.732687:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a1c0 x1874670273071744/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1787828547.732702:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787828547.732721:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828547/real 1787828547]  req@ffff9ee005728780 x1874670273071360/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828572 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787828547.732738:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728780 x1874670273071360/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828572 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828547.732747:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787828547.732751:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787828547.732754:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273071360:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787828547.732777:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273071488:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787828547.732795:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787828547.732805:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828547/real 1787828547]  req@ffff9ee00572a940 x1874670273071488/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828572 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787828547.732817:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a940 x1874670273071488/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828572 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828547.732825:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787828547.732828:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787828547.732832:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273071488:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787828547.732838:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273071616:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787828547.732854:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787828547.732864:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828547/real 1787828547]  req@ffff9ee005729e00 x1874670273071616/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828572 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787828547.732875:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729e00 x1874670273071616/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828572 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828547.732883:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787828547.732887:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787828547.732890:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273071616:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787828547.732896:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273071744:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787828547.732911:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787828547.732920:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828547/real 1787828547]  req@ffff9ee00572a1c0 x1874670273071744/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828572 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787828547.732931:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a1c0 x1874670273071744/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828572 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828547.732939:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787828547.732942:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787828547.732946:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273071744:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828548.563691:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828548.755489:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828549.587552:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828549.779377:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828550.611613:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828550.803442:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828551.635677:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828551.827394:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828552.659504:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828552.851363:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:2.0:1787828552.851429:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828552.851438:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787828552.851442:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828552.851453:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3716
00000100:00080000:2.0:1787828552.851478:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828552.851486:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787828552.851534:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057283c0 x1874670273071872/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828552.851584:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828552.851589:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787828552.851591:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828552.851607:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3716
00000100:00080000:2.0:1787828552.851611:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828552.851614:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828552.851644:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787828552.851658:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273071872:192.168.203.121@tcp:250:kworker.0
00000100:00100000:2.0:1787828552.851665:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728000 x1874670273072000/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828552.851693:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828552.851697:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787828552.851699:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828552.851705:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3716
00000100:00080000:2.0:1787828552.851708:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828552.851714:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828552.851719:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828552.851732:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a580 x1874670273072128/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828552.851756:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828552.851759:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787828552.851760:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828552.851764:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3716
00000100:00080000:2.0:1787828552.851770:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828552.851774:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828552.851789:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828552.851810:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728b40 x1874670273072256/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1787828552.851815:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:2.0:1787828552.851828:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828552.851831:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787828552.851834:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828552.851838:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3716
00000100:00080000:2.0:1787828552.851841:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828552.851845:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828552.851849:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787828552.851898:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728f00 x1874670273072384/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828552.851906:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828552.851909:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787828552.851911:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828552.851916:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3716
00000100:00080000:2.0:1787828552.851919:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828552.851921:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828552.851926:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787828552.851930:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828552/real 1787828552]  req@ffff9ee0057283c0 x1874670273071872/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828577 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828552.851953:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b840 x1874670273072512/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828552.852044:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828552.852048:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787828552.852050:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828552.852054:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3716
00000100:00080000:2.0:1787828552.852056:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1787828552.852060:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057283c0 x1874670273071872/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828577 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828552.852062:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828552.852075:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:3.0:1787828552.852094:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:2.0:1787828552.852097:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729a40 x1874670273072640/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828552.852102:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787828552.852120:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273071872:192.168.203.121@tcp:250:kworker.0
00000100:00100000:3.0:1787828552.852168:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273072000:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787828552.852191:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787828552.852200:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828552/real 1787828552]  req@ffff9ee005728000 x1874670273072000/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828577 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787828552.852233:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728000 x1874670273072000/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828577 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828552.852244:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787828552.852248:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787828552.852252:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273072000:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787828552.852261:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273072128:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787828552.852295:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787828552.852307:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828552/real 1787828552]  req@ffff9ee00572a580 x1874670273072128/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828577 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787828552.852321:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a580 x1874670273072128/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828577 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828552.852375:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787828552.852379:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787828552.852383:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273072128:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787828552.852391:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273072256:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787828552.852435:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787828552.852473:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828552/real 1787828552]  req@ffff9ee005728b40 x1874670273072256/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828577 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787828552.852488:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728b40 x1874670273072256/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828577 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828552.852498:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787828552.852528:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787828552.852533:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273072256:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787828552.852542:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273072384:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787828552.852570:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787828552.852583:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828552/real 1787828552]  req@ffff9ee005728f00 x1874670273072384/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828577 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787828552.852629:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728f00 x1874670273072384/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828577 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828552.852638:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787828552.852642:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787828552.852646:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273072384:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787828552.852682:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273072512:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787828552.852720:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787828552.852736:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828552/real 1787828552]  req@ffff9ee00572b840 x1874670273072512/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828577 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787828552.852762:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b840 x1874670273072512/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828577 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828552.852789:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787828552.852793:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787828552.852797:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273072512:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787828552.852804:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273072640:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787828552.852832:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787828552.852851:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828552/real 1787828552]  req@ffff9ee005729a40 x1874670273072640/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828577 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787828552.852883:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729a40 x1874670273072640/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828577 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828552.852900:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787828552.852904:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787828552.852907:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273072640:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828553.683608:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787828553.875453:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828554.707594:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787828554.899480:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828555.731592:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787828555.923453:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828556.755632:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828556.947451:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828557.779590:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828557.971459:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:2.0:1787828557.971494:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828557.971507:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787828557.971513:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828557.971527:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3721
00000100:00080000:2.0:1787828557.971562:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828557.971573:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787828557.971660:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b0c0 x1874670273072768/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828557.971714:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828557.971719:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787828557.971721:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828557.971726:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3721
00000100:00080000:2.0:1787828557.971732:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828557.971738:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828557.971753:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787828557.971772:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b480 x1874670273072896/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787828557.971788:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273072768:192.168.203.121@tcp:250:kworker.0
00000100:00080000:2.0:1787828557.971793:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828557.971817:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787828557.971820:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828557.971828:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3721
00000100:00080000:2.0:1787828557.971834:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828557.971839:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828557.971847:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828557.971880:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572ad00 x1874670273073024/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828557.971893:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828557.971898:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000800:00000100:3.0:1787828557.971905:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:2.0:1787828557.971907:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828557.971915:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3721
00000100:00080000:2.0:1787828557.971923:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828557.971968:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828557.971976:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828557.971994:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729a40 x1874670273073152/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787828557.972012:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828557/real 1787828557]  req@ffff9ee00572b0c0 x1874670273072768/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828582 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828557.972031:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828557.972058:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787828557.972062:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828557.972077:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3721
00000100:00100000:3.0:1787828557.972080:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b0c0 x1874670273072768/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828582 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828557.972088:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828557.972107:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828557.972130:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00080000:3.0:1787828557.972148:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:2.0:1787828557.972157:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b840 x1874670273073280/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828557.972163:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787828557.972183:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273072768:192.168.203.121@tcp:250:kworker.0
00000100:00080000:2.0:1787828557.972233:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828557.972240:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00100000:3.0:1787828557.972248:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273072896:192.168.203.121@tcp:38:kworker.0
00000100:00080000:2.0:1787828557.972249:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828557.972264:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3721
00000100:00080000:2.0:1787828557.972270:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828557.972287:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828557.972294:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828557.972312:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728f00 x1874670273073408/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1787828557.972327:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:2.0:1787828557.972338:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828557.972343:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787828557.972347:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828557.972419:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3721
00000100:00080000:2.0:1787828557.972425:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828557.972432:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828557.972442:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787828557.972457:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828557/real 1787828557]  req@ffff9ee00572b480 x1874670273072896/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828582 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828557.972464:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728b40 x1874670273073536/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787828557.972560:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b480 x1874670273072896/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828582 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828557.972575:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787828557.972580:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787828557.972585:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273072896:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787828557.972593:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273073024:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787828557.972619:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787828557.972630:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828557/real 1787828557]  req@ffff9ee00572ad00 x1874670273073024/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828582 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787828557.972640:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572ad00 x1874670273073024/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828582 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828557.972647:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787828557.972650:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787828557.972652:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273073024:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787828557.972658:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273073152:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787828557.972672:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787828557.972679:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828557/real 1787828557]  req@ffff9ee005729a40 x1874670273073152/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828582 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787828557.972689:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729a40 x1874670273073152/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828582 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828557.972695:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787828557.972698:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787828557.972701:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273073152:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787828557.972706:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273073280:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787828557.972724:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787828557.972739:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828557/real 1787828557]  req@ffff9ee00572b840 x1874670273073280/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828582 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787828557.972757:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b840 x1874670273073280/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828582 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828557.972769:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787828557.972774:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787828557.972779:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273073280:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787828557.972806:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273073408:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787828557.972828:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787828557.972838:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828557/real 1787828557]  req@ffff9ee005728f00 x1874670273073408/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828582 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787828557.972849:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728f00 x1874670273073408/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828582 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828557.972856:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787828557.972859:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787828557.972862:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273073408:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787828557.972867:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273073536:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787828557.972880:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787828557.972887:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828557/real 1787828557]  req@ffff9ee005728b40 x1874670273073536/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828582 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787828557.972897:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728b40 x1874670273073536/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828582 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828557.972904:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787828557.972907:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787828557.972910:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273073536:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828558.803621:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828558.995438:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828559.827690:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828560.019505:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828560.851473:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828561.043441:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828561.875488:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828562.067432:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828562.899512:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828563.091382:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787828563.091412:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828563.091418:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787828563.091421:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828563.091429:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3726
00000100:00080000:3.0:1787828563.091437:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828563.091444:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787828563.091475:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707c00 x1874670273073664/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828563.091498:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828563.091501:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787828563.091502:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828563.091505:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3726
00000100:00080000:3.0:1787828563.091507:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828563.091510:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828563.091518:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787828563.091527:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057061c0 x1874670273073792/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787828563.091532:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273073664:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787828563.091538:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828563.091543:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787828563.091544:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828563.091547:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3726
00000100:00080000:3.0:1787828563.091549:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828563.091551:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828563.091555:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787828563.091564:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705680 x1874670273073920/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828563.091571:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828563.091580:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787828563.091582:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828563.091588:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3726
00000100:00080000:3.0:1787828563.091590:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828563.091595:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000800:00000100:2.0:1787828563.091596:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000008:00100000:3.0:1787828563.091602:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787828563.091613:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706d00 x1874670273074048/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828563.091620:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828563.091626:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787828563.091628:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828563.091630:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3726
00000100:00080000:3.0:1787828563.091633:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828563.091636:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828563.091640:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787828563.091648:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828563/real 1787828563]  req@ffff9ee005707c00 x1874670273073664/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828588 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787828563.091649:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704000 x1874670273074176/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828563.091673:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828563.091678:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787828563.091679:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828563.091683:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3726
00000100:00080000:3.0:1787828563.091685:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1787828563.091690:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707c00 x1874670273073664/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828588 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828563.091691:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828563.091697:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787828563.091708:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057070c0 x1874670273074304/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828563.091710:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828563.091720:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:3.0:1787828563.091721:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1787828563.091726:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273073664:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787828563.091726:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787828563.091729:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828563.091737:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3726
00000100:00080000:3.0:1787828563.091740:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828563.091742:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828563.091745:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787828563.091751:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706940 x1874670273074432/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787828563.091759:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273073792:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787828563.091790:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828563.091804:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828563/real 1787828563]  req@ffff9ee0057061c0 x1874670273073792/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828588 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828563.091814:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057061c0 x1874670273073792/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828588 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828563.091835:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828563.091838:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828563.091840:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273073792:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787828563.091845:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273073920:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787828563.091861:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828563.091868:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828563/real 1787828563]  req@ffff9ee005705680 x1874670273073920/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828588 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828563.091875:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705680 x1874670273073920/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828588 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828563.091880:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828563.091882:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828563.091884:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273073920:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787828563.091888:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273074048:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787828563.091898:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828563.091913:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828563/real 1787828563]  req@ffff9ee005706d00 x1874670273074048/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828588 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828563.091920:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706d00 x1874670273074048/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828588 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828563.091925:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828563.091927:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828563.091930:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273074048:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787828563.091934:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273074176:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787828563.091944:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828563.091949:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828563/real 1787828563]  req@ffff9ee005704000 x1874670273074176/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828588 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828563.091957:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704000 x1874670273074176/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828588 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828563.091962:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828563.091964:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828563.091966:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273074176:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787828563.091969:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273074304:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787828563.091983:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828563.091989:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828563/real 1787828563]  req@ffff9ee0057070c0 x1874670273074304/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828588 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828563.091995:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057070c0 x1874670273074304/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828588 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828563.092000:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828563.092002:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828563.092005:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273074304:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787828563.092017:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273074432:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787828563.092028:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828563.092034:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828563/real 1787828563]  req@ffff9ee005706940 x1874670273074432/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828588 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828563.092052:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706940 x1874670273074432/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828588 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828563.092057:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828563.092059:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828563.092061:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273074432:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828563.923546:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828564.115506:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828564.947476:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828565.139488:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828565.971597:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828566.163414:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828566.995452:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828567.187441:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828568.019512:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828568.211405:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:2.0:1787828568.211449:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828568.211459:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787828568.211465:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828568.211476:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3731
00000100:00080000:2.0:1787828568.211491:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828568.211500:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787828568.211542:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a580 x1874670273074560/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828568.211587:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828568.211590:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787828568.211592:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828568.211596:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3731
00000100:00080000:2.0:1787828568.211601:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828568.211605:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828568.211630:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787828568.211642:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273074560:192.168.203.121@tcp:250:kworker.0
00000100:00100000:2.0:1787828568.211649:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728000 x1874670273074688/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828568.211670:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828568.211675:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787828568.211678:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828568.211685:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3731
00000100:00080000:2.0:1787828568.211703:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828568.211713:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000800:00000100:3.0:1787828568.211715:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000008:00100000:2.0:1787828568.211723:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828568.211741:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057283c0 x1874670273074816/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828568.211768:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828568.211773:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787828568.211775:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828568.211781:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3731
00000100:00080000:2.0:1787828568.211786:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1787828568.211788:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828568/real 1787828568]  req@ffff9ee00572a580 x1874670273074560/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828593 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828568.211795:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828568.211806:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787828568.211827:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a580 x1874670273074560/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828593 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828568.211829:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a1c0 x1874670273074944/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828568.211883:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828568.211884:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828568.211907:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787828568.211912:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:2.0:1787828568.211913:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1787828568.211920:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273074560:192.168.203.121@tcp:250:kworker.0
00000100:00080000:2.0:1787828568.211923:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3731
00000100:00080000:2.0:1787828568.211932:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828568.211937:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828568.211942:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787828568.211968:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729e00 x1874670273075072/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787828568.211973:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273074688:192.168.203.121@tcp:38:kworker.0
00000100:00080000:2.0:1787828568.211989:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828568.211993:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787828568.211995:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828568.212000:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3731
00000100:00080000:2.0:1787828568.212005:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000800:00000100:3.0:1787828568.212010:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:2.0:1787828568.212013:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828568.212022:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787828568.212032:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828568/real 1787828568]  req@ffff9ee005728000 x1874670273074688/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828593 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828568.212039:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a940 x1874670273075200/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828568.212075:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1787828568.212076:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728000 x1874670273074688/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828593 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828568.212086:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787828568.212094:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828568.212094:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787828568.212104:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00080000:2.0:1787828568.212124:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3731
00000100:00100000:3.0:1787828568.212127:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273074688:192.168.203.121@tcp:38:kworker.0
00000100:00080000:2.0:1787828568.212136:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1787828568.212140:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273074816:192.168.203.121@tcp:8:kworker.0
00000100:00080000:2.0:1787828568.212148:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828568.212158:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828568.212177:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728780 x1874670273075328/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1787828568.212187:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787828568.212232:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828568/real 1787828568]  req@ffff9ee0057283c0 x1874670273074816/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828593 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787828568.212260:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057283c0 x1874670273074816/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828593 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828568.212270:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787828568.212273:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787828568.212277:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273074816:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787828568.212284:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273074944:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787828568.212369:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787828568.212385:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828568/real 1787828568]  req@ffff9ee00572a1c0 x1874670273074944/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828593 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787828568.212401:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a1c0 x1874670273074944/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828593 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828568.212411:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787828568.212415:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787828568.212420:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273074944:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787828568.212442:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273075072:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787828568.212467:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787828568.212478:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828568/real 1787828568]  req@ffff9ee005729e00 x1874670273075072/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828593 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787828568.212489:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729e00 x1874670273075072/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828593 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828568.212501:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787828568.212504:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787828568.212507:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273075072:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787828568.212511:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273075200:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787828568.212525:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787828568.212532:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828568/real 1787828568]  req@ffff9ee00572a940 x1874670273075200/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828593 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787828568.212542:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a940 x1874670273075200/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828593 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828568.212548:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787828568.212550:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787828568.212552:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273075200:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787828568.212557:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273075328:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787828568.212568:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787828568.212575:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828568/real 1787828568]  req@ffff9ee005728780 x1874670273075328/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828593 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787828568.212584:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728780 x1874670273075328/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828593 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828568.212590:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787828568.212592:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787828568.212596:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273075328:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828569.043466:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828569.235433:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828570.067596:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828570.259411:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828571.091454:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828571.283506:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828572.115519:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828572.307425:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828573.139519:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828573.331375:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:2.0:1787828573.331385:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828573.331391:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787828573.331395:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828573.331403:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3737
00000100:00080000:2.0:1787828573.331412:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828573.331419:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787828573.331448:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572bc00 x1874670273075456/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828573.331469:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828573.331472:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787828573.331473:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828573.331476:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3737
00000100:00080000:2.0:1787828573.331478:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828573.331481:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828573.331488:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787828573.331497:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057292c0 x1874670273075584/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787828573.331504:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273075456:192.168.203.121@tcp:250:kworker.0
00000100:00080000:2.0:1787828573.331508:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828573.331512:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787828573.331514:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828573.331517:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3737
00000100:00080000:2.0:1787828573.331519:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828573.331522:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828573.331525:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828573.331533:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729680 x1874670273075712/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828573.331539:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828573.331541:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787828573.331543:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828573.331545:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3737
00000100:00080000:2.0:1787828573.331556:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828573.331559:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828573.331562:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828573.331570:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728780 x1874670273075840/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1787828573.331576:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:2.0:1787828573.331580:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828573.331584:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787828573.331585:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828573.331589:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3737
00000100:00080000:2.0:1787828573.331592:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828573.331595:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828573.331598:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787828573.331605:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a940 x1874670273075968/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828573.331616:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1787828573.331618:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828573/real 1787828573]  req@ffff9ee00572bc00 x1874670273075456/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828598 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828573.331621:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787828573.331625:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828573.331631:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3737
00000100:00080000:2.0:1787828573.331636:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828573.331640:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828573.331643:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787828573.331647:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572bc00 x1874670273075456/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828598 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828573.331653:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729e00 x1874670273076096/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828573.331666:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828573.331667:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828573.331672:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787828573.331673:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:2.0:1787828573.331675:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828573.331681:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3737
00000100:00100000:3.0:1787828573.331681:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273075456:192.168.203.121@tcp:250:kworker.0
00000100:00080000:2.0:1787828573.331687:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828573.331693:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828573.331703:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828573.331715:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a1c0 x1874670273076224/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787828573.331719:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057292c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273075584:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787828573.331747:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787828573.331758:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828573/real 1787828573]  req@ffff9ee0057292c0 x1874670273075584/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828598 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787828573.331776:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057292c0 x1874670273075584/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828598 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828573.331785:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787828573.331790:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787828573.331793:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057292c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273075584:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787828573.331801:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273075712:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787828573.331833:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787828573.331844:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828573/real 1787828573]  req@ffff9ee005729680 x1874670273075712/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828598 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787828573.331854:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729680 x1874670273075712/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828598 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828573.331861:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787828573.331865:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787828573.331868:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273075712:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787828573.331872:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273075840:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787828573.331888:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787828573.331899:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828573/real 1787828573]  req@ffff9ee005728780 x1874670273075840/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828598 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787828573.331907:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728780 x1874670273075840/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828598 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828573.331912:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787828573.331916:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787828573.331919:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273075840:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787828573.331925:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273075968:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787828573.331940:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787828573.331948:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828573/real 1787828573]  req@ffff9ee00572a940 x1874670273075968/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828598 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787828573.331960:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a940 x1874670273075968/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828598 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828573.331975:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787828573.331977:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787828573.331979:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273075968:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787828573.331983:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273076096:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787828573.332072:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787828573.332092:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828573/real 1787828573]  req@ffff9ee005729e00 x1874670273076096/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828598 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787828573.332117:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729e00 x1874670273076096/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828598 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828573.332123:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787828573.332126:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787828573.332128:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273076096:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787828573.332153:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273076224:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787828573.332179:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787828573.332187:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828573/real 1787828573]  req@ffff9ee00572a1c0 x1874670273076224/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828598 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787828573.332194:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a1c0 x1874670273076224/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828598 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828573.332403:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787828573.332406:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787828573.332409:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273076224:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828574.163472:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828574.355404:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828575.187567:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828575.379405:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828576.211441:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828576.403435:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828577.235557:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828577.427493:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828578.259535:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828578.451437:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787828578.451536:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828578.451544:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787828578.451550:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828578.451562:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3742
00000100:00080000:3.0:1787828578.451575:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828578.451584:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787828578.451630:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057052c0 x1874670273076352/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828578.451671:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828578.451676:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787828578.451679:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828578.451683:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3742
00000100:00080000:3.0:1787828578.451689:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828578.451694:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828578.451707:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787828578.451724:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707480 x1874670273076480/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787828578.451736:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273076352:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787828578.451744:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828578.451752:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787828578.451754:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828578.451760:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3742
00000100:00080000:3.0:1787828578.451764:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828578.451769:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828578.451776:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787828578.451794:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707840 x1874670273076608/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828578.451806:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828578.451810:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787828578.451813:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828578.451818:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3742
00000100:00080000:3.0:1787828578.451823:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828578.451827:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000800:00000100:2.0:1787828578.451836:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000008:00100000:3.0:1787828578.451838:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787828578.451857:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057043c0 x1874670273076736/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828578.451868:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828578.451873:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787828578.451875:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828578.451881:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3742
00000100:00080000:3.0:1787828578.451887:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828578.451893:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787828578.451902:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828578/real 1787828578]  req@ffff9ee0057052c0 x1874670273076352/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828603 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:3.0:1787828578.451905:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787828578.451928:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706580 x1874670273076864/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787828578.451942:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057052c0 x1874670273076352/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828603 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828578.451946:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828578.451962:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787828578.451974:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828578.451983:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:3.0:1787828578.451984:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1787828578.451994:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273076352:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787828578.452000:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3742
00000100:00080000:3.0:1787828578.452010:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828578.452015:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828578.452021:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828578.452037:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273076480:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787828578.452040:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704b40 x1874670273076992/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828578.452061:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828578.452066:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787828578.452069:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828578.452075:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3742
00000100:00080000:3.0:1787828578.452082:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000800:00000100:2.0:1787828578.452083:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787828578.452091:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828578.452100:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828578.452113:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828578/real 1787828578]  req@ffff9ee005707480 x1874670273076480/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828603 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787828578.452121:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705e00 x1874670273077120/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787828578.452165:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707480 x1874670273076480/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828603 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828578.452178:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828578.452183:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828578.452190:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273076480:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787828578.452199:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273076608:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787828578.452250:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828578.452266:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828578/real 1787828578]  req@ffff9ee005707840 x1874670273076608/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828603 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828578.452281:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707840 x1874670273076608/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828603 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828578.452300:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828578.452304:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828578.452308:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273076608:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787828578.452345:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273076736:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787828578.452370:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828578.452383:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828578/real 1787828578]  req@ffff9ee0057043c0 x1874670273076736/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828603 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828578.452397:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057043c0 x1874670273076736/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828603 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828578.452407:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828578.452411:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828578.452415:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273076736:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787828578.452422:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273076864:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787828578.452441:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828578.452452:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828578/real 1787828578]  req@ffff9ee005706580 x1874670273076864/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828603 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828578.452466:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706580 x1874670273076864/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828603 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828578.452476:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828578.452479:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828578.452484:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273076864:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787828578.452504:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273076992:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787828578.452525:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828578.452537:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828578/real 1787828578]  req@ffff9ee005704b40 x1874670273076992/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828603 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828578.452550:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704b40 x1874670273076992/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828603 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828578.452559:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828578.452563:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828578.452566:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273076992:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787828578.452573:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273077120:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787828578.452590:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828578.452601:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828578/real 1787828578]  req@ffff9ee005705e00 x1874670273077120/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828603 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828578.452615:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705e00 x1874670273077120/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828603 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828578.452624:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828578.452627:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828578.452630:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273077120:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828579.283571:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828579.475401:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828580.307488:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828580.499380:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828581.331521:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828581.523415:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828582.355490:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828582.547431:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828583.379472:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828583.571415:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:0.0:1787828583.571416:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828583.571425:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1787828583.571429:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828583.571437:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3747
00000100:00080000:0.0:1787828583.571446:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828583.571453:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787828583.571483:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9a40 x1874670273077248/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828583.571508:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828583.571511:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787828583.571512:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828583.571515:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3747
00000100:00080000:0.0:1787828583.571517:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828583.571519:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828583.571526:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787828583.571535:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb0c0 x1874670273077376/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828583.571543:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828583.571545:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787828583.571547:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828583.571549:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3747
00000100:00080000:0.0:1787828583.571552:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828583.571557:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787828583.571558:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273077248:192.168.203.121@tcp:250:kworker.0
00000008:00100000:0.0:1787828583.571560:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828583.571572:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ea580 x1874670273077504/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828583.571580:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828583.571583:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787828583.571584:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828583.571586:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3747
00000100:00080000:0.0:1787828583.571588:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828583.571590:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828583.571593:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828583.571599:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ead00 x1874670273077632/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828583.571605:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828583.571607:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787828583.571609:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828583.571612:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3747
00000100:00080000:0.0:1787828583.571615:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828583.571617:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828583.571620:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787828583.571626:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ea940 x1874670273077760/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828583.571637:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828583.571640:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787828583.571641:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828583.571643:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3747
00000100:00080000:0.0:1787828583.571646:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828583.571648:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828583.571652:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828583.571659:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8780 x1874670273077888/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828583.571665:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828583.571667:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787828583.571668:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828583.571671:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3747
00000100:00080000:0.0:1787828583.571674:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828583.571677:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828583.571680:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828583.571685:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273077376:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787828583.571697:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9680 x1874670273078016/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787828583.571726:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273077504:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787828583.571742:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273077632:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787828583.571756:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273077760:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787828583.571768:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273077888:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787828583.571781:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273078016:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828584.403449:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828584.595459:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828585.427510:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828585.619444:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828586.451485:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828586.643712:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000400:00000100:0.0:1787828586.643863:0:2355:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.203.121:988
00000400:00000100:0.0:1787828586.643911:0:2355:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.203.121@tcp at host 192.168.203.121 was unreachable: the network or that node may be down, or Lustre may be misconfigured.
00000800:00000100:0.0:1787828586.643928:0:2355:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:0.0:1787828586.643971:0:2355:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:0.0:1787828586.643981:0:2355:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:0.0:1787828586.643989:0:2355:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:0.0:1787828586.643998:0:2355:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:0.0:1787828586.644007:0:2355:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:0.0:1787828586.644015:0:2355:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000100:00100000:2.0:1787828586.644044:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828583/real 1787828586]  req@ffff9ee0056ea580 x1874670273077504/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828608 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828586.644071:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ea580 x1874670273077504/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828608 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828586.644083:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828586.644089:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828586.644094:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273077504:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787828586.644102:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828583/real 1787828586]  req@ffff9ee0056ead00 x1874670273077632/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828608 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828586.644116:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ead00 x1874670273077632/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828608 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828586.644133:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828586.644136:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828586.644139:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273077632:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787828586.644146:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828583/real 1787828586]  req@ffff9ee0056ea940 x1874670273077760/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828608 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828586.644158:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ea940 x1874670273077760/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828608 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828586.644181:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828586.644185:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828586.644189:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273077760:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787828586.644197:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828583/real 1787828586]  req@ffff9ee0056e8780 x1874670273077888/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828608 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828586.644210:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8780 x1874670273077888/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828608 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828586.644218:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828586.644222:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828586.644225:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273077888:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787828586.644231:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828583/real 1787828586]  req@ffff9ee0056e9680 x1874670273078016/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828608 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828586.644242:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9680 x1874670273078016/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828608 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828586.644256:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828586.644259:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828586.644263:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273078016:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787828586.644285:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828583/real 1787828586]  req@ffff9ee0056e9a40 x1874670273077248/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828608 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828586.644300:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9a40 x1874670273077248/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828608 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828586.644308:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828586.644311:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828586.644399:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273077248:192.168.203.121@tcp:250:kworker.0
00000100:00100000:2.0:1787828586.644410:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828583/real 1787828586]  req@ffff9ee0056eb0c0 x1874670273077376/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828608 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828586.644424:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb0c0 x1874670273077376/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828608 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828586.644433:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828586.644437:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828586.644441:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273077376:192.168.203.121@tcp:38:kworker.0
00010000:00010000:3.0:1787828587.475504:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828587.667490:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828588.499656:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1787828588.691416:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828588.691424:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787828588.691428:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828588.691436:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3752
00000100:00080000:3.0:1787828588.691446:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828588.691453:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787828588.691454:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00100000:3.0:1787828588.691483:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705a40 x1874670273078144/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828588.691502:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828588.691504:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787828588.691506:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828588.691508:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3752
00000100:00080000:3.0:1787828588.691511:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828588.691513:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828588.691520:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787828588.691528:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704780 x1874670273078272/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828588.691535:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828588.691538:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787828588.691539:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828588.691541:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3752
00000100:00080000:3.0:1787828588.691543:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828588.691546:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828588.691550:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828588.691554:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273078144:192.168.203.121@tcp:250:kworker.0
00000100:00100000:3.0:1787828588.691561:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705e00 x1874670273078400/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828588.691568:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828588.691570:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787828588.691571:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828588.691574:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3752
00000100:00080000:3.0:1787828588.691576:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828588.691578:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828588.691581:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787828588.691592:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704b40 x1874670273078528/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828588.691601:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828588.691605:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787828588.691608:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828588.691612:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3752
00000100:00080000:3.0:1787828588.691617:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000800:00000100:2.0:1787828588.691622:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787828588.691626:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828588.691634:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787828588.691646:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706580 x1874670273078656/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828588.691656:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828588.691660:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787828588.691662:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1787828588.691668:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828588/real 1787828588]  req@ffff9ee005705a40 x1874670273078144/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828613 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828588.691676:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3752
00000100:00080000:3.0:1787828588.691685:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828588.691691:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787828588.691696:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705a40 x1874670273078144/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828613 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:3.0:1787828588.691697:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:2.0:1787828588.691714:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:3.0:1787828588.691715:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057043c0 x1874670273078784/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828588.691724:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:3.0:1787828588.691733:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1787828588.691734:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273078144:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787828588.691739:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787828588.691745:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1787828588.691750:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273078272:192.168.203.121@tcp:38:kworker.0
00000100:00080000:3.0:1787828588.691752:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3752
00000100:00080000:3.0:1787828588.691760:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828588.691764:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828588.691769:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787828588.691782:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707840 x1874670273078912/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1787828588.691789:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828588.691813:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828588/real 1787828588]  req@ffff9ee005704780 x1874670273078272/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828613 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828588.691826:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704780 x1874670273078272/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828613 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828588.691835:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828588.691838:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828588.691841:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273078272:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787828588.691864:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273078400:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787828588.691885:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828588.691898:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828588/real 1787828588]  req@ffff9ee005705e00 x1874670273078400/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828613 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828588.691909:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705e00 x1874670273078400/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828613 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828588.691922:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828588.691924:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828588.691927:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273078400:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787828588.691933:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273078528:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787828588.691949:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828588.691959:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828588/real 1787828588]  req@ffff9ee005704b40 x1874670273078528/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828613 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828588.691970:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704b40 x1874670273078528/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828613 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828588.691977:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828588.691980:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828588.691983:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273078528:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787828588.691988:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273078656:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787828588.692005:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828588.692016:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828588/real 1787828588]  req@ffff9ee005706580 x1874670273078656/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828613 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828588.692026:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706580 x1874670273078656/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828613 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828588.692033:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828588.692036:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828588.692040:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273078656:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787828588.692045:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273078784:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787828588.692065:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828588.692077:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828588/real 1787828588]  req@ffff9ee0057043c0 x1874670273078784/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828613 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828588.692088:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057043c0 x1874670273078784/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828613 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828588.692095:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828588.692099:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828588.692103:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273078784:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787828588.692109:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273078912:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787828588.692129:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828588.692141:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828588/real 1787828588]  req@ffff9ee005707840 x1874670273078912/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828613 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828588.692173:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707840 x1874670273078912/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828613 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828588.692182:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828588.692186:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828588.692189:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273078912:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828589.523487:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828589.715539:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828590.547463:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828590.739418:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828591.571509:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828591.763400:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828592.595456:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828592.787400:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828593.619494:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828593.811402:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:2.0:1787828593.811440:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828593.811446:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787828593.811449:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828593.811456:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3757
00000100:00080000:2.0:1787828593.811466:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828593.811471:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787828593.811502:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057283c0 x1874670273079040/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828593.811529:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828593.811534:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787828593.811536:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828593.811541:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3757
00000100:00080000:2.0:1787828593.811545:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828593.811550:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787828593.811558:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273079040:192.168.203.121@tcp:250:kworker.0
00000008:00100000:2.0:1787828593.811561:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787828593.811576:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728000 x1874670273079168/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828593.811584:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828593.811587:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787828593.811589:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828593.811591:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3757
00000100:00080000:2.0:1787828593.811603:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828593.811606:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828593.811610:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:3.0:1787828593.811615:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828593.811620:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a580 x1874670273079296/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828593.811629:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828593.811631:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787828593.811633:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828593.811635:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3757
00000100:00080000:2.0:1787828593.811637:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828593.811640:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828593.811643:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828593.811650:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728b40 x1874670273079424/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787828593.811655:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828593/real 1787828593]  req@ffff9ee0057283c0 x1874670273079040/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828618 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828593.811662:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828593.811669:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787828593.811672:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828593.811677:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3757
00000100:00080000:2.0:1787828593.811679:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828593.811684:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787828593.811684:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057283c0 x1874670273079040/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828618 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:2.0:1787828593.811690:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00080000:3.0:1787828593.811700:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:2.0:1787828593.811702:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728f00 x1874670273079552/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828593.811708:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787828593.811716:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273079040:192.168.203.121@tcp:250:kworker.0
00000100:00080000:2.0:1787828593.811717:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828593.811725:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787828593.811727:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828593.811731:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3757
00000100:00080000:2.0:1787828593.811733:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828593.811735:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828593.811737:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828593.811746:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b840 x1874670273079680/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828593.811752:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1787828593.811753:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273079168:192.168.203.121@tcp:38:kworker.0
00000100:00080000:2.0:1787828593.811757:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787828593.811761:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828593.811763:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3757
00000100:00080000:2.0:1787828593.811766:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828593.811768:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828593.811772:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:3.0:1787828593.811780:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828593.811782:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729a40 x1874670273079808/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787828593.811794:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828593/real 1787828593]  req@ffff9ee005728000 x1874670273079168/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828618 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787828593.811804:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728000 x1874670273079168/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828618 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828593.811810:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787828593.811813:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787828593.811815:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273079168:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787828593.811819:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273079296:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787828593.811832:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787828593.811840:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828593/real 1787828593]  req@ffff9ee00572a580 x1874670273079296/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828618 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787828593.811853:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a580 x1874670273079296/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828618 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828593.811870:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787828593.811873:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787828593.811877:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273079296:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787828593.811884:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273079424:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787828593.811904:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787828593.811913:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828593/real 1787828593]  req@ffff9ee005728b40 x1874670273079424/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828618 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787828593.811926:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728b40 x1874670273079424/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828618 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828593.811935:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787828593.811938:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787828593.811942:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273079424:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787828593.811948:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273079552:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787828593.811969:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787828593.811978:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828593/real 1787828593]  req@ffff9ee005728f00 x1874670273079552/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828618 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787828593.811986:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728f00 x1874670273079552/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828618 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828593.811991:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787828593.811994:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787828593.811995:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273079552:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787828593.812009:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273079680:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787828593.812021:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787828593.812026:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828593/real 1787828593]  req@ffff9ee00572b840 x1874670273079680/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828618 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787828593.812038:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b840 x1874670273079680/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828618 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828593.812044:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787828593.812045:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787828593.812047:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273079680:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787828593.812050:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273079808:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787828593.812060:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787828593.812065:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828593/real 1787828593]  req@ffff9ee005729a40 x1874670273079808/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828618 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787828593.812072:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729a40 x1874670273079808/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828618 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828593.812078:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787828593.812081:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787828593.812085:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273079808:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828594.643458:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828594.835448:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828595.667456:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828595.859406:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828596.691466:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828596.883408:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828597.715475:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828597.907430:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828598.739448:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828598.931473:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787828598.931598:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828598.931603:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787828598.931607:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828598.931614:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3762
00000100:00080000:3.0:1787828598.931623:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828598.931629:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787828598.931662:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707480 x1874670273079936/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828598.931685:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828598.931688:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787828598.931691:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828598.931695:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3762
00000100:00080000:3.0:1787828598.931700:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828598.931704:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828598.931715:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787828598.931716:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273079936:192.168.203.121@tcp:250:kworker.0
00000100:00100000:3.0:1787828598.931733:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057052c0 x1874670273080064/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828598.931748:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828598.931752:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787828598.931754:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828598.931757:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3762
00000100:00080000:3.0:1787828598.931763:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828598.931766:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828598.931771:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:2.0:1787828598.931775:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787828598.931787:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706940 x1874670273080192/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828598.931799:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828598.931803:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787828598.931805:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1787828598.931810:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828598/real 1787828598]  req@ffff9ee005707480 x1874670273079936/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828623 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828598.931812:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3762
00000100:00080000:3.0:1787828598.931820:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828598.931826:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787828598.931829:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707480 x1874670273079936/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828623 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:3.0:1787828598.931833:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:2.0:1787828598.931847:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:3.0:1787828598.931850:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057070c0 x1874670273080320/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828598.931853:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828598.931860:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273079936:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787828598.931869:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828598.931872:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787828598.931873:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828598.931876:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3762
00000100:00080000:3.0:1787828598.931879:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1787828598.931883:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273080064:192.168.203.121@tcp:38:kworker.0
00000100:00080000:3.0:1787828598.931885:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828598.931892:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787828598.931902:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704000 x1874670273080448/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1787828598.931909:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787828598.931914:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828598.931918:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787828598.931920:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1787828598.931923:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828598/real 1787828598]  req@ffff9ee0057052c0 x1874670273080064/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828623 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828598.931926:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3762
00000100:00080000:3.0:1787828598.931932:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828598.931937:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787828598.931942:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057052c0 x1874670273080064/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828623 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:3.0:1787828598.931942:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:2.0:1787828598.931954:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:3.0:1787828598.931957:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706d00 x1874670273080576/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828598.931959:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828598.931966:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273080064:192.168.203.121@tcp:38:kworker.0
00000100:00080000:3.0:1787828598.931977:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1787828598.931979:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273080192:192.168.203.121@tcp:8:kworker.0
00000100:00080000:3.0:1787828598.931981:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787828598.931985:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828598.931988:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3762
00000100:00080000:3.0:1787828598.931990:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828598.931994:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828598.931998:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:2.0:1787828598.932000:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787828598.932011:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705680 x1874670273080704/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787828598.932012:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828598/real 1787828598]  req@ffff9ee005706940 x1874670273080192/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828623 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828598.932043:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706940 x1874670273080192/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828623 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828598.932050:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828598.932052:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828598.932055:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273080192:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787828598.932060:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273080320:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787828598.932072:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828598.932077:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828598/real 1787828598]  req@ffff9ee0057070c0 x1874670273080320/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828623 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828598.932101:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057070c0 x1874670273080320/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828623 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828598.932106:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828598.932109:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828598.932111:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273080320:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787828598.932121:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273080448:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787828598.932133:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828598.932139:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828598/real 1787828598]  req@ffff9ee005704000 x1874670273080448/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828623 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828598.932146:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704000 x1874670273080448/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828623 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828598.932151:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828598.932154:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828598.932156:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273080448:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787828598.932159:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273080576:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787828598.932168:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828598.932174:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828598/real 1787828598]  req@ffff9ee005706d00 x1874670273080576/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828623 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828598.932181:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706d00 x1874670273080576/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828623 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828598.932186:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828598.932187:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828598.932189:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273080576:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787828598.932192:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273080704:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787828598.932201:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828598.932206:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828598/real 1787828598]  req@ffff9ee005705680 x1874670273080704/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828623 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828598.932212:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705680 x1874670273080704/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828623 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828598.932217:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828598.932219:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828598.932221:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273080704:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828599.763495:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828599.955389:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828600.787500:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828600.979397:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828601.811511:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828602.003435:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828602.835437:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828603.027426:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828603.859486:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1787828604.051432:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828604.051440:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787828604.051444:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828604.051452:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3767
00000100:00100000:1.0:1787828604.051461:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:2.0:1787828604.051462:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828604.051471:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787828604.051503:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572ad00 x1874670273080832/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828604.051524:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828604.051527:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787828604.051528:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828604.051531:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3767
00000100:00080000:2.0:1787828604.051533:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828604.051536:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828604.051544:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787828604.051553:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b480 x1874670273080960/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787828604.051557:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273080832:192.168.203.121@tcp:250:kworker.0
00000100:00080000:2.0:1787828604.051566:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828604.051569:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787828604.051570:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828604.051573:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3767
00000100:00080000:2.0:1787828604.051575:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828604.051578:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828604.051581:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828604.051588:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b0c0 x1874670273081088/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828604.051594:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828604.051596:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787828604.051597:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828604.051600:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3767
00000100:00080000:2.0:1787828604.051603:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828604.051605:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828604.051608:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828604.051615:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729a40 x1874670273081216/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828604.051622:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828604.051624:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787828604.051625:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828604.051627:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3767
00000100:00080000:2.0:1787828604.051630:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828604.051634:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000800:00000100:3.0:1787828604.051638:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000008:00100000:2.0:1787828604.051639:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787828604.051649:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b840 x1874670273081344/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828604.051657:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828604.051661:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787828604.051663:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828604.051667:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3767
00000100:00080000:2.0:1787828604.051671:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828604.051676:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828604.051682:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787828604.051689:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828604/real 1787828604]  req@ffff9ee00572ad00 x1874670273080832/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828629 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828604.051697:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728f00 x1874670273081472/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787828604.051708:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572ad00 x1874670273080832/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828629 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828604.051711:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828604.051719:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787828604.051722:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828604.051727:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3767
00000100:00080000:3.0:1787828604.051727:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828604.051735:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828604.051735:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:2.0:1787828604.051742:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787828604.051743:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273080832:192.168.203.121@tcp:250:kworker.0
00000008:00100000:2.0:1787828604.051748:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828604.051760:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728b40 x1874670273081600/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787828604.051770:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273080960:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787828604.051792:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787828604.051801:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828604/real 1787828604]  req@ffff9ee00572b480 x1874670273080960/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828629 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787828604.051810:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b480 x1874670273080960/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828629 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828604.051815:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787828604.051818:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787828604.051820:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273080960:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787828604.051824:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273081088:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787828604.051836:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787828604.051842:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828604/real 1787828604]  req@ffff9ee00572b0c0 x1874670273081088/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828629 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787828604.051849:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b0c0 x1874670273081088/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828629 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828604.051854:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787828604.051856:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787828604.051857:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273081088:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787828604.051861:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273081216:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787828604.051875:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787828604.051886:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828604/real 1787828604]  req@ffff9ee005729a40 x1874670273081216/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828629 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787828604.051898:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729a40 x1874670273081216/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828629 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828604.051907:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787828604.051911:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787828604.051914:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273081216:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787828604.051921:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273081344:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787828604.051942:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787828604.051955:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828604/real 1787828604]  req@ffff9ee00572b840 x1874670273081344/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828629 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787828604.051967:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b840 x1874670273081344/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828629 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828604.051975:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787828604.051978:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787828604.051982:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273081344:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787828604.051988:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273081472:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787828604.052008:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787828604.052020:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828604/real 1787828604]  req@ffff9ee005728f00 x1874670273081472/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828629 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787828604.052031:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728f00 x1874670273081472/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828629 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828604.052039:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787828604.052042:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787828604.052060:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273081472:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787828604.052081:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273081600:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787828604.052103:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787828604.052115:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828604/real 1787828604]  req@ffff9ee005728b40 x1874670273081600/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828629 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787828604.052127:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728b40 x1874670273081600/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828629 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828604.052136:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787828604.052140:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787828604.052143:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273081600:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828604.883492:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828605.075424:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828605.907464:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828606.099427:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828606.931537:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828607.123433:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828607.955453:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828608.147435:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828608.979452:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1787828609.171398:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1787828609.171399:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:2.0:1787828609.171408:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787828609.171413:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828609.171421:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3772
00000100:00080000:2.0:1787828609.171430:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828609.171436:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787828609.171468:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a580 x1874670273081728/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828609.171486:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828609.171489:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787828609.171490:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828609.171493:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3772
00000100:00080000:2.0:1787828609.171496:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828609.171499:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828609.171506:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787828609.171514:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728000 x1874670273081856/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828609.171529:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828609.171532:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787828609.171535:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1787828609.171536:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273081728:192.168.203.121@tcp:250:kworker.0
00000100:00080000:2.0:1787828609.171539:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3772
00000100:00080000:2.0:1787828609.171544:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828609.171549:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828609.171552:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828609.171559:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057283c0 x1874670273081984/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828609.171565:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828609.171568:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787828609.171569:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828609.171571:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3772
00000100:00080000:2.0:1787828609.171574:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828609.171575:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828609.171578:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828609.171585:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a1c0 x1874670273082112/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828609.171596:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828609.171598:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787828609.171599:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828609.171602:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3772
00000100:00080000:2.0:1787828609.171604:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828609.171606:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828609.171609:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787828609.171614:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729e00 x1874670273082240/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828609.171619:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828609.171622:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787828609.171623:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828609.171625:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3772
00000100:00080000:2.0:1787828609.171627:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828609.171629:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828609.171631:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828609.171637:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a940 x1874670273082368/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828609.171642:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828609.171644:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787828609.171645:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828609.171647:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3772
00000100:00080000:2.0:1787828609.171650:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000800:00000100:3.0:1787828609.171656:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:2.0:1787828609.171657:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828609.171663:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828609.171670:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728780 x1874670273082496/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787828609.171708:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828609/real 1787828609]  req@ffff9ee00572a580 x1874670273081728/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828634 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787828609.171729:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a580 x1874670273081728/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828634 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828609.171742:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787828609.171747:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787828609.171751:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273081728:192.168.203.121@tcp:250:kworker.0
00000100:00100000:3.0:1787828609.171776:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273081856:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787828609.171809:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787828609.171824:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828609/real 1787828609]  req@ffff9ee005728000 x1874670273081856/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828634 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787828609.171839:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728000 x1874670273081856/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828634 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828609.171849:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787828609.171853:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787828609.171857:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273081856:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787828609.171864:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273081984:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787828609.172106:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787828609.172173:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828609/real 1787828609]  req@ffff9ee0057283c0 x1874670273081984/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828634 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787828609.172190:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057283c0 x1874670273081984/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828634 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828609.172200:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787828609.172204:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787828609.172208:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273081984:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787828609.172215:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273082112:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787828609.172240:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787828609.172253:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828609/real 1787828609]  req@ffff9ee00572a1c0 x1874670273082112/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828634 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787828609.172275:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a1c0 x1874670273082112/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828634 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828609.172284:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787828609.172287:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787828609.172291:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273082112:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787828609.172297:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273082240:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787828609.172344:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787828609.172361:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828609/real 1787828609]  req@ffff9ee005729e00 x1874670273082240/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828634 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787828609.172378:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729e00 x1874670273082240/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828634 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828609.172387:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787828609.172391:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787828609.172394:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273082240:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787828609.172402:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273082368:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787828609.172425:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787828609.172437:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828609/real 1787828609]  req@ffff9ee00572a940 x1874670273082368/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828634 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787828609.172450:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a940 x1874670273082368/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828634 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828609.172465:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787828609.172468:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787828609.172472:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273082368:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787828609.172479:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273082496:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787828609.172499:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787828609.172511:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828609/real 1787828609]  req@ffff9ee005728780 x1874670273082496/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828634 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787828609.172524:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728780 x1874670273082496/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828634 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828609.172533:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787828609.172536:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787828609.172539:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273082496:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828610.003481:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828610.195423:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828611.027485:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828611.219401:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828612.051496:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828612.243401:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828613.075531:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828613.267412:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828614.099445:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828614.291405:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:2.0:1787828614.291407:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828614.291417:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787828614.291421:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828614.291432:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3778
00000100:00080000:2.0:1787828614.291442:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828614.291457:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787828614.291494:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729680 x1874670273082624/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828614.291518:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828614.291523:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787828614.291525:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828614.291529:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3778
00000100:00080000:2.0:1787828614.291533:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828614.291538:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828614.291549:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787828614.291555:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273082624:192.168.203.121@tcp:250:kworker.0
00000100:00100000:2.0:1787828614.291564:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057292c0 x1874670273082752/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828614.291585:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828614.291589:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787828614.291590:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828614.291594:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3778
00000100:00080000:2.0:1787828614.291606:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828614.291610:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828614.291615:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:3.0:1787828614.291621:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828614.291631:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572bc00 x1874670273082880/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828614.291642:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828614.291646:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787828614.291648:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828614.291653:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3778
00000100:00080000:2.0:1787828614.291657:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1787828614.291661:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828614/real 1787828614]  req@ffff9ee005729680 x1874670273082624/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828639 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828614.291665:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828614.291672:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787828614.291687:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729680 x1874670273082624/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828639 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828614.291699:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728780 x1874670273083008/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828614.291700:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787828614.291711:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787828614.291721:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273082624:192.168.203.121@tcp:250:kworker.0
00000100:00080000:2.0:1787828614.291722:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828614.291731:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787828614.291734:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828614.291740:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3778
00000100:00080000:2.0:1787828614.291745:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1787828614.291750:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057292c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273082752:192.168.203.121@tcp:38:kworker.0
00000100:00080000:2.0:1787828614.291752:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828614.291762:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787828614.291777:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a940 x1874670273083136/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828614.291789:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:3.0:1787828614.291795:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:2.0:1787828614.291796:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787828614.291810:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1787828614.291813:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828614/real 1787828614]  req@ffff9ee0057292c0 x1874670273082752/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828639 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828614.291821:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3778
00000100:00080000:2.0:1787828614.291829:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828614.291836:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787828614.291836:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057292c0 x1874670273082752/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828639 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:2.0:1787828614.291845:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:3.0:1787828614.291852:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787828614.291859:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828614.291864:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729e00 x1874670273083264/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787828614.291867:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057292c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273082752:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787828614.291881:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273082880:192.168.203.121@tcp:8:kworker.0
00000100:00080000:2.0:1787828614.291884:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828614.291890:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787828614.291893:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828614.291898:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3778
00000100:00080000:2.0:1787828614.291903:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828614.291909:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000800:00000100:3.0:1787828614.291910:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000008:00100000:2.0:1787828614.291917:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787828614.291927:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828614/real 1787828614]  req@ffff9ee00572bc00 x1874670273082880/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828639 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828614.291932:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a1c0 x1874670273083392/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787828614.291957:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572bc00 x1874670273082880/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828639 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828614.291973:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787828614.291994:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787828614.292002:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273082880:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787828614.292009:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273083008:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787828614.292029:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787828614.292040:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828614/real 1787828614]  req@ffff9ee005728780 x1874670273083008/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828639 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787828614.292053:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728780 x1874670273083008/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828639 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828614.292061:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787828614.292065:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787828614.292068:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273083008:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787828614.292085:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273083136:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787828614.292101:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787828614.292111:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828614/real 1787828614]  req@ffff9ee00572a940 x1874670273083136/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828639 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787828614.292124:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a940 x1874670273083136/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828639 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828614.292132:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787828614.292136:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787828614.292139:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273083136:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787828614.292144:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273083264:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787828614.292159:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787828614.292169:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828614/real 1787828614]  req@ffff9ee005729e00 x1874670273083264/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828639 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787828614.292188:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729e00 x1874670273083264/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828639 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828614.292197:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787828614.292200:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787828614.292204:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273083264:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787828614.292210:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273083392:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787828614.292226:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787828614.292236:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828614/real 1787828614]  req@ffff9ee00572a1c0 x1874670273083392/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828639 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787828614.292247:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a1c0 x1874670273083392/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828639 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828614.292256:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787828614.292260:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787828614.292263:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273083392:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828615.123525:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828615.315396:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828616.147465:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828616.339390:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828617.171432:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828617.363365:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828618.195471:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828618.387379:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828619.219429:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828619.411386:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787828619.411439:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828619.411447:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787828619.411453:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828619.411468:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3783
00000100:00080000:3.0:1787828619.411482:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828619.411499:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787828619.411541:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057061c0 x1874670273083520/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828619.411572:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828619.411576:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787828619.411578:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828619.411581:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3783
00000100:00080000:3.0:1787828619.411586:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828619.411590:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828619.411600:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787828619.411613:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707c00 x1874670273083648/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787828619.411616:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273083520:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787828619.411642:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828619.411645:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787828619.411647:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828619.411652:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3783
00000100:00080000:3.0:1787828619.411655:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828619.411658:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828619.411662:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787828619.411673:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705680 x1874670273083776/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828619.411679:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828619.411682:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787828619.411683:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828619.411686:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3783
00000100:00080000:3.0:1787828619.411692:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828619.411695:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828619.411699:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787828619.411706:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706d00 x1874670273083904/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1787828619.411714:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787828619.411734:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828619.411738:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787828619.411739:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828619.411743:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3783
00000100:00080000:3.0:1787828619.411746:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828619.411751:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828619.411755:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787828619.411764:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704000 x1874670273084032/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787828619.411769:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828619/real 1787828619]  req@ffff9ee0057061c0 x1874670273083520/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828644 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828619.411779:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828619.411782:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787828619.411783:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828619.411788:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3783
00000100:00080000:3.0:1787828619.411796:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828619.411807:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828619.411820:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787828619.411841:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057070c0 x1874670273084160/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787828619.411843:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057061c0 x1874670273083520/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828644 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828619.411874:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828619.411883:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787828619.411887:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828619.411893:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3783
00000100:00080000:2.0:1787828619.411894:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787828619.411903:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828619.411908:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:3.0:1787828619.411912:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787828619.411918:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273083520:192.168.203.121@tcp:250:kworker.0
00000008:00100000:3.0:1787828619.411919:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787828619.411952:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706940 x1874670273084288/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787828619.411978:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273083648:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787828619.412010:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828619.412023:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828619/real 1787828619]  req@ffff9ee005707c00 x1874670273083648/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828644 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828619.412034:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707c00 x1874670273083648/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828644 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828619.412040:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828619.412042:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828619.412045:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273083648:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787828619.412050:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273083776:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787828619.412066:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828619.412081:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828619/real 1787828619]  req@ffff9ee005705680 x1874670273083776/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828644 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828619.412089:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705680 x1874670273083776/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828644 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828619.412095:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828619.412097:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828619.412100:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273083776:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787828619.412104:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273083904:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787828619.412115:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828619.412120:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828619/real 1787828619]  req@ffff9ee005706d00 x1874670273083904/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828644 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828619.412133:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706d00 x1874670273083904/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828644 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828619.412139:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828619.412143:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828619.412145:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273083904:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787828619.412150:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273084032:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787828619.412161:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828619.412171:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828619/real 1787828619]  req@ffff9ee005704000 x1874670273084032/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828644 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828619.412191:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704000 x1874670273084032/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828644 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828619.412199:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828619.412203:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828619.412207:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273084032:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787828619.412212:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273084160:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787828619.412229:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828619.412237:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828619/real 1787828619]  req@ffff9ee0057070c0 x1874670273084160/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828644 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828619.412244:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057070c0 x1874670273084160/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828644 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828619.412256:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828619.412259:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828619.412261:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273084160:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787828619.412265:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273084288:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787828619.412278:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828619.412284:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828619/real 1787828619]  req@ffff9ee005706940 x1874670273084288/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828644 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828619.412291:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706940 x1874670273084288/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828644 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828619.412300:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828619.412302:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828619.412304:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273084288:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828620.243481:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828620.435418:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828621.267458:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828621.459386:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828622.291452:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828622.483382:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828623.315458:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828623.507391:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828624.339493:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1787828624.531404:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1787828624.531405:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787828624.531414:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787828624.531417:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828624.531426:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3788
00000100:00080000:3.0:1787828624.531435:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828624.531442:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787828624.531480:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057052c0 x1874670273084416/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828624.531517:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828624.531520:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787828624.531522:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828624.531526:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3788
00000100:00080000:3.0:1787828624.531529:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828624.531533:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828624.531543:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787828624.531557:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707480 x1874670273084544/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787828624.531569:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273084416:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787828624.531573:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828624.531578:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787828624.531580:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828624.531584:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3788
00000100:00080000:3.0:1787828624.531588:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828624.531591:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828624.531595:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787828624.531607:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707840 x1874670273084672/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828624.531614:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828624.531617:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787828624.531618:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828624.531621:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3788
00000100:00080000:3.0:1787828624.531623:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828624.531625:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000800:00000100:2.0:1787828624.531630:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000008:00100000:3.0:1787828624.531630:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787828624.531640:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057043c0 x1874670273084800/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828624.531649:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828624.531651:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787828624.531652:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828624.531655:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3788
00000100:00080000:3.0:1787828624.531658:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828624.531661:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828624.531664:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787828624.531674:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706580 x1874670273084928/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787828624.531680:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828624/real 1787828624]  req@ffff9ee0057052c0 x1874670273084416/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828649 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828624.531683:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828624.531692:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787828624.531695:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828624.531700:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3788
00000100:00080000:3.0:1787828624.531703:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828624.531705:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828624.531709:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828624.531710:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057052c0 x1874670273084416/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828649 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787828624.531717:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704b40 x1874670273085056/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828624.531737:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787828624.531737:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828624.531744:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787828624.531746:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828624.531748:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:3.0:1787828624.531751:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3788
00000100:00080000:3.0:1787828624.531755:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1787828624.531759:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273084416:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787828624.531761:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828624.531769:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787828624.531776:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705e00 x1874670273085184/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787828624.531792:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273084544:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787828624.531815:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828624.531825:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828624/real 1787828624]  req@ffff9ee005707480 x1874670273084544/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828649 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828624.531834:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707480 x1874670273084544/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828649 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828624.531840:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828624.531843:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828624.531845:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273084544:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787828624.531849:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273084672:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787828624.531861:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828624.531867:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828624/real 1787828624]  req@ffff9ee005707840 x1874670273084672/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828649 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828624.531874:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707840 x1874670273084672/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828649 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828624.531879:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828624.531881:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828624.531883:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273084672:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787828624.531887:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273084800:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787828624.531917:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828624.531930:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828624/real 1787828624]  req@ffff9ee0057043c0 x1874670273084800/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828649 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828624.531943:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057043c0 x1874670273084800/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828649 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828624.531952:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828624.531955:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828624.531959:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273084800:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787828624.531966:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273084928:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787828624.531987:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828624.532000:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828624/real 1787828624]  req@ffff9ee005706580 x1874670273084928/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828649 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828624.532013:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706580 x1874670273084928/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828649 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828624.532018:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828624.532021:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828624.532023:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273084928:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787828624.532027:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273085056:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787828624.532042:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828624.532049:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828624/real 1787828624]  req@ffff9ee005704b40 x1874670273085056/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828649 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828624.532056:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704b40 x1874670273085056/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828649 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828624.532061:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828624.532063:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828624.532065:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273085056:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787828624.532077:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273085184:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787828624.532088:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828624.532094:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828624/real 1787828624]  req@ffff9ee005705e00 x1874670273085184/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828649 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828624.532112:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705e00 x1874670273085184/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828649 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828624.532121:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828624.532124:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828624.532127:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273085184:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828625.363470:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828625.555413:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828626.387455:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828626.579434:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828627.411484:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828627.603398:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828628.435513:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828628.627433:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828629.459475:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828629.651394:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:0.0:1787828629.651411:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828629.651416:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1787828629.651420:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828629.651427:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3793
00000100:00080000:0.0:1787828629.651437:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828629.651443:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787828629.651476:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9e00 x1874670273085312/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828629.651503:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828629.651507:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787828629.651509:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828629.651514:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3793
00000100:00080000:0.0:1787828629.651518:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828629.651523:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828629.651534:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787828629.651542:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273085312:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787828629.651549:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8b40 x1874670273085440/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828629.651558:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828629.651561:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787828629.651562:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828629.651565:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3793
00000100:00080000:0.0:1787828629.651568:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828629.651571:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828629.651575:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828629.651584:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e92c0 x1874670273085568/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828629.651590:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828629.651593:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787828629.651594:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828629.651596:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3793
00000100:00080000:0.0:1787828629.651598:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828629.651602:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000800:00000100:2.0:1787828629.651605:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000008:00100000:0.0:1787828629.651606:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828629.651614:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb840 x1874670273085696/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828629.651621:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828629.651623:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787828629.651625:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828629.651629:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3793
00000100:00080000:0.0:1787828629.651631:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828629.651633:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828629.651636:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787828629.651643:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb480 x1874670273085824/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828629.651649:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828629.651652:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787828629.651655:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1787828629.651655:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828629/real 1787828629]  req@ffff9ee0056e9e00 x1874670273085312/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828654 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828629.651663:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3793
00000100:00080000:0.0:1787828629.651666:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828629.651671:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828629.651677:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828629.651686:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8000 x1874670273085952/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787828629.651692:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9e00 x1874670273085312/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828654 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828629.651695:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828629.651700:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787828629.651703:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828629.651710:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3793
00000100:00080000:0.0:1787828629.651717:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828629.651718:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787828629.651722:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00080000:2.0:1787828629.651727:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000008:00100000:0.0:1787828629.651731:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828629.651735:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273085312:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787828629.651747:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e83c0 x1874670273086080/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787828629.651761:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273085440:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787828629.651787:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828629.651800:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828629/real 1787828629]  req@ffff9ee0056e8b40 x1874670273085440/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828654 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828629.651812:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8b40 x1874670273085440/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828654 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828629.651819:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828629.651821:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828629.651823:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273085440:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787828629.651827:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273085568:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787828629.651842:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828629.651848:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828629/real 1787828629]  req@ffff9ee0056e92c0 x1874670273085568/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828654 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828629.651855:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e92c0 x1874670273085568/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828654 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828629.651861:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828629.651862:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828629.651864:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273085568:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787828629.651882:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273085696:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787828629.651896:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828629.651903:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828629/real 1787828629]  req@ffff9ee0056eb840 x1874670273085696/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828654 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828629.651911:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb840 x1874670273085696/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828654 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828629.651916:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828629.651918:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828629.651920:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273085696:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787828629.651924:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273085824:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787828629.651934:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828629.651939:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828629/real 1787828629]  req@ffff9ee0056eb480 x1874670273085824/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828654 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828629.651946:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb480 x1874670273085824/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828654 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828629.651951:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828629.651953:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828629.651954:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273085824:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787828629.651958:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273085952:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787828629.651967:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828629.651972:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828629/real 1787828629]  req@ffff9ee0056e8000 x1874670273085952/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828654 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828629.651978:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8000 x1874670273085952/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828654 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828629.651983:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828629.651985:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828629.651987:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273085952:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787828629.651999:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273086080:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787828629.652008:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828629.652015:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828629/real 1787828629]  req@ffff9ee0056e83c0 x1874670273086080/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828654 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828629.652022:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e83c0 x1874670273086080/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828654 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828629.652027:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828629.652028:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828629.652030:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273086080:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828630.483488:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828630.675425:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828631.507517:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828631.699380:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828632.531596:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828632.723427:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828633.555447:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828633.747377:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828634.579523:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828634.771445:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:2.0:1787828634.771519:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828634.771528:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787828634.771533:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828634.771545:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3798
00000100:00080000:2.0:1787828634.771558:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828634.771567:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787828634.771613:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057283c0 x1874670273086208/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828634.771654:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828634.771658:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787828634.771661:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828634.771666:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3798
00000100:00080000:2.0:1787828634.771670:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828634.771674:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828634.771686:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787828634.771703:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728000 x1874670273086336/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828634.771721:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1787828634.771721:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273086208:192.168.203.121@tcp:250:kworker.0
00000100:00080000:2.0:1787828634.771738:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787828634.771741:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828634.771747:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3798
00000100:00080000:2.0:1787828634.771751:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828634.771756:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828634.771763:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828634.771781:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a580 x1874670273086464/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828634.771793:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828634.771798:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787828634.771801:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828634.771805:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3798
00000100:00080000:2.0:1787828634.771810:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828634.771813:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828634.771818:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828634.771830:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728b40 x1874670273086592/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828634.771876:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828634.771880:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787828634.771883:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828634.771889:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3798
00000100:00080000:2.0:1787828634.771894:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828634.771900:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000800:00000100:3.0:1787828634.771907:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000008:00100000:2.0:1787828634.771914:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787828634.771933:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728f00 x1874670273086720/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828634.771948:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828634.771952:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787828634.771954:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828634.771958:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3798
00000100:00080000:2.0:1787828634.771964:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828634.771969:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828634.771976:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787828634.771982:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828634/real 1787828634]  req@ffff9ee0057283c0 x1874670273086208/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828659 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828634.772003:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b840 x1874670273086848/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787828634.772015:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057283c0 x1874670273086208/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828659 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828634.772058:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828634.772059:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787828634.772072:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:2.0:1787828634.772075:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787828634.772085:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1787828634.772086:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273086208:192.168.203.121@tcp:250:kworker.0
00000100:00080000:2.0:1787828634.772106:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3798
00000100:00080000:2.0:1787828634.772117:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828634.772123:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828634.772131:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787828634.772142:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273086336:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787828634.772153:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729a40 x1874670273086976/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1787828634.772208:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787828634.772240:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828634/real 1787828634]  req@ffff9ee005728000 x1874670273086336/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828659 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787828634.772259:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728000 x1874670273086336/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828659 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828634.772271:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787828634.772276:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787828634.772281:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273086336:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787828634.772289:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273086464:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787828634.772351:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787828634.772368:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828634/real 1787828634]  req@ffff9ee00572a580 x1874670273086464/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828659 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787828634.772383:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a580 x1874670273086464/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828659 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828634.772394:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787828634.772398:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787828634.772402:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273086464:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787828634.772410:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273086592:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787828634.772432:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787828634.772443:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828634/real 1787828634]  req@ffff9ee005728b40 x1874670273086592/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828659 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787828634.772457:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728b40 x1874670273086592/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828659 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828634.772467:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787828634.772470:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787828634.772474:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273086592:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787828634.772481:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273086720:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787828634.772501:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787828634.772511:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828634/real 1787828634]  req@ffff9ee005728f00 x1874670273086720/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828659 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787828634.772526:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728f00 x1874670273086720/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828659 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828634.772535:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787828634.772539:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787828634.772542:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273086720:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787828634.772549:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273086848:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787828634.772567:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787828634.772578:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828634/real 1787828634]  req@ffff9ee00572b840 x1874670273086848/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828659 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787828634.772591:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b840 x1874670273086848/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828659 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828634.772601:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787828634.772605:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787828634.772608:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273086848:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787828634.772635:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273086976:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787828634.772654:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787828634.772665:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828634/real 1787828634]  req@ffff9ee005729a40 x1874670273086976/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828659 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787828634.772691:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729a40 x1874670273086976/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828659 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828634.772708:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787828634.772715:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787828634.772721:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273086976:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828635.603544:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828635.795408:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828636.627505:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828636.819401:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828637.651506:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828637.843422:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828638.675443:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828638.867380:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828639.699478:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828639.891443:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:0.0:1787828639.891482:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828639.891497:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1787828639.891502:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828639.891514:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3803
00000100:00080000:0.0:1787828639.891526:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828639.891533:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787828639.891575:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8f00 x1874670273087104/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828639.891601:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828639.891604:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787828639.891605:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828639.891609:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3803
00000100:00080000:0.0:1787828639.891611:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828639.891613:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828639.891625:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787828639.891635:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ebc00 x1874670273087232/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828639.891643:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828639.891646:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787828639.891649:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828639.891653:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3803
00000100:00080000:0.0:1787828639.891655:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828639.891659:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828639.891666:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787828639.891667:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273087104:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787828639.891682:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e83c0 x1874670273087360/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828639.891692:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828639.891695:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787828639.891696:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828639.891700:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3803
00000100:00080000:0.0:1787828639.891703:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828639.891706:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828639.891709:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828639.891716:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8000 x1874670273087488/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828639.891724:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828639.891726:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787828639.891728:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828639.891731:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3803
00000100:00080000:0.0:1787828639.891736:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828639.891740:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828639.891743:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787828639.891750:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb480 x1874670273087616/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828639.891761:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:3.0:1787828639.891762:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:0.0:1787828639.891768:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787828639.891770:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828639.891774:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3803
00000100:00080000:0.0:1787828639.891778:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828639.891780:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828639.891784:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828639.891793:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb840 x1874670273087744/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828639.891812:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828639.891815:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787828639.891817:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828639.891820:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3803
00000100:00080000:0.0:1787828639.891825:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828639.891828:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828639.891832:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787828639.891837:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828639/real 1787828639]  req@ffff9ee0056e8f00 x1874670273087104/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828664 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787828639.891846:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e92c0 x1874670273087872/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787828639.891903:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8f00 x1874670273087104/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828664 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828639.891918:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787828639.891923:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787828639.891928:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273087104:192.168.203.121@tcp:250:kworker.0
00000100:00100000:3.0:1787828639.891936:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273087232:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787828639.891964:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787828639.891979:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828639/real 1787828639]  req@ffff9ee0056ebc00 x1874670273087232/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828664 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787828639.891992:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ebc00 x1874670273087232/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828664 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828639.892007:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787828639.892010:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787828639.892025:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273087232:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787828639.892053:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273087360:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787828639.892077:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787828639.892090:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828639/real 1787828639]  req@ffff9ee0056e83c0 x1874670273087360/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828664 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787828639.892103:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e83c0 x1874670273087360/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828664 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828639.892112:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787828639.892116:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787828639.892119:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273087360:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787828639.892127:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273087488:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787828639.892148:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787828639.892160:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828639/real 1787828639]  req@ffff9ee0056e8000 x1874670273087488/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828664 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787828639.892173:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8000 x1874670273087488/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828664 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828639.892181:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787828639.892185:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787828639.892189:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273087488:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787828639.892196:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273087616:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787828639.892218:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787828639.892239:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828639/real 1787828639]  req@ffff9ee0056eb480 x1874670273087616/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828664 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787828639.892253:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb480 x1874670273087616/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828664 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828639.892261:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787828639.892265:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787828639.892268:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273087616:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787828639.892276:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273087744:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787828639.892298:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787828639.892311:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828639/real 1787828639]  req@ffff9ee0056eb840 x1874670273087744/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828664 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787828639.892355:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb840 x1874670273087744/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828664 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828639.892364:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787828639.892367:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787828639.892371:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273087744:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787828639.892378:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273087872:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787828639.892401:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787828639.892414:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828639/real 1787828639]  req@ffff9ee0056e92c0 x1874670273087872/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828664 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787828639.892426:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e92c0 x1874670273087872/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828664 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828639.892434:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787828639.892437:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787828639.892440:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273087872:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828640.723546:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828640.915393:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828641.747470:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828641.939460:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828642.771478:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828642.963386:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828643.795466:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828643.987388:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828644.819540:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828645.011401:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787828645.011475:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828645.011484:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787828645.011490:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828645.011502:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3808
00000100:00080000:3.0:1787828645.011516:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828645.011525:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787828645.011591:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704780 x1874670273088000/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828645.011656:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828645.011663:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787828645.011667:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828645.011691:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3808
00000100:00080000:3.0:1787828645.011698:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828645.011713:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787828645.011715:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273088000:192.168.203.121@tcp:250:kworker.0
00000008:00100000:3.0:1787828645.011731:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000800:00000100:1.0:1787828645.011849:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828645.011896:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828645/real 1787828645]  req@ffff9ee005704780 x1874670273088000/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828670 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828645.011914:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704780 x1874670273088000/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828670 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828645.011924:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828645.011928:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828645.011932:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273088000:192.168.203.121@tcp:250:kworker.0
00000100:00100000:3.0:1787828645.011994:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705a40 x1874670273088128/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828645.012048:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1787828645.012049:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273088128:192.168.203.121@tcp:38:kworker.0
00000100:00080000:3.0:1787828645.012063:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787828645.012066:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828645.012071:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3808
00000100:00080000:3.0:1787828645.012075:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828645.012082:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828645.012090:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1787828645.012096:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787828645.012116:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704780 x1874670273088256/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828645.012131:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828645/real 1787828645]  req@ffff9ee005705a40 x1874670273088128/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828670 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828645.012132:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828645.012147:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787828645.012154:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1787828645.012164:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705a40 x1874670273088128/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828670 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828645.012182:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3808
00000100:00080000:1.0:1787828645.012184:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828645.012194:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00080000:3.0:1787828645.012196:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1787828645.012209:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273088128:192.168.203.121@tcp:38:kworker.0
00000100:00080000:3.0:1787828645.012213:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828645.012224:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787828645.012225:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273088256:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828645.012264:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828645.012272:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828645/real 1787828645]  req@ffff9ee005704780 x1874670273088256/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828670 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787828645.012288:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705e00 x1874670273088384/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828645.012292:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704780 x1874670273088256/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828670 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828645.012339:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828645.012344:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828645.012351:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273088256:192.168.203.121@tcp:8:kworker.0
00000100:00080000:3.0:1787828645.012368:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1787828645.012372:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273088384:192.168.203.121@tcp:8:kworker.0
00000100:00080000:3.0:1787828645.012377:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787828645.012389:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828645.012399:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3808
00000100:00080000:3.0:1787828645.012405:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000800:00000100:1.0:1787828645.012408:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787828645.012414:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828645.012422:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787828645.012430:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828645/real 1787828645]  req@ffff9ee005705e00 x1874670273088384/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828670 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787828645.012438:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704b40 x1874670273088512/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828645.012496:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828645.012499:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787828645.012503:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1787828645.012505:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705e00 x1874670273088384/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828670 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828645.012510:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3808
00000100:00080000:3.0:1787828645.012517:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828645.012527:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828645.012536:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:1.0:1787828645.012549:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:3.0:1787828645.012553:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706580 x1874670273088640/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787828645.012560:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828645.012576:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273088384:192.168.203.121@tcp:8:kworker.0
00000100:00080000:3.0:1787828645.012590:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828645.012597:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787828645.012601:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1787828645.012602:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273088512:192.168.203.121@tcp:38:kworker.0
00000100:00080000:3.0:1787828645.012622:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3808
00000100:00080000:3.0:1787828645.012647:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000800:00000100:1.0:1787828645.012652:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787828645.012661:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787828645.012666:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828645/real 1787828645]  req@ffff9ee005704b40 x1874670273088512/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828670 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:3.0:1787828645.012674:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787828645.012681:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704b40 x1874670273088512/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828670 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828645.012693:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828645.012703:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787828645.012705:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057043c0 x1874670273088768/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828645.012711:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273088512:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828645.012730:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273088640:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828645.012759:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828645.012791:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828645/real 1787828645]  req@ffff9ee005706580 x1874670273088640/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828670 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828645.012800:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706580 x1874670273088640/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828670 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828645.012806:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828645.012808:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828645.012811:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273088640:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828645.012821:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273088768:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828645.012835:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828645.012842:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828645/real 1787828645]  req@ffff9ee0057043c0 x1874670273088768/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828670 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828645.012849:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057043c0 x1874670273088768/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828670 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828645.012853:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828645.012855:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828645.012858:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273088768:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828645.843655:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828646.035444:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828646.867482:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828647.059396:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828647.891476:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828648.083384:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828648.915442:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828649.107418:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828649.939604:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828650.131463:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787828650.131463:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828650.131480:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787828650.131487:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828650.131529:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3813
00000100:00080000:3.0:1787828650.131546:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828650.131556:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787828650.131617:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707840 x1874670273088896/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828650.131657:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828650.131661:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787828650.131663:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828650.131667:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3813
00000100:00080000:3.0:1787828650.131672:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828650.131678:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828650.131693:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787828650.131707:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273088896:192.168.203.121@tcp:250:kworker.0
00000100:00100000:3.0:1787828650.131719:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707480 x1874670273089024/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828650.131750:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828650.131754:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787828650.131756:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828650.131760:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3813
00000100:00080000:3.0:1787828650.131764:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828650.131769:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828650.131775:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787828650.131795:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057052c0 x1874670273089152/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828650.131804:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828650.131808:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787828650.131809:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828650.131812:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3813
00000100:00080000:3.0:1787828650.131815:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828650.131818:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828650.131823:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787828650.131832:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706940 x1874670273089280/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828650.131841:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828650.131844:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787828650.131847:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828650.131852:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3813
00000100:00080000:3.0:1787828650.131854:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828650.131857:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828650.131865:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787828650.131871:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273089024:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787828650.131880:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057070c0 x1874670273089408/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828650.131891:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828650.131895:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787828650.131898:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828650.131902:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3813
00000100:00080000:3.0:1787828650.131909:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828650.131915:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828650.131920:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787828650.131926:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273089152:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787828650.131936:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704000 x1874670273089536/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828650.131946:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828650.131950:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787828650.131952:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828650.131956:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3813
00000100:00080000:3.0:1787828650.131958:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828650.131966:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787828650.131967:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273089280:192.168.203.121@tcp:8:kworker.0
00000008:00100000:3.0:1787828650.131973:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787828650.131992:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706d00 x1874670273089664/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828650.132034:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273089408:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828650.132060:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273089536:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828650.132079:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273089664:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828650.963463:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828651.155405:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828651.987483:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828652.179394:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828653.011463:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828653.203428:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000400:00000100:2.0:1787828653.203560:0:2353:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.203.121:988
00000400:00000100:2.0:1787828653.203593:0:2353:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.203.121@tcp at host 192.168.203.121 was unreachable: the network or that node may be down, or Lustre may be misconfigured.
00000800:00000100:2.0:1787828653.203606:0:2353:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:2.0:1787828653.203637:0:2353:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:2.0:1787828653.203643:0:2353:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:2.0:1787828653.203648:0:2353:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:2.0:1787828653.203653:0:2353:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:2.0:1787828653.203658:0:2353:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:2.0:1787828653.203663:0:2353:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000100:00100000:1.0:1787828653.203735:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828650/real 1787828653]  req@ffff9ee0057070c0 x1874670273089408/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828675 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828653.203765:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057070c0 x1874670273089408/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828675 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828653.203777:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828653.203782:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828653.203787:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273089408:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828653.203795:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828650/real 1787828653]  req@ffff9ee005704000 x1874670273089536/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828675 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828653.203807:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704000 x1874670273089536/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828675 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828653.203814:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828653.203818:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828653.203822:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273089536:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828653.203828:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828650/real 1787828653]  req@ffff9ee005706d00 x1874670273089664/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828675 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828653.203839:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706d00 x1874670273089664/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828675 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828653.203846:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828653.203849:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828653.203852:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273089664:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828653.203858:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828650/real 1787828653]  req@ffff9ee005707480 x1874670273089024/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828675 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828653.203869:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707480 x1874670273089024/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828675 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828653.203876:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828653.203880:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828653.203883:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273089024:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828653.203890:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828650/real 1787828653]  req@ffff9ee0057052c0 x1874670273089152/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828675 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828653.203900:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057052c0 x1874670273089152/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828675 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828653.203907:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828653.203910:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828653.203913:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273089152:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828653.203918:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828650/real 1787828653]  req@ffff9ee005706940 x1874670273089280/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828675 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828653.203947:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706940 x1874670273089280/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828675 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828653.203954:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828653.203957:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828653.203960:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273089280:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828653.203966:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828650/real 1787828653]  req@ffff9ee005707840 x1874670273088896/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828675 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828653.203976:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707840 x1874670273088896/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828675 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828653.203983:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828653.203986:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828653.203990:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273088896:192.168.203.121@tcp:250:kworker.0
00010000:00010000:3.0:1787828654.035476:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828654.227399:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828655.059566:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1787828655.251450:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1787828655.251456:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787828655.251463:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787828655.251469:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828655.251479:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3818
00000100:00080000:3.0:1787828655.251490:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828655.251498:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787828655.251535:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705680 x1874670273089792/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828655.251560:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828655.251563:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787828655.251565:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828655.251568:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3818
00000100:00080000:3.0:1787828655.251572:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828655.251576:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828655.251588:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787828655.251602:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273089792:192.168.203.121@tcp:250:kworker.0
00000100:00100000:3.0:1787828655.251608:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707c00 x1874670273089920/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828655.251623:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828655.251626:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787828655.251628:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828655.251632:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3818
00000100:00080000:3.0:1787828655.251637:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828655.251642:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828655.251648:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787828655.251662:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057061c0 x1874670273090048/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828655.251674:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828655.251677:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787828655.251679:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828655.251684:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3818
00000100:00080000:3.0:1787828655.251703:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828655.251708:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828655.251714:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1787828655.251725:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787828655.251734:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707840 x1874670273090176/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828655.251751:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828655.251755:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787828655.251757:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828655.251763:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3818
00000100:00080000:3.0:1787828655.251768:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828655.251772:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828655.251778:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787828655.251792:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706940 x1874670273090304/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828655.251804:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828655/real 1787828655]  req@ffff9ee005705680 x1874670273089792/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828680 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828655.251806:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828655.251827:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787828655.251832:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828655.251849:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3818
00000100:00080000:3.0:1787828655.251859:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1787828655.251867:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705680 x1874670273089792/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828680 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828655.251870:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828655.251898:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:1.0:1787828655.251905:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828655.251915:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787828655.251923:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057052c0 x1874670273090432/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828655.251925:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273089792:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787828655.251958:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828655.251963:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787828655.251966:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828655.251973:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3818
00000100:00080000:3.0:1787828655.251977:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828655.251982:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828655.251988:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787828655.252001:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273089920:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787828655.252004:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707480 x1874670273090560/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1787828655.252048:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828655.252068:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828655/real 1787828655]  req@ffff9ee005707c00 x1874670273089920/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828680 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828655.252082:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707c00 x1874670273089920/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828680 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828655.252091:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828655.252095:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828655.252099:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273089920:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828655.252106:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273090048:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828655.252131:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828655.252142:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828655/real 1787828655]  req@ffff9ee0057061c0 x1874670273090048/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828680 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828655.252155:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057061c0 x1874670273090048/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828680 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828655.252163:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828655.252166:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828655.252170:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273090048:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828655.252177:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273090176:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828655.252199:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828655.252211:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828655/real 1787828655]  req@ffff9ee005707840 x1874670273090176/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828680 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828655.252223:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707840 x1874670273090176/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828680 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828655.252232:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828655.252236:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828655.252240:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273090176:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828655.252247:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273090304:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787828655.252270:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828655.252283:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828655/real 1787828655]  req@ffff9ee005706940 x1874670273090304/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828680 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828655.252304:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706940 x1874670273090304/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828680 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828655.252313:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828655.252348:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828655.252351:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273090304:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828655.252357:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273090432:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828655.252380:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828655.252394:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828655/real 1787828655]  req@ffff9ee0057052c0 x1874670273090432/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828680 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828655.252408:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057052c0 x1874670273090432/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828680 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828655.252417:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828655.252421:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828655.252425:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273090432:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828655.252448:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273090560:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828655.252470:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828655.252482:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828655/real 1787828655]  req@ffff9ee005707480 x1874670273090560/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828680 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828655.252494:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707480 x1874670273090560/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828680 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828655.252508:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828655.252511:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828655.252515:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273090560:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828656.083546:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828656.275426:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828657.107534:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828657.299419:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828658.131496:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828658.323409:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828659.155590:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828659.347454:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828660.179463:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1787828660.371398:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1787828660.371410:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787828660.371410:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787828660.371414:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828660.371427:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3824
00000100:00080000:3.0:1787828660.371439:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828660.371446:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787828660.371485:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706d00 x1874670273090688/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828660.371514:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828660.371518:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787828660.371520:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828660.371523:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3824
00000100:00080000:3.0:1787828660.371527:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828660.371531:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828660.371541:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787828660.371551:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273090688:192.168.203.121@tcp:250:kworker.0
00000100:00100000:3.0:1787828660.371556:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704000 x1874670273090816/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828660.371569:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828660.371572:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787828660.371574:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828660.371578:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3824
00000100:00080000:3.0:1787828660.371581:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828660.371584:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828660.371589:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787828660.371602:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057070c0 x1874670273090944/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828660.371610:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828660.371613:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787828660.371614:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828660.371618:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3824
00000100:00080000:3.0:1787828660.371621:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000800:00000100:1.0:1787828660.371624:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787828660.371630:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828660.371636:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787828660.371649:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057043c0 x1874670273091072/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828660.371680:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828660.371684:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787828660.371686:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828660.371690:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3824
00000100:00080000:3.0:1787828660.371695:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1787828660.371697:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828660/real 1787828660]  req@ffff9ee005706d00 x1874670273090688/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828685 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828660.371705:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828660.371716:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787828660.371729:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706d00 x1874670273090688/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828685 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787828660.371736:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706580 x1874670273091200/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787828660.371748:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787828660.371753:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828660.371757:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:3.0:1787828660.371760:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787828660.371764:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1787828660.371765:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273090688:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787828660.371775:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3824
00000100:00080000:3.0:1787828660.371779:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828660.371782:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828660.371786:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787828660.371796:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704b40 x1874670273091328/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828660.371799:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273090816:192.168.203.121@tcp:38:kworker.0
00000100:00080000:3.0:1787828660.371833:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828660.371836:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787828660.371838:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828660.371842:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3824
00000100:00080000:3.0:1787828660.371846:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000800:00000100:1.0:1787828660.371850:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787828660.371853:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828660.371860:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787828660.371868:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828660/real 1787828660]  req@ffff9ee005704000 x1874670273090816/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828685 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787828660.371872:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705e00 x1874670273091456/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828660.371895:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704000 x1874670273090816/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828685 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828660.371921:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828660.371925:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828660.371928:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273090816:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828660.371934:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273090944:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828660.371961:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828660.371971:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828660/real 1787828660]  req@ffff9ee0057070c0 x1874670273090944/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828685 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828660.371981:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057070c0 x1874670273090944/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828685 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828660.371989:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828660.371991:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828660.371994:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273090944:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828660.371999:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273091072:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828660.372012:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828660.372019:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828660/real 1787828660]  req@ffff9ee0057043c0 x1874670273091072/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828685 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828660.372029:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057043c0 x1874670273091072/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828685 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828660.372055:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828660.372058:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828660.372062:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273091072:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828660.372068:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273091200:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787828660.372086:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828660.372095:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828660/real 1787828660]  req@ffff9ee005706580 x1874670273091200/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828685 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828660.372138:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706580 x1874670273091200/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828685 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828660.372147:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828660.372150:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828660.372154:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273091200:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828660.372202:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273091328:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828660.372226:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828660.372256:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828660/real 1787828660]  req@ffff9ee005704b40 x1874670273091328/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828685 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828660.372266:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704b40 x1874670273091328/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828685 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828660.372273:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828660.372276:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828660.372279:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273091328:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828660.372283:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273091456:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828660.372297:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828660.372305:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828660/real 1787828660]  req@ffff9ee005705e00 x1874670273091456/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828685 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828660.372315:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705e00 x1874670273091456/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828685 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828660.372321:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828660.372324:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828660.372326:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273091456:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828661.203498:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828661.395423:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828662.227526:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828662.419401:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828663.251455:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828663.443439:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828664.275471:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828664.467461:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828665.299531:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1787828665.491500:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1787828665.491501:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:0.0:1787828665.491512:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1787828665.491518:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828665.491528:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3829
00000100:00080000:0.0:1787828665.491551:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828665.491559:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787828665.491615:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8b40 x1874670273091584/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828665.491652:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828665.491655:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787828665.491656:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828665.491660:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3829
00000100:00080000:0.0:1787828665.491663:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828665.491666:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828665.491687:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787828665.491698:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9e00 x1874670273091712/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828665.491708:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1787828665.491709:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273091584:192.168.203.121@tcp:250:kworker.0
00000100:00080000:0.0:1787828665.491712:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787828665.491716:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828665.491721:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3829
00000100:00080000:0.0:1787828665.491724:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828665.491726:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828665.491729:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828665.491737:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb0c0 x1874670273091840/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828665.491743:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828665.491746:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787828665.491747:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828665.491750:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3829
00000100:00080000:0.0:1787828665.491753:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828665.491755:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828665.491758:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828665.491765:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9a40 x1874670273091968/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828665.491770:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828665.491779:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787828665.491780:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828665.491783:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3829
00000100:00080000:0.0:1787828665.491786:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828665.491789:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828665.491792:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000800:00000100:1.0:1787828665.491798:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787828665.491803:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9680 x1874670273092096/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828665.491811:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828665.491815:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787828665.491817:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828665.491822:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3829
00000100:00080000:0.0:1787828665.491828:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828665.491833:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828665.491838:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828665.491854:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8780 x1874670273092224/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828665.491858:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828665/real 1787828665]  req@ffff9ee0056e8b40 x1874670273091584/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828690 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828665.491884:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1787828665.491889:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8b40 x1874670273091584/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828690 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828665.491890:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787828665.491894:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828665.491904:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3829
00000100:00080000:0.0:1787828665.491911:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828665.491913:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787828665.491918:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00080000:1.0:1787828665.491923:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000008:00100000:0.0:1787828665.491927:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787828665.491931:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273091584:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787828665.491943:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ea940 x1874670273092352/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828665.491966:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273091712:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787828665.491995:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828665.492011:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828665/real 1787828665]  req@ffff9ee0056e9e00 x1874670273091712/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828690 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828665.492025:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9e00 x1874670273091712/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828690 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828665.492035:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828665.492039:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828665.492043:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273091712:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828665.492049:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273091840:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828665.492071:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828665.492084:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828665/real 1787828665]  req@ffff9ee0056eb0c0 x1874670273091840/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828690 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828665.492107:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb0c0 x1874670273091840/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828690 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828665.492117:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828665.492120:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828665.492124:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273091840:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828665.492131:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273091968:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828665.492151:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828665.492164:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828665/real 1787828665]  req@ffff9ee0056e9a40 x1874670273091968/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828690 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828665.492198:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9a40 x1874670273091968/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828690 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828665.492207:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828665.492212:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828665.492216:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273091968:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828665.492223:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273092096:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787828665.492244:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828665.492257:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828665/real 1787828665]  req@ffff9ee0056e9680 x1874670273092096/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828690 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828665.492271:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9680 x1874670273092096/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828690 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828665.492290:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828665.492293:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828665.492297:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273092096:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828665.492304:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273092224:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828665.492352:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828665.492365:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828665/real 1787828665]  req@ffff9ee0056e8780 x1874670273092224/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828690 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828665.492377:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8780 x1874670273092224/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828690 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828665.492385:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828665.492389:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828665.492393:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273092224:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828665.492400:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273092352:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828665.492422:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828665.492434:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828665/real 1787828665]  req@ffff9ee0056ea940 x1874670273092352/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828690 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828665.492447:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ea940 x1874670273092352/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828690 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828665.492456:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828665.492460:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828665.492474:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273092352:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828666.323550:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828666.515450:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828667.347507:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828667.539448:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828668.371525:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828668.563460:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828669.395508:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828669.587467:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828670.419526:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1787828670.611453:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1787828670.611455:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:0.0:1787828670.611476:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1787828670.611482:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828670.611492:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3834
00000100:00080000:0.0:1787828670.611502:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828670.611527:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787828670.611579:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ead00 x1874670273092480/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828670.611645:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828670.611649:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787828670.611651:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828670.611655:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3834
00000100:00080000:0.0:1787828670.611658:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828670.611663:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828670.611672:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787828670.611687:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273092480:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787828670.611692:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ea580 x1874670273092608/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828670.611710:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828670.611716:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787828670.611719:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828670.611724:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3834
00000100:00080000:0.0:1787828670.611747:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828670.611755:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000800:00000100:1.0:1787828670.611759:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000008:00100000:0.0:1787828670.611765:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828670.611795:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ea940 x1874670273092736/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828670.611811:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828670.611814:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787828670.611816:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828670.611820:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3834
00000100:00080000:0.0:1787828670.611825:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828670.611830:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787828670.611835:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828670/real 1787828670]  req@ffff9ee0056ead00 x1874670273092480/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828695 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:0.0:1787828670.611838:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828670.611863:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8780 x1874670273092864/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828670.611865:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ead00 x1874670273092480/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828695 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828670.611909:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787828670.611911:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828670.611917:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:0.0:1787828670.611919:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787828670.611924:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1787828670.611929:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273092480:192.168.203.121@tcp:250:kworker.0
00000100:00080000:0.0:1787828670.611942:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3834
00000100:00080000:0.0:1787828670.611949:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1787828670.611953:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273092608:192.168.203.121@tcp:38:kworker.0
00000100:00080000:0.0:1787828670.611957:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828670.611994:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787828670.612011:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9680 x1874670273092992/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1787828670.612020:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:0.0:1787828670.612038:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828670.612043:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787828670.612045:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1787828670.612050:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828670/real 1787828670]  req@ffff9ee0056ea580 x1874670273092608/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828695 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828670.612052:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3834
00000100:00080000:0.0:1787828670.612062:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828670.612071:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787828670.612077:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ea580 x1874670273092608/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828695 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:0.0:1787828670.612078:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:1.0:1787828670.612095:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:0.0:1787828670.612106:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9a40 x1874670273093120/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787828670.612114:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00080000:0.0:1787828670.612128:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1787828670.612129:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273092608:192.168.203.121@tcp:38:kworker.0
00000100:00080000:0.0:1787828670.612135:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787828670.612140:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828670.612147:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3834
00000100:00100000:1.0:1787828670.612154:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273092736:192.168.203.121@tcp:8:kworker.0
00000100:00080000:0.0:1787828670.612155:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828670.612166:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828670.612175:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828670.612196:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb0c0 x1874670273093248/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1787828670.612204:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828670.612223:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828670/real 1787828670]  req@ffff9ee0056ea940 x1874670273092736/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828695 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828670.612237:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ea940 x1874670273092736/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828695 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828670.612246:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828670.612250:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828670.612253:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273092736:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828670.612259:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273092864:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828670.612275:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828670.612284:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828670/real 1787828670]  req@ffff9ee0056e8780 x1874670273092864/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828695 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828670.612295:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8780 x1874670273092864/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828695 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828670.612302:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828670.612304:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828670.612307:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273092864:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828670.612322:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273092992:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787828670.612337:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828670.612373:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828670/real 1787828670]  req@ffff9ee0056e9680 x1874670273092992/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828695 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828670.612384:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9680 x1874670273092992/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828695 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828670.612392:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828670.612395:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828670.612398:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273092992:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828670.612421:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273093120:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828670.612438:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828670.612446:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828670/real 1787828670]  req@ffff9ee0056e9a40 x1874670273093120/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828695 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828670.612456:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9a40 x1874670273093120/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828695 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828670.612463:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828670.612466:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828670.612495:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273093120:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828670.612501:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273093248:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828670.612516:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828670.612524:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828670/real 1787828670]  req@ffff9ee0056eb0c0 x1874670273093248/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828695 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828670.612534:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb0c0 x1874670273093248/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828695 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828670.612542:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828670.612544:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828670.612547:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273093248:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828671.443501:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828671.635444:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828672.467588:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828672.659392:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828673.491510:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828673.683408:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828674.515675:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828674.707398:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828675.539461:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1787828675.731410:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1787828675.731414:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:0.0:1787828675.731419:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1787828675.731424:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828675.731432:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3839
00000100:00080000:0.0:1787828675.731441:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828675.731448:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787828675.731493:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9e00 x1874670273093376/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828675.731518:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828675.731521:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787828675.731522:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828675.731525:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3839
00000100:00080000:0.0:1787828675.731527:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828675.731531:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828675.731539:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787828675.731561:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8b40 x1874670273093504/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828675.731565:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273093376:192.168.203.121@tcp:250:kworker.0
00000100:00080000:0.0:1787828675.731575:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828675.731579:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787828675.731580:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828675.731584:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3839
00000100:00080000:0.0:1787828675.731588:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828675.731599:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828675.731603:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828675.731614:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e92c0 x1874670273093632/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828675.731621:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828675.731623:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787828675.731625:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828675.731627:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3839
00000100:00080000:0.0:1787828675.731637:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828675.731639:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828675.731643:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1787828675.731647:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787828675.731654:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb840 x1874670273093760/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828675.731663:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828675.731665:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787828675.731667:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828675.731669:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3839
00000100:00080000:0.0:1787828675.731672:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828675.731674:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828675.731677:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787828675.731686:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb480 x1874670273093888/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828675.731694:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1787828675.731694:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828675/real 1787828675]  req@ffff9ee0056e9e00 x1874670273093376/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828700 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828675.731702:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787828675.731705:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828675.731712:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3839
00000100:00080000:0.0:1787828675.731717:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828675.731720:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828675.731723:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787828675.731728:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9e00 x1874670273093376/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828700 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787828675.731733:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8000 x1874670273094016/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787828675.731753:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787828675.731761:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828675.731764:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:0.0:1787828675.731765:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787828675.731770:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1787828675.731774:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273093376:192.168.203.121@tcp:250:kworker.0
00000100:00080000:0.0:1787828675.731776:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3839
00000100:00080000:0.0:1787828675.731779:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828675.731793:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828675.731796:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828675.731803:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e83c0 x1874670273094144/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828675.731815:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273093504:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787828675.731840:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828675.731862:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828675/real 1787828675]  req@ffff9ee0056e8b40 x1874670273093504/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828700 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828675.731875:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8b40 x1874670273093504/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828700 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828675.731885:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828675.731888:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828675.731891:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273093504:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828675.731897:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273093632:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828675.731913:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828675.731922:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828675/real 1787828675]  req@ffff9ee0056e92c0 x1874670273093632/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828700 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828675.731934:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e92c0 x1874670273093632/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828700 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828675.731944:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828675.731947:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828675.731950:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273093632:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828675.731957:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273093760:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828675.731973:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828675.731982:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828675/real 1787828675]  req@ffff9ee0056eb840 x1874670273093760/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828700 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828675.731993:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb840 x1874670273093760/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828700 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828675.732002:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828675.732005:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828675.732008:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273093760:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828675.732014:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273093888:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787828675.732039:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828675.732047:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828675/real 1787828675]  req@ffff9ee0056eb480 x1874670273093888/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828700 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828675.732059:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb480 x1874670273093888/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828700 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828675.732067:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828675.732070:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828675.732073:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273093888:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828675.732078:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273094016:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828675.732094:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828675.732104:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828675/real 1787828675]  req@ffff9ee0056e8000 x1874670273094016/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828700 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828675.732116:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8000 x1874670273094016/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828700 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828675.732123:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828675.732127:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828675.732130:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273094016:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828675.732135:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273094144:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828675.732157:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828675.732167:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828675/real 1787828675]  req@ffff9ee0056e83c0 x1874670273094144/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828700 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828675.732178:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e83c0 x1874670273094144/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828700 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828675.732187:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828675.732189:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828675.732193:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273094144:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828676.563482:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828676.755412:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828677.587521:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828677.779401:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828678.611479:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828678.803516:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828679.635585:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828679.827498:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828680.659431:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828680.851452:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:2.0:1787828680.851494:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828680.851506:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787828680.851525:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828680.851538:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3844
00000100:00080000:2.0:1787828680.851554:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828680.851566:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787828680.851616:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b0c0 x1874670273094272/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828680.851657:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828680.851662:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787828680.851666:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828680.851671:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3844
00000100:00080000:2.0:1787828680.851678:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828680.851685:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828680.851698:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787828680.851717:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b480 x1874670273094400/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828680.851730:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828680.851735:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787828680.851737:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828680.851741:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3844
00000100:00080000:2.0:1787828680.851746:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828680.851752:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828680.851760:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787828680.851760:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273094272:192.168.203.121@tcp:250:kworker.0
00000100:00100000:2.0:1787828680.851783:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572ad00 x1874670273094528/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828680.851796:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828680.851800:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787828680.851803:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828680.851807:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3844
00000100:00080000:2.0:1787828680.851812:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828680.851816:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828680.851821:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828680.851835:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729a40 x1874670273094656/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828680.851844:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828680.851848:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787828680.851851:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828680.851855:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3844
00000100:00080000:2.0:1787828680.851860:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828680.851865:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828680.851870:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787828680.851884:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b840 x1874670273094784/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828680.851896:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828680.851901:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787828680.851903:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828680.851908:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3844
00000100:00080000:2.0:1787828680.851913:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828680.851918:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828680.851923:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828680.851937:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728f00 x1874670273094912/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828680.851949:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828680.851953:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787828680.851957:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828680.851961:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3844
00000100:00080000:2.0:1787828680.851965:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828680.851972:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828680.851978:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828680.851991:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728b40 x1874670273095040/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1787828680.852006:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787828680.852062:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828680/real 1787828680]  req@ffff9ee00572b0c0 x1874670273094272/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828705 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787828680.852084:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b0c0 x1874670273094272/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828705 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828680.852093:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787828680.852097:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787828680.852100:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273094272:192.168.203.121@tcp:250:kworker.0
00000100:00100000:3.0:1787828680.852121:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273094400:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787828680.852141:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787828680.852150:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828680/real 1787828680]  req@ffff9ee00572b480 x1874670273094400/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828705 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787828680.852158:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b480 x1874670273094400/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828705 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828680.852168:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787828680.852171:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787828680.852173:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273094400:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787828680.852177:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273094528:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787828680.852189:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787828680.852195:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828680/real 1787828680]  req@ffff9ee00572ad00 x1874670273094528/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828705 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787828680.852202:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572ad00 x1874670273094528/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828705 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828680.852207:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787828680.852209:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787828680.852211:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273094528:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787828680.852215:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273094656:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787828680.852232:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787828680.852243:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828680/real 1787828680]  req@ffff9ee005729a40 x1874670273094656/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828705 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787828680.852256:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729a40 x1874670273094656/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828705 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828680.852264:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787828680.852268:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787828680.852272:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273094656:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787828680.852279:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273094784:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787828680.852304:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787828680.852313:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828680/real 1787828680]  req@ffff9ee00572b840 x1874670273094784/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828705 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787828680.852344:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b840 x1874670273094784/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828705 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828680.852351:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787828680.852354:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787828680.852357:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273094784:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787828680.852363:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273094912:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787828680.852378:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787828680.852385:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828680/real 1787828680]  req@ffff9ee005728f00 x1874670273094912/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828705 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787828680.852393:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728f00 x1874670273094912/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828705 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828680.852397:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787828680.852399:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787828680.852401:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273094912:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787828680.852405:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273095040:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787828680.852415:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787828680.852421:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828680/real 1787828680]  req@ffff9ee005728b40 x1874670273095040/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828705 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787828680.852428:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728b40 x1874670273095040/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828705 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828680.852433:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787828680.852435:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787828680.852437:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273095040:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828681.683473:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828681.875369:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828682.707571:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828682.899375:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828683.731549:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828683.923364:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828684.755595:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828684.947375:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828685.779458:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828685.971395:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:2.0:1787828685.971439:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828685.971448:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787828685.971454:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828685.971465:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3849
00000100:00080000:2.0:1787828685.971493:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828685.971504:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787828685.971602:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a580 x1874670273095168/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828685.971640:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828685.971644:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787828685.971646:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828685.971652:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3849
00000100:00080000:2.0:1787828685.971664:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1787828685.971673:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273095168:192.168.203.121@tcp:250:kworker.0
00000100:00080000:2.0:1787828685.971675:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828685.971699:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787828685.971721:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728000 x1874670273095296/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828685.971733:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828685.971737:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787828685.971746:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828685.971750:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3849
00000100:00080000:2.0:1787828685.971754:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000800:00000100:3.0:1787828685.971761:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:2.0:1787828685.971763:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828685.971772:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828685.971786:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057283c0 x1874670273095424/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828685.971797:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828685.971801:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787828685.971802:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828685.971806:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3849
00000100:00080000:2.0:1787828685.971811:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828685.971815:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828685.971822:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787828685.971835:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828685/real 1787828685]  req@ffff9ee00572a580 x1874670273095168/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828710 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828685.971840:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a1c0 x1874670273095552/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828685.971890:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1787828685.971892:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a580 x1874670273095168/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828710 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828685.971901:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787828685.971905:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828685.971914:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3849
00000100:00080000:2.0:1787828685.971921:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828685.971944:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787828685.971952:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:2.0:1787828685.971953:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787828685.971967:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273095168:192.168.203.121@tcp:250:kworker.0
00000008:00100000:2.0:1787828685.971969:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787828685.972012:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729e00 x1874670273095680/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787828685.972034:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273095296:192.168.203.121@tcp:38:kworker.0
00000100:00080000:2.0:1787828685.972075:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:3.0:1787828685.972097:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:2.0:1787828685.972103:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787828685.972115:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1787828685.972116:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828685/real 1787828685]  req@ffff9ee005728000 x1874670273095296/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828710 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828685.972134:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3849
00000100:00080000:2.0:1787828685.972141:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1787828685.972143:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728000 x1874670273095296/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828710 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828685.972162:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828685.972168:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00080000:3.0:1787828685.972168:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787828685.972185:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273095296:192.168.203.121@tcp:38:kworker.0
00000008:00100000:2.0:1787828685.972188:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787828685.972195:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273095424:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787828685.972216:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a940 x1874670273095808/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1787828685.972227:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:2.0:1787828685.972253:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828685.972256:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787828685.972257:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828685.972261:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3849
00000100:00080000:2.0:1787828685.972265:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828685.972268:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787828685.972271:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828685/real 1787828685]  req@ffff9ee0057283c0 x1874670273095424/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828710 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:2.0:1787828685.972286:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787828685.972297:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057283c0 x1874670273095424/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828710 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828685.972305:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728780 x1874670273095936/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828685.972380:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787828685.972397:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787828685.972403:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273095424:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787828685.972411:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273095552:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787828685.972432:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787828685.972453:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828685/real 1787828685]  req@ffff9ee00572a1c0 x1874670273095552/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828710 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787828685.972468:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a1c0 x1874670273095552/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828710 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828685.972473:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787828685.972491:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787828685.972495:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273095552:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787828685.972511:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273095680:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787828685.972539:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787828685.972547:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828685/real 1787828685]  req@ffff9ee005729e00 x1874670273095680/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828710 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787828685.972556:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729e00 x1874670273095680/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828710 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828685.972562:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787828685.972564:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787828685.972567:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273095680:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787828685.972571:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273095808:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787828685.972581:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787828685.972588:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828685/real 1787828685]  req@ffff9ee00572a940 x1874670273095808/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828710 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787828685.972596:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a940 x1874670273095808/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828710 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828685.972605:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787828685.972608:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787828685.972610:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273095808:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787828685.972614:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273095936:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787828685.972624:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787828685.972630:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828685/real 1787828685]  req@ffff9ee005728780 x1874670273095936/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828710 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787828685.972637:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728780 x1874670273095936/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828710 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828685.972642:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787828685.972644:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787828685.972646:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273095936:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828686.803545:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828686.995371:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828687.827554:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828688.019460:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828688.851484:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828689.043522:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828689.875511:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828690.067442:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828690.899499:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1787828691.091410:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828691.091422:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787828691.091426:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1787828691.091435:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:2.0:1787828691.091438:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3854
00000100:00080000:2.0:1787828691.091463:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828691.091472:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787828691.091517:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572bc00 x1874670273096064/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828691.091542:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828691.091545:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787828691.091546:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828691.091549:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3854
00000100:00080000:2.0:1787828691.091552:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828691.091556:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828691.091564:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787828691.091574:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057292c0 x1874670273096192/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787828691.091583:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273096064:192.168.203.121@tcp:250:kworker.0
00000100:00080000:2.0:1787828691.091590:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828691.091593:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787828691.091594:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828691.091598:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3854
00000100:00080000:2.0:1787828691.091600:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828691.091603:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828691.091607:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828691.091617:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729680 x1874670273096320/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828691.091624:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828691.091626:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787828691.091628:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828691.091632:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3854
00000100:00080000:2.0:1787828691.091657:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828691.091660:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828691.091664:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828691.091677:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728780 x1874670273096448/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1787828691.091679:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:2.0:1787828691.091697:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828691.091700:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787828691.091701:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828691.091706:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3854
00000100:00080000:2.0:1787828691.091709:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828691.091712:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828691.091715:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787828691.091724:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a940 x1874670273096576/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828691.091730:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828691.091733:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787828691.091734:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828691.091736:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3854
00000100:00080000:2.0:1787828691.091738:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828691.091740:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828691.091743:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828691.091750:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729e00 x1874670273096704/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828691.091756:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1787828691.091759:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828691/real 1787828691]  req@ffff9ee00572bc00 x1874670273096064/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828716 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828691.091760:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787828691.091765:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828691.091781:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3854
00000100:00080000:2.0:1787828691.091791:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828691.091800:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828691.091815:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828691.091830:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a1c0 x1874670273096832/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787828691.091836:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572bc00 x1874670273096064/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828716 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828691.091873:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787828691.091878:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787828691.091889:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273096064:192.168.203.121@tcp:250:kworker.0
00000100:00100000:3.0:1787828691.091917:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057292c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273096192:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787828691.091938:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787828691.091949:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828691/real 1787828691]  req@ffff9ee0057292c0 x1874670273096192/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828716 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787828691.091958:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057292c0 x1874670273096192/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828716 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828691.091965:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787828691.091967:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787828691.091970:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057292c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273096192:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787828691.091974:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273096320:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787828691.091994:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787828691.092002:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828691/real 1787828691]  req@ffff9ee005729680 x1874670273096320/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828716 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787828691.092010:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729680 x1874670273096320/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828716 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828691.092020:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787828691.092023:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787828691.092025:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273096320:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787828691.092029:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273096448:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787828691.092040:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787828691.092047:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828691/real 1787828691]  req@ffff9ee005728780 x1874670273096448/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828716 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787828691.092059:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728780 x1874670273096448/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828716 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828691.092068:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787828691.092072:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787828691.092076:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273096448:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787828691.092083:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273096576:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787828691.092106:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787828691.092123:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828691/real 1787828691]  req@ffff9ee00572a940 x1874670273096576/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828716 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787828691.092132:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a940 x1874670273096576/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828716 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828691.092138:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787828691.092141:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787828691.092144:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273096576:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787828691.092149:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273096704:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787828691.092163:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787828691.092170:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828691/real 1787828691]  req@ffff9ee005729e00 x1874670273096704/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828716 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787828691.092178:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729e00 x1874670273096704/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828716 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828691.092187:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787828691.092190:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787828691.092194:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273096704:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787828691.092201:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273096832:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787828691.092223:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787828691.092236:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828691/real 1787828691]  req@ffff9ee00572a1c0 x1874670273096832/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828716 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787828691.092250:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a1c0 x1874670273096832/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828716 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828691.092259:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787828691.092263:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787828691.092283:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273096832:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828691.923567:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828692.115414:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828692.947499:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828693.139466:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828693.971546:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828694.163390:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828694.995605:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828695.187481:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828696.019531:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828696.211419:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:2.0:1787828696.211433:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828696.211440:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787828696.211444:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828696.211453:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3859
00000100:00080000:2.0:1787828696.211464:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828696.211470:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787828696.211502:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057283c0 x1874670273096960/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828696.211527:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828696.211530:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787828696.211532:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828696.211535:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3859
00000100:00080000:2.0:1787828696.211538:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828696.211541:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828696.211550:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787828696.211560:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273096960:192.168.203.121@tcp:250:kworker.0
00000100:00100000:2.0:1787828696.211562:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728000 x1874670273097088/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828696.211581:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828696.211584:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787828696.211585:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828696.211589:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3859
00000100:00080000:2.0:1787828696.211593:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828696.211599:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828696.211605:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828696.211632:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a580 x1874670273097216/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1787828696.211639:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:2.0:1787828696.211652:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828696.211657:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787828696.211661:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828696.211666:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3859
00000100:00080000:2.0:1787828696.211672:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828696.211677:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828696.211684:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787828696.211688:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828696/real 1787828696]  req@ffff9ee0057283c0 x1874670273096960/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828721 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828696.211701:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728b40 x1874670273097344/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787828696.211709:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057283c0 x1874670273096960/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828721 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828696.211714:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828696.211722:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787828696.211728:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:2.0:1787828696.211730:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00100000:3.0:1787828696.211734:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273096960:192.168.203.121@tcp:250:kworker.0
00000100:00080000:2.0:1787828696.211735:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828696.211746:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3859
00000100:00080000:2.0:1787828696.211751:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828696.211755:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828696.211759:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787828696.211764:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273097088:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787828696.211773:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728f00 x1874670273097472/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828696.211784:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:3.0:1787828696.211789:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:2.0:1787828696.211791:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787828696.211794:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828696.211799:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3859
00000100:00080000:2.0:1787828696.211803:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1787828696.211808:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828696/real 1787828696]  req@ffff9ee005728000 x1874670273097088/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828721 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828696.211809:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828696.211816:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787828696.211829:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728000 x1874670273097088/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828721 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828696.211832:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b840 x1874670273097600/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828696.211852:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828696.211856:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828696.211860:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00080000:2.0:1787828696.211862:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787828696.211867:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1787828696.211868:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273097088:192.168.203.121@tcp:38:kworker.0
00000100:00080000:2.0:1787828696.211876:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3859
00000100:00080000:2.0:1787828696.211880:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1787828696.211881:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273097216:192.168.203.121@tcp:8:kworker.0
00000100:00080000:2.0:1787828696.211886:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828696.211891:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828696.211903:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729a40 x1874670273097728/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1787828696.211910:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787828696.211923:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828696/real 1787828696]  req@ffff9ee00572a580 x1874670273097216/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828721 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787828696.211942:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a580 x1874670273097216/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828721 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828696.211949:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787828696.211952:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787828696.211955:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273097216:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787828696.211960:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273097344:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787828696.211973:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787828696.211980:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828696/real 1787828696]  req@ffff9ee005728b40 x1874670273097344/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828721 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787828696.211994:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728b40 x1874670273097344/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828721 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828696.212004:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787828696.212007:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787828696.212011:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273097344:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787828696.212031:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273097472:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787828696.212056:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787828696.212066:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828696/real 1787828696]  req@ffff9ee005728f00 x1874670273097472/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828721 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787828696.212081:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728f00 x1874670273097472/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828721 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828696.212088:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787828696.212090:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787828696.212093:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273097472:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787828696.212097:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273097600:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787828696.212110:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787828696.212117:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828696/real 1787828696]  req@ffff9ee00572b840 x1874670273097600/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828721 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787828696.212126:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b840 x1874670273097600/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828721 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828696.212131:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787828696.212133:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787828696.212135:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273097600:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787828696.212139:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273097728:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787828696.212150:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787828696.212156:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828696/real 1787828696]  req@ffff9ee005729a40 x1874670273097728/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828721 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787828696.212164:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729a40 x1874670273097728/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828721 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828696.212175:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787828696.212177:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787828696.212179:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273097728:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828697.043533:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828697.235417:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828698.067528:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828698.259469:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828699.091595:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828699.283435:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828700.115554:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828700.307467:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828701.139536:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828701.331468:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:2.0:1787828701.331487:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828701.331498:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787828701.331505:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828701.331521:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3865
00000100:00080000:2.0:1787828701.331536:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828701.331547:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787828701.331636:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572ad00 x1874670273097856/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828701.331670:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828701.331675:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787828701.331678:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828701.331682:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3865
00000100:00080000:2.0:1787828701.331688:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828701.331694:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828701.331709:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787828701.331723:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273097856:192.168.203.121@tcp:250:kworker.0
00000100:00100000:2.0:1787828701.331740:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b480 x1874670273097984/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828701.331756:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828701.331761:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787828701.331763:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828701.331767:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3865
00000100:00080000:2.0:1787828701.331773:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828701.331779:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828701.331818:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828701.331837:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b0c0 x1874670273098112/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828701.331850:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828701.331854:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787828701.331857:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828701.331862:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3865
00000100:00080000:2.0:1787828701.331867:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828701.331872:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828701.331878:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828701.331897:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729a40 x1874670273098240/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828701.331910:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828701.331915:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787828701.331918:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828701.331924:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3865
00000100:00080000:2.0:1787828701.331972:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828701.331978:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000800:00000100:3.0:1787828701.331986:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000008:00100000:2.0:1787828701.331987:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787828701.332017:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b840 x1874670273098368/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828701.332038:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828701.332044:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00100000:3.0:1787828701.332045:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828701/real 1787828701]  req@ffff9ee00572ad00 x1874670273097856/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828726 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828701.332047:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828701.332058:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3865
00000100:00080000:2.0:1787828701.332068:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828701.332077:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828701.332085:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787828701.332087:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572ad00 x1874670273097856/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828726 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828701.332104:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728f00 x1874670273098496/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828701.332105:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787828701.332119:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:2.0:1787828701.332121:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828701.332127:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:3.0:1787828701.332130:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273097856:192.168.203.121@tcp:250:kworker.0
00000100:00080000:2.0:1787828701.332131:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828701.332141:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3865
00000100:00080000:2.0:1787828701.332146:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828701.332150:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828701.332154:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828701.332163:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728b40 x1874670273098624/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787828701.332175:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273097984:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787828701.332212:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787828701.332230:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828701/real 1787828701]  req@ffff9ee00572b480 x1874670273097984/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828726 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787828701.332245:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b480 x1874670273097984/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828726 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828701.332257:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787828701.332261:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787828701.332265:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273097984:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787828701.332286:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273098112:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787828701.332350:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787828701.332368:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828701/real 1787828701]  req@ffff9ee00572b0c0 x1874670273098112/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828726 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787828701.332400:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b0c0 x1874670273098112/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828726 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828701.332411:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787828701.332415:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787828701.332420:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273098112:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787828701.332429:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273098240:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787828701.332473:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787828701.332486:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828701/real 1787828701]  req@ffff9ee005729a40 x1874670273098240/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828726 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787828701.332497:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729a40 x1874670273098240/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828726 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828701.332508:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787828701.332513:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787828701.332518:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273098240:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787828701.332527:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273098368:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787828701.332565:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787828701.332578:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828701/real 1787828701]  req@ffff9ee00572b840 x1874670273098368/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828726 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787828701.332591:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b840 x1874670273098368/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828726 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828701.332616:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787828701.332620:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787828701.332626:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273098368:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787828701.332635:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273098496:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787828701.332664:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787828701.332679:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828701/real 1787828701]  req@ffff9ee005728f00 x1874670273098496/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828726 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787828701.332690:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728f00 x1874670273098496/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828726 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828701.332698:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787828701.332701:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787828701.332704:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273098496:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787828701.332725:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273098624:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787828701.332742:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787828701.332767:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828701/real 1787828701]  req@ffff9ee005728b40 x1874670273098624/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828726 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787828701.332775:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728b40 x1874670273098624/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828726 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828701.332781:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787828701.332783:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787828701.332785:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273098624:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828702.163565:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828702.355452:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828703.187547:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828703.379460:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828704.211543:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828704.403473:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828705.235508:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828705.427502:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828706.259610:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828706.451415:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:0.0:1787828706.451422:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828706.451429:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1787828706.451434:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828706.451445:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3870
00000100:00080000:0.0:1787828706.451457:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828706.451465:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787828706.451509:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ebc00 x1874670273098752/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828706.451538:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828706.451542:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787828706.451544:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828706.451549:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3870
00000100:00080000:0.0:1787828706.451554:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828706.451559:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828706.451573:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787828706.451578:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273098752:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787828706.451591:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8f00 x1874670273098880/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828706.451602:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828706.451613:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787828706.451615:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828706.451619:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3870
00000100:00080000:0.0:1787828706.451622:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828706.451625:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828706.451630:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828706.451642:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e83c0 x1874670273099008/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828706.451649:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828706.451651:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787828706.451653:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828706.451659:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3870
00000800:00000100:3.0:1787828706.451661:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:0.0:1787828706.451664:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828706.451668:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828706.451672:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828706.451680:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8000 x1874670273099136/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828706.451687:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828706.451689:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787828706.451691:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828706.451694:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3870
00000100:00080000:0.0:1787828706.451696:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828706.451699:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828706.451702:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787828706.451711:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb480 x1874670273099264/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787828706.451718:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828706/real 1787828706]  req@ffff9ee0056ebc00 x1874670273098752/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828731 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828706.451721:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828706.451730:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787828706.451731:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828706.451736:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3870
00000100:00080000:0.0:1787828706.451740:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828706.451746:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828706.451750:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787828706.451756:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ebc00 x1874670273098752/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828731 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787828706.451760:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb840 x1874670273099392/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828706.451782:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787828706.451790:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828706.451790:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:0.0:1787828706.451797:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787828706.451801:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1787828706.451802:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273098752:192.168.203.121@tcp:250:kworker.0
00000100:00080000:0.0:1787828706.451809:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3870
00000100:00080000:0.0:1787828706.451812:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828706.451815:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828706.451818:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828706.451825:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e92c0 x1874670273099520/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787828706.451832:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273098880:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787828706.451872:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787828706.451883:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828706/real 1787828706]  req@ffff9ee0056e8f00 x1874670273098880/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828731 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787828706.451891:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8f00 x1874670273098880/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828731 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828706.451898:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787828706.451901:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787828706.451904:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273098880:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787828706.451908:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273099008:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787828706.451921:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787828706.451927:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828706/real 1787828706]  req@ffff9ee0056e83c0 x1874670273099008/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828731 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787828706.451935:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e83c0 x1874670273099008/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828731 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828706.451941:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787828706.451942:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787828706.451944:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273099008:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787828706.451949:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273099136:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787828706.451960:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787828706.451982:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828706/real 1787828706]  req@ffff9ee0056e8000 x1874670273099136/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828731 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787828706.451989:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8000 x1874670273099136/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828731 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828706.451994:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787828706.451996:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787828706.451999:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273099136:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787828706.452002:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273099264:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787828706.452013:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787828706.452018:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828706/real 1787828706]  req@ffff9ee0056eb480 x1874670273099264/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828731 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787828706.452025:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb480 x1874670273099264/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828731 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828706.452030:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787828706.452032:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787828706.452033:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273099264:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787828706.452037:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273099392:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787828706.452047:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787828706.452052:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828706/real 1787828706]  req@ffff9ee0056eb840 x1874670273099392/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828731 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787828706.452060:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb840 x1874670273099392/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828731 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828706.452065:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787828706.452066:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787828706.452068:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273099392:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787828706.452080:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273099520:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787828706.452090:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787828706.452096:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828706/real 1787828706]  req@ffff9ee0056e92c0 x1874670273099520/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828731 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787828706.452104:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e92c0 x1874670273099520/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828731 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828706.452109:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787828706.452111:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787828706.452113:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273099520:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828707.283596:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828707.475427:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828708.307537:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828708.499481:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828709.331550:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828709.523486:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828710.355547:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828710.547468:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828711.379506:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828711.571459:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:1.0:1787828711.571466:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828711.571475:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1787828711.571481:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787828711.571492:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3875
00000100:00080000:1.0:1787828711.571504:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828711.571514:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787828711.571557:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a03c0 x1874670273099648/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787828711.571594:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828711.571598:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787828711.571601:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787828711.571606:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3875
00000100:00080000:1.0:1787828711.571612:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828711.571618:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787828711.571626:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273099648:192.168.203.121@tcp:250:kworker.0
00000008:00100000:1.0:1787828711.571629:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787828711.571651:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1a40 x1874670273099776/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787828711.571666:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828711.571670:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787828711.571672:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787828711.571678:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3875
00000100:00080000:1.0:1787828711.571683:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000800:00000100:3.0:1787828711.571690:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:1.0:1787828711.571691:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787828711.571701:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787828711.571720:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a12c0 x1874670273099904/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787828711.571731:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828711/real 1787828711]  req@ffff9ee0056a03c0 x1874670273099648/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828736 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828711.571736:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828711.571748:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787828711.571753:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1787828711.571757:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a03c0 x1874670273099648/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828736 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828711.571760:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3875
00000100:00080000:1.0:1787828711.571770:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828711.571773:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828711.571778:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00080000:3.0:1787828711.571781:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787828711.571788:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273099648:192.168.203.121@tcp:250:kworker.0
00000008:00100000:1.0:1787828711.571790:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787828711.571809:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a21c0 x1874670273100032/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787828711.571810:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273099776:192.168.203.121@tcp:38:kworker.0
00000100:00080000:1.0:1787828711.571832:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828711.571839:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000800:00000100:3.0:1787828711.571840:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787828711.571851:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828711/real 1787828711]  req@ffff9ee0056a1a40 x1874670273099776/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828736 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828711.571855:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787828711.571868:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3875
00000100:00080000:1.0:1787828711.571878:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1787828711.571883:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1a40 x1874670273099776/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828736 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828711.571887:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00080000:3.0:1787828711.571898:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000008:00100000:1.0:1787828711.571901:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00080000:3.0:1787828711.571903:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787828711.571910:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273099776:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787828711.571915:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273099904:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828711.571923:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1680 x1874670273100160/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1787828711.571934:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:1.0:1787828711.571944:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1787828711.571947:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828711/real 1787828711]  req@ffff9ee0056a12c0 x1874670273099904/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828736 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828711.571952:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787828711.571958:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1787828711.571964:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a12c0 x1874670273099904/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828736 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828711.571968:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3875
00000100:00080000:1.0:1787828711.571978:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828711.571979:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787828711.571987:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00080000:1.0:1787828711.571991:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787828711.571994:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273099904:192.168.203.121@tcp:8:kworker.0
00000008:00100000:1.0:1787828711.572002:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787828711.572011:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273100032:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828711.572022:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0f00 x1874670273100288/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1787828711.572030:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787828711.572041:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828711/real 1787828711]  req@ffff9ee0056a21c0 x1874670273100032/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828736 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828711.572044:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828711.572057:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787828711.572062:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1787828711.572062:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a21c0 x1874670273100032/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828736 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828711.572073:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3875
00000100:00080000:1.0:1787828711.572082:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828711.572084:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787828711.572091:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00080000:1.0:1787828711.572093:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787828711.572096:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273100032:192.168.203.121@tcp:8:kworker.0
00000008:00100000:1.0:1787828711.572103:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787828711.572104:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273100160:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828711.572126:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a3c00 x1874670273100416/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1787828711.572128:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787828711.572139:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828711/real 1787828711]  req@ffff9ee0056a1680 x1874670273100160/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828736 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787828711.572153:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1680 x1874670273100160/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828736 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828711.572169:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787828711.572172:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787828711.572174:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273100160:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787828711.572185:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273100288:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787828711.572197:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787828711.572203:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828711/real 1787828711]  req@ffff9ee0056a0f00 x1874670273100288/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828736 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787828711.572211:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0f00 x1874670273100288/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828736 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828711.572219:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787828711.572223:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787828711.572227:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273100288:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787828711.572235:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273100416:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787828711.572256:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787828711.572269:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828711/real 1787828711]  req@ffff9ee0056a3c00 x1874670273100416/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828736 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787828711.572282:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a3c00 x1874670273100416/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828736 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828711.572289:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787828711.572291:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787828711.572293:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273100416:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828712.403497:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828712.595410:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828713.427453:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828713.619385:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828714.451481:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828714.643445:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828715.475466:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828715.667373:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828716.499529:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828716.691391:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:1.0:1787828716.691401:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828716.691407:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1787828716.691411:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787828716.691418:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3880
00000100:00080000:1.0:1787828716.691428:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828716.691435:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787828716.691469:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a2940 x1874670273100544/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787828716.691504:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828716.691509:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787828716.691512:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787828716.691518:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3880
00000100:00080000:1.0:1787828716.691523:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828716.691527:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787828716.691537:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787828716.691549:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273100544:192.168.203.121@tcp:250:kworker.0
00000100:00100000:1.0:1787828716.691553:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a3c00 x1874670273100672/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787828716.691565:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828716.691568:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787828716.691570:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787828716.691574:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3880
00000100:00080000:1.0:1787828716.691578:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828716.691592:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787828716.691603:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787828716.691617:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0f00 x1874670273100800/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787828716.691627:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828716.691630:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787828716.691631:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787828716.691634:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3880
00000100:00080000:1.0:1787828716.691637:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828716.691640:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787828716.691643:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787828716.691651:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1680 x1874670273100928/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787828716.691657:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828716.691659:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787828716.691661:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787828716.691664:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3880
00000100:00080000:1.0:1787828716.691665:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828716.691668:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787828716.691671:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787828716.691681:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a21c0 x1874670273101056/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787828716.691687:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828716.691690:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787828716.691691:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787828716.691697:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3880
00000100:00100000:0.0:1787828716.691698:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273100672:192.168.203.121@tcp:38:kworker.0
00000100:00080000:1.0:1787828716.691699:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828716.691706:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787828716.691711:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787828716.691722:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a12c0 x1874670273101184/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787828716.691730:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828716.691732:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787828716.691734:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787828716.691737:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3880
00000100:00080000:1.0:1787828716.691740:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828716.691743:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787828716.691746:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828716.691748:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273100800:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828716.691756:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1a40 x1874670273101312/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787828716.691787:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273100928:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787828716.691815:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273101056:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787828716.691841:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273101184:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787828716.691859:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273101312:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828717.523501:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828717.715403:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828718.547460:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828718.739386:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828719.571495:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828719.763443:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000400:00000100:2.0:1787828719.763624:0:2354:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.203.121:988
00000400:00000100:2.0:1787828719.763677:0:2354:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.203.121@tcp at host 192.168.203.121 was unreachable: the network or that node may be down, or Lustre may be misconfigured.
00000800:00000100:2.0:1787828719.763692:0:2354:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:2.0:1787828719.763786:0:2354:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:2.0:1787828719.763796:0:2354:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:2.0:1787828719.763822:0:2354:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:2.0:1787828719.763832:0:2354:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:2.0:1787828719.763841:0:2354:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:2.0:1787828719.763851:0:2354:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000100:00100000:0.0:1787828719.763859:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828716/real 1787828719]  req@ffff9ee0056a12c0 x1874670273101184/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828741 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787828719.763894:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a12c0 x1874670273101184/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828741 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828719.763906:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787828719.763916:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787828719.763921:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273101184:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787828719.763928:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828716/real 1787828719]  req@ffff9ee0056a1a40 x1874670273101312/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828741 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787828719.763942:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1a40 x1874670273101312/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828741 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828719.763954:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787828719.763957:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787828719.763961:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273101312:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787828719.763967:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828716/real 1787828719]  req@ffff9ee0056a3c00 x1874670273100672/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828741 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787828719.763979:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a3c00 x1874670273100672/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828741 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828719.763987:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787828719.763990:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787828719.763994:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273100672:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787828719.764001:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828716/real 1787828719]  req@ffff9ee0056a0f00 x1874670273100800/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828741 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787828719.764013:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0f00 x1874670273100800/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828741 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828719.764020:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787828719.764024:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787828719.764027:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273100800:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787828719.764033:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828716/real 1787828719]  req@ffff9ee0056a1680 x1874670273100928/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828741 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787828719.764045:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1680 x1874670273100928/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828741 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828719.764053:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787828719.764056:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787828719.764059:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273100928:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787828719.764064:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828716/real 1787828719]  req@ffff9ee0056a21c0 x1874670273101056/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828741 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787828719.764074:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a21c0 x1874670273101056/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828741 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828719.764082:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787828719.764085:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787828719.764088:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273101056:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787828719.764094:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828716/real 1787828719]  req@ffff9ee0056a2940 x1874670273100544/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828741 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787828719.764104:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a2940 x1874670273100544/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828741 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828719.764111:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787828719.764114:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787828719.764117:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273100544:192.168.203.121@tcp:250:kworker.0
00010000:00010000:3.0:1787828720.595455:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828720.787371:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828721.619433:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828721.811458:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:2.0:1787828721.811494:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828721.811505:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787828721.811509:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828721.811516:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3885
00000100:00080000:2.0:1787828721.811525:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828721.811531:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787828721.811561:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a580 x1874670273101440/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828721.811582:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828721.811584:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787828721.811586:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828721.811588:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3885
00000100:00080000:2.0:1787828721.811590:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828721.811593:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828721.811601:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787828721.811609:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728000 x1874670273101568/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828721.811617:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828721.811620:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787828721.811621:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828721.811623:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3885
00000100:00080000:2.0:1787828721.811625:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828721.811627:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828721.811631:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828721.811635:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273101440:192.168.203.121@tcp:250:kworker.0
00000100:00100000:2.0:1787828721.811640:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057283c0 x1874670273101696/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828721.811654:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828721.811657:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787828721.811659:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828721.811674:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3885
00000100:00080000:2.0:1787828721.811678:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828721.811682:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828721.811688:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828721.811700:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a1c0 x1874670273101824/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828721.811710:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828721.811713:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787828721.811717:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:0.0:1787828721.811719:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:2.0:1787828721.811724:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3885
00000100:00080000:2.0:1787828721.811730:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828721.811735:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828721.811741:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787828721.811755:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729e00 x1874670273101952/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828721.811765:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828721.811768:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787828721.811771:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1787828721.811777:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828721/real 1787828721]  req@ffff9ee00572a580 x1874670273101440/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828746 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828721.811779:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3885
00000100:00080000:2.0:1787828721.811786:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828721.811794:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828721.811799:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828721.811804:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a580 x1874670273101440/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828746 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828721.811816:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787828721.811820:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787828721.811824:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273101440:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787828721.811832:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273101568:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787828721.811839:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a940 x1874670273102080/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828721.811849:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828721.811853:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787828721.811855:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:0.0:1787828721.811861:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:2.0:1787828721.811863:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3885
00000100:00080000:2.0:1787828721.811869:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828721.811873:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828721.811879:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828721.811882:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828721/real 1787828721]  req@ffff9ee005728000 x1874670273101568/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828746 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828721.811893:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728780 x1874670273102208/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787828721.811934:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728000 x1874670273101568/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828746 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828721.811945:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787828721.811950:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787828721.811954:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273101568:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787828721.811982:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273101696:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787828721.812006:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787828721.812019:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828721/real 1787828721]  req@ffff9ee0057283c0 x1874670273101696/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828746 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787828721.812029:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057283c0 x1874670273101696/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828746 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828721.812037:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787828721.812039:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787828721.812042:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273101696:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787828721.812048:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273101824:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787828721.812065:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787828721.812075:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828721/real 1787828721]  req@ffff9ee00572a1c0 x1874670273101824/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828746 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787828721.812087:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a1c0 x1874670273101824/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828746 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828721.812099:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787828721.812103:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787828721.812106:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273101824:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787828721.812111:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273101952:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787828721.812130:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787828721.812142:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828721/real 1787828721]  req@ffff9ee005729e00 x1874670273101952/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828746 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787828721.812152:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729e00 x1874670273101952/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828746 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828721.812159:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787828721.812162:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787828721.812165:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273101952:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787828721.812170:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273102080:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787828721.812189:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787828721.812200:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828721/real 1787828721]  req@ffff9ee00572a940 x1874670273102080/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828746 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787828721.812210:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a940 x1874670273102080/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828746 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828721.812217:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787828721.812220:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787828721.812223:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273102080:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787828721.812245:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273102208:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787828721.812265:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787828721.812277:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828721/real 1787828721]  req@ffff9ee005728780 x1874670273102208/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828746 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787828721.812289:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728780 x1874670273102208/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828746 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828721.812296:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787828721.812298:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787828721.812302:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273102208:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828722.643448:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828722.835407:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828723.667477:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828723.859441:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828724.691480:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828724.883426:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828725.715505:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828725.907453:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828726.739520:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1787828726.931453:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1787828726.931453:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:2.0:1787828726.931474:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787828726.931480:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828726.931495:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3890
00000100:00080000:2.0:1787828726.931510:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828726.931518:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787828726.931562:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729680 x1874670273102336/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828726.931590:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828726.931593:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787828726.931594:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828726.931597:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3890
00000100:00080000:2.0:1787828726.931600:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828726.931602:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828726.931613:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787828726.931621:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057292c0 x1874670273102464/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828726.931629:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828726.931631:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787828726.931633:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828726.931636:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3890
00000100:00080000:2.0:1787828726.931638:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828726.931642:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828726.931646:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828726.931653:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572bc00 x1874670273102592/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828726.931659:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828726.931662:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787828726.931663:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828726.931666:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3890
00000100:00080000:2.0:1787828726.931669:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828726.931673:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787828726.931675:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273102336:192.168.203.121@tcp:250:kworker.0
00000008:00100000:2.0:1787828726.931677:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828726.931690:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728780 x1874670273102720/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828726.931697:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828726.931700:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787828726.931701:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828726.931705:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3890
00000100:00080000:2.0:1787828726.931707:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828726.931709:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828726.931712:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787828726.931721:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a940 x1874670273102848/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828726.931728:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828726.931731:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787828726.931732:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828726.931735:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3890
00000100:00080000:2.0:1787828726.931738:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828726.931740:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828726.931743:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828726.931750:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729e00 x1874670273102976/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828726.931756:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828726.931758:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787828726.931759:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828726.931761:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3890
00000100:00080000:2.0:1787828726.931764:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000800:00000100:0.0:1787828726.931768:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:2.0:1787828726.931771:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828726.931776:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828726.931785:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a1c0 x1874670273103104/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787828726.931820:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828726/real 1787828726]  req@ffff9ee005729680 x1874670273102336/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828751 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787828726.931836:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729680 x1874670273102336/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828751 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828726.931845:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787828726.931848:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787828726.931852:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273102336:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787828726.931857:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057292c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273102464:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787828726.931872:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787828726.931889:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828726/real 1787828726]  req@ffff9ee0057292c0 x1874670273102464/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828751 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787828726.931898:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057292c0 x1874670273102464/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828751 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828726.931903:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787828726.931906:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787828726.931908:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057292c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273102464:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787828726.931912:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273102592:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787828726.931924:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787828726.931930:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828726/real 1787828726]  req@ffff9ee00572bc00 x1874670273102592/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828751 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787828726.931937:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572bc00 x1874670273102592/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828751 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828726.931942:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787828726.931944:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787828726.931946:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273102592:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787828726.931970:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273102720:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787828726.931981:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787828726.931987:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828726/real 1787828726]  req@ffff9ee005728780 x1874670273102720/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828751 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787828726.932000:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728780 x1874670273102720/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828751 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828726.932005:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787828726.932007:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787828726.932008:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273102720:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787828726.932012:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273102848:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787828726.932022:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787828726.932028:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828726/real 1787828726]  req@ffff9ee00572a940 x1874670273102848/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828751 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787828726.932035:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a940 x1874670273102848/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828751 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828726.932040:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787828726.932042:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787828726.932043:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273102848:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787828726.932047:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273102976:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787828726.932056:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787828726.932061:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828726/real 1787828726]  req@ffff9ee005729e00 x1874670273102976/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828751 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787828726.932068:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729e00 x1874670273102976/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828751 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828726.932077:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787828726.932079:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787828726.932081:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273102976:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787828726.932084:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273103104:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787828726.932094:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787828726.932099:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828726/real 1787828726]  req@ffff9ee00572a1c0 x1874670273103104/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828751 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787828726.932106:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a1c0 x1874670273103104/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828751 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828726.932110:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787828726.932112:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787828726.932114:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273103104:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828727.763488:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828727.955439:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828728.787473:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828728.979378:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828729.811531:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828730.003437:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828730.835561:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828731.027411:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828731.859507:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828732.051404:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:2.0:1787828732.051406:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828732.051413:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787828732.051417:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828732.051425:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3895
00000100:00080000:2.0:1787828732.051434:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828732.051440:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787828732.051471:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057283c0 x1874670273103232/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828732.051493:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828732.051496:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787828732.051497:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828732.051500:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3895
00000100:00080000:2.0:1787828732.051502:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828732.051504:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828732.051512:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787828732.051519:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728000 x1874670273103360/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828732.051526:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828732.051529:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787828732.051530:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828732.051533:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3895
00000100:00080000:2.0:1787828732.051534:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828732.051537:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828732.051540:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828732.051547:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a580 x1874670273103488/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787828732.051554:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273103232:192.168.203.121@tcp:250:kworker.0
00000100:00080000:2.0:1787828732.051563:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828732.051567:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787828732.051568:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828732.051571:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3895
00000100:00080000:2.0:1787828732.051572:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828732.051574:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828732.051577:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828732.051585:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728b40 x1874670273103616/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828732.051590:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828732.051593:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787828732.051594:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828732.051596:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3895
00000100:00080000:2.0:1787828732.051598:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828732.051600:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828732.051603:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787828732.051611:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728f00 x1874670273103744/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828732.051617:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828732.051619:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787828732.051620:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828732.051622:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3895
00000100:00080000:2.0:1787828732.051625:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828732.051628:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828732.051631:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828732.051639:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b840 x1874670273103872/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1787828732.051645:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:2.0:1787828732.051650:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828732.051654:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787828732.051655:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828732.051658:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3895
00000100:00080000:2.0:1787828732.051661:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828732.051663:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828732.051666:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828732.051672:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729a40 x1874670273104000/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787828732.051699:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828732/real 1787828732]  req@ffff9ee0057283c0 x1874670273103232/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828757 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787828732.051720:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057283c0 x1874670273103232/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828757 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828732.051732:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787828732.051737:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787828732.051742:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273103232:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787828732.051750:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273103360:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787828732.051777:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787828732.051791:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828732/real 1787828732]  req@ffff9ee005728000 x1874670273103360/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828757 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787828732.051806:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728000 x1874670273103360/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828757 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828732.051815:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787828732.051819:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787828732.051823:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273103360:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787828732.051849:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273103488:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787828732.051872:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787828732.051885:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828732/real 1787828732]  req@ffff9ee00572a580 x1874670273103488/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828757 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787828732.051899:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a580 x1874670273103488/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828757 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828732.051907:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787828732.051911:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787828732.051915:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273103488:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787828732.051921:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273103616:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787828732.051943:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787828732.051955:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828732/real 1787828732]  req@ffff9ee005728b40 x1874670273103616/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828757 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787828732.051969:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728b40 x1874670273103616/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828757 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828732.051978:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787828732.051981:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787828732.051984:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273103616:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787828732.051991:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273103744:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787828732.052011:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787828732.052022:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828732/real 1787828732]  req@ffff9ee005728f00 x1874670273103744/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828757 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787828732.052033:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728f00 x1874670273103744/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828757 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828732.052041:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787828732.052045:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787828732.052048:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273103744:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787828732.052053:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273103872:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787828732.052069:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787828732.052078:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828732/real 1787828732]  req@ffff9ee00572b840 x1874670273103872/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828757 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787828732.052095:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b840 x1874670273103872/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828757 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828732.052103:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787828732.052106:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787828732.052109:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273103872:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787828732.052114:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273104000:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787828732.052131:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787828732.052140:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828732/real 1787828732]  req@ffff9ee005729a40 x1874670273104000/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828757 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787828732.052152:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729a40 x1874670273104000/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828757 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828732.052176:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787828732.052179:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787828732.052182:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273104000:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828732.883547:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828733.075377:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828733.907486:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828734.099419:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828734.931563:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828735.123405:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828735.955550:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828736.147458:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828736.979582:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1787828737.171388:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828737.171398:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787828737.171403:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828737.171416:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3900
00000100:00100000:3.0:1787828737.171422:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:2.0:1787828737.171435:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828737.171444:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787828737.171488:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b0c0 x1874670273104128/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828737.171532:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828737.171536:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787828737.171537:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828737.171541:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3900
00000100:00080000:2.0:1787828737.171545:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828737.171551:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828737.171562:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787828737.171570:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273104128:192.168.203.121@tcp:250:kworker.0
00000100:00100000:2.0:1787828737.171578:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b480 x1874670273104256/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828737.171596:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828737.171600:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787828737.171602:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828737.171608:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3900
00000100:00080000:2.0:1787828737.171613:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828737.171620:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828737.171628:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:0.0:1787828737.171641:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828737.171647:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572ad00 x1874670273104384/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828737.171659:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828737.171663:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787828737.171665:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828737.171670:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3900
00000100:00080000:2.0:1787828737.171675:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828737.171680:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828737.171686:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828737.171692:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828737/real 1787828737]  req@ffff9ee00572b0c0 x1874670273104128/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828762 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828737.171699:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729a40 x1874670273104512/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828737.171758:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828737.171763:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787828737.171766:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1787828737.171773:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b0c0 x1874670273104128/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828762 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828737.171778:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3900
00000100:00080000:2.0:1787828737.171788:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828737.171800:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00080000:0.0:1787828737.171801:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000008:00100000:2.0:1787828737.171807:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00080000:0.0:1787828737.171811:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787828737.171816:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273104128:192.168.203.121@tcp:250:kworker.0
00000100:00100000:2.0:1787828737.171834:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b840 x1874670273104640/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828737.171843:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828737.171846:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787828737.171849:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828737.171855:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3900
00000100:00100000:0.0:1787828737.171860:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273104256:192.168.203.121@tcp:38:kworker.0
00000100:00080000:2.0:1787828737.171863:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828737.171873:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828737.171880:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:0.0:1787828737.171898:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828737.171900:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728f00 x1874670273104768/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787828737.171920:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828737/real 1787828737]  req@ffff9ee00572b480 x1874670273104256/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828762 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828737.171924:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828737.171933:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787828737.171941:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828737.171951:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3900
00000100:00080000:2.0:1787828737.171959:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828737.171963:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828737.171967:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828737.171969:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b480 x1874670273104256/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828762 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828737.171983:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:2.0:1787828737.171984:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728b40 x1874670273104896/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828737.171997:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787828737.172010:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273104256:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787828737.172020:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273104384:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787828737.172042:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787828737.172050:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828737/real 1787828737]  req@ffff9ee00572ad00 x1874670273104384/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828762 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787828737.172059:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572ad00 x1874670273104384/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828762 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828737.172065:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787828737.172068:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787828737.172071:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273104384:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787828737.172077:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273104512:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787828737.172088:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787828737.172094:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828737/real 1787828737]  req@ffff9ee005729a40 x1874670273104512/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828762 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787828737.172101:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729a40 x1874670273104512/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828762 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828737.172106:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787828737.172108:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787828737.172110:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273104512:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787828737.172114:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273104640:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787828737.172141:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787828737.172151:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828737/real 1787828737]  req@ffff9ee00572b840 x1874670273104640/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828762 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787828737.172159:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b840 x1874670273104640/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828762 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828737.172165:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787828737.172168:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787828737.172170:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273104640:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787828737.172185:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273104768:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787828737.172196:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787828737.172203:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828737/real 1787828737]  req@ffff9ee005728f00 x1874670273104768/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828762 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787828737.172210:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728f00 x1874670273104768/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828762 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828737.172215:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787828737.172217:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787828737.172219:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273104768:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787828737.172223:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273104896:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787828737.172233:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787828737.172238:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828737/real 1787828737]  req@ffff9ee005728b40 x1874670273104896/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828762 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787828737.172245:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728b40 x1874670273104896/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828762 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828737.172250:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787828737.172252:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787828737.172254:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273104896:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828738.003552:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828738.195397:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828739.027591:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828739.219431:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828740.051473:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828740.243394:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828741.075481:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828741.267416:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828742.099599:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1787828742.291467:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1787828742.291483:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787828742.291487:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787828742.291497:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828742.291510:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3906
00000100:00080000:3.0:1787828742.291524:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828742.291533:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787828742.291579:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704780 x1874670273105024/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828742.291610:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828742.291615:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787828742.291618:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828742.291623:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3906
00000100:00080000:3.0:1787828742.291628:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828742.291635:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828742.291650:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787828742.291673:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705a40 x1874670273105152/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787828742.291684:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273105024:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787828742.291709:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828742.291716:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787828742.291720:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828742.291728:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3906
00000100:00080000:3.0:1787828742.291736:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828742.291744:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828742.291754:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:0.0:1787828742.291776:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787828742.291781:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705e00 x1874670273105280/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828742.291805:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828742.291812:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787828742.291815:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828742.291823:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3906
00000100:00080000:3.0:1787828742.291831:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1787828742.291834:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828742/real 1787828742]  req@ffff9ee005704780 x1874670273105024/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828767 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828742.291862:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828742.291884:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828742.291896:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704780 x1874670273105024/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828767 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828742.291914:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:3.0:1787828742.291917:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704b40 x1874670273105408/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828742.291925:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787828742.291938:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273105024:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787828742.291963:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828742.291970:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787828742.291975:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1787828742.291980:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273105152:192.168.203.121@tcp:38:kworker.0
00000100:00080000:3.0:1787828742.291992:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3906
00000100:00080000:3.0:1787828742.292002:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828742.292010:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828742.292019:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000800:00000100:0.0:1787828742.292022:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787828742.292046:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828742/real 1787828742]  req@ffff9ee005705a40 x1874670273105152/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828767 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787828742.292053:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706580 x1874670273105536/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787828742.292082:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705a40 x1874670273105152/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828767 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828742.292150:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828742.292156:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787828742.292161:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787828742.292168:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00080000:3.0:1787828742.292172:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1787828742.292180:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273105152:192.168.203.121@tcp:38:kworker.0
00000100:00080000:3.0:1787828742.292190:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3906
00000100:00100000:0.0:1787828742.292194:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273105280:192.168.203.121@tcp:8:kworker.0
00000100:00080000:3.0:1787828742.292201:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828742.292211:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828742.292221:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:0.0:1787828742.292236:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787828742.292247:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057043c0 x1874670273105664/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787828742.292266:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828742/real 1787828742]  req@ffff9ee005705e00 x1874670273105280/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828767 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828742.292271:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828742.292286:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787828742.292292:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1787828742.292302:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705e00 x1874670273105280/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828767 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828742.292303:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3906
00000100:00080000:3.0:1787828742.292317:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828742.292321:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787828742.292331:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00080000:0.0:1787828742.292382:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787828742.292390:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273105280:192.168.203.121@tcp:8:kworker.0
00000008:00100000:3.0:1787828742.292399:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828742.292403:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273105408:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787828742.292429:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057070c0 x1874670273105792/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1787828742.292444:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787828742.292469:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828742/real 1787828742]  req@ffff9ee005704b40 x1874670273105408/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828767 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787828742.292485:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704b40 x1874670273105408/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828767 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828742.292496:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787828742.292500:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787828742.292504:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273105408:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787828742.292523:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273105536:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787828742.292543:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787828742.292553:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828742/real 1787828742]  req@ffff9ee005706580 x1874670273105536/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828767 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787828742.292566:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706580 x1874670273105536/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828767 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828742.292575:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787828742.292578:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787828742.292582:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273105536:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787828742.292588:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273105664:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787828742.292605:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787828742.292616:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828742/real 1787828742]  req@ffff9ee0057043c0 x1874670273105664/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828767 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787828742.292629:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057043c0 x1874670273105664/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828767 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828742.292638:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787828742.292641:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787828742.292644:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273105664:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787828742.292650:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273105792:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787828742.292666:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787828742.292675:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828742/real 1787828742]  req@ffff9ee0057070c0 x1874670273105792/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828767 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787828742.292687:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057070c0 x1874670273105792/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828767 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828742.292695:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787828742.292699:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787828742.292702:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273105792:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828743.123628:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828743.315485:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828744.147522:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828744.339457:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828745.171506:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828745.363502:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828746.195455:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828746.387407:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828747.219430:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828747.411430:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:2.0:1787828747.411438:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828747.411444:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787828747.411448:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828747.411457:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3911
00000100:00080000:2.0:1787828747.411468:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828747.411475:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787828747.411509:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a580 x1874670273105920/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828747.411532:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828747.411534:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787828747.411536:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828747.411539:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3911
00000100:00080000:2.0:1787828747.411542:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828747.411545:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828747.411554:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787828747.411566:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728000 x1874670273106048/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828747.411583:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828747.411587:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787828747.411589:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828747.411595:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3911
00000100:00080000:2.0:1787828747.411599:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828747.411605:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828747.411610:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828747.411618:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273105920:192.168.203.121@tcp:250:kworker.0
00000100:00100000:2.0:1787828747.411622:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057283c0 x1874670273106176/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828747.411631:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828747.411634:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787828747.411635:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828747.411639:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3911
00000100:00080000:2.0:1787828747.411641:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828747.411644:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828747.411647:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828747.411656:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a1c0 x1874670273106304/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828747.411662:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828747.411665:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787828747.411666:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828747.411669:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3911
00000100:00080000:2.0:1787828747.411671:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828747.411673:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828747.411676:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000800:00000100:0.0:1787828747.411679:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828747.411688:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729e00 x1874670273106432/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828747.411696:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828747.411698:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787828747.411700:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828747.411702:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3911
00000100:00080000:2.0:1787828747.411704:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828747.411706:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828747.411710:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828747.411718:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828747/real 1787828747]  req@ffff9ee00572a580 x1874670273105920/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828772 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828747.411721:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a940 x1874670273106560/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828747.411747:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828747.411749:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787828747.411751:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1787828747.411754:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a580 x1874670273105920/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828772 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828747.411757:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3911
00000100:00080000:2.0:1787828747.411762:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828747.411768:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00080000:0.0:1787828747.411774:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000008:00100000:2.0:1787828747.411774:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:0.0:1787828747.411780:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828747.411783:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728780 x1874670273106688/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787828747.411787:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273105920:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787828747.411793:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273106048:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787828747.411812:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787828747.411823:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828747/real 1787828747]  req@ffff9ee005728000 x1874670273106048/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828772 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787828747.411831:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728000 x1874670273106048/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828772 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828747.411836:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787828747.411838:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787828747.411840:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273106048:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787828747.411858:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273106176:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787828747.411870:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787828747.411876:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828747/real 1787828747]  req@ffff9ee0057283c0 x1874670273106176/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828772 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787828747.411883:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057283c0 x1874670273106176/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828772 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828747.411889:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787828747.411890:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787828747.411892:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273106176:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787828747.411896:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273106304:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787828747.411905:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787828747.411911:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828747/real 1787828747]  req@ffff9ee00572a1c0 x1874670273106304/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828772 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787828747.411918:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a1c0 x1874670273106304/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828772 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828747.411923:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787828747.411924:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787828747.411926:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273106304:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787828747.411929:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273106432:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787828747.411939:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787828747.411944:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828747/real 1787828747]  req@ffff9ee005729e00 x1874670273106432/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828772 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787828747.411950:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729e00 x1874670273106432/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828772 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828747.411960:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787828747.411962:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787828747.411964:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273106432:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787828747.411967:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273106560:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787828747.411976:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787828747.411981:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828747/real 1787828747]  req@ffff9ee00572a940 x1874670273106560/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828772 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787828747.411989:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a940 x1874670273106560/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828772 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828747.411993:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787828747.411995:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787828747.411997:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273106560:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787828747.412000:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273106688:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787828747.412009:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787828747.412014:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828747/real 1787828747]  req@ffff9ee005728780 x1874670273106688/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828772 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787828747.412021:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728780 x1874670273106688/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828772 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828747.412026:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787828747.412027:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787828747.412029:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273106688:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828748.243490:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828748.435378:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828749.267576:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828749.459360:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828750.291641:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828750.483369:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828751.315611:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828751.507369:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828752.339553:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828752.531365:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787828752.531419:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828752.531426:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787828752.531430:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828752.531441:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3916
00000100:00080000:3.0:1787828752.531450:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828752.531456:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787828752.531484:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704000 x1874670273106816/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828752.531504:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828752.531506:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787828752.531509:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828752.531512:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3916
00000100:00080000:3.0:1787828752.531516:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828752.531519:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787828752.531525:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273106816:192.168.203.121@tcp:250:kworker.0
00000008:00100000:3.0:1787828752.531536:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787828752.531554:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706d00 x1874670273106944/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828752.531576:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:2.0:1787828752.531582:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787828752.531586:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787828752.531589:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828752.531595:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3916
00000100:00080000:3.0:1787828752.531600:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828752.531605:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828752.531611:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828752.531622:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828752/real 1787828752]  req@ffff9ee005704000 x1874670273106816/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828777 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787828752.531628:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707480 x1874670273107072/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828752.531645:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1787828752.531646:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704000 x1874670273106816/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828777 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828752.531656:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787828752.531661:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828752.531664:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787828752.531669:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3916
00000100:00080000:2.0:1787828752.531671:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:3.0:1787828752.531675:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1787828752.531676:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273106816:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787828752.531681:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828752.531687:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828752.531699:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273106944:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787828752.531700:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057052c0 x1874670273107200/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1787828752.531723:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828752.531731:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828752/real 1787828752]  req@ffff9ee005706d00 x1874670273106944/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828777 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828752.531740:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706d00 x1874670273106944/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828777 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828752.531751:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828752.531754:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828752.531759:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273106944:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787828752.531773:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273107072:192.168.203.121@tcp:8:kworker.0
00000100:00080000:3.0:1787828752.531776:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828752.531785:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787828752.531787:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828752.531796:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3916
00000800:00000100:2.0:1787828752.531803:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828752.531817:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828752/real 1787828752]  req@ffff9ee005707480 x1874670273107072/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828777 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828752.531826:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707480 x1874670273107072/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828777 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828752.531832:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828752.531835:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828752.531837:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273107072:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787828752.531859:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273107200:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787828752.531878:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828752.531888:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828752/real 1787828752]  req@ffff9ee0057052c0 x1874670273107200/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828777 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828752.531897:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1787828752.531902:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057052c0 x1874670273107200/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828777 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828752.531906:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828752.531914:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00080000:2.0:1787828752.531915:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828752.531921:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828752.531926:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273107200:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787828752.531965:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706940 x1874670273107328/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828752.531982:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828752.531984:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787828752.531986:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828752.531990:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3916
00000100:00080000:3.0:1787828752.531994:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828752.531998:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828752.532003:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787828752.532011:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707840 x1874670273107456/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828752.532033:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828752.532035:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787828752.532037:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828752.532041:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3916
00000100:00080000:3.0:1787828752.532044:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828752.532047:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828752.532052:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787828752.532061:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057061c0 x1874670273107584/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828752.532085:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273107328:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787828752.532120:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828752.532133:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828752/real 1787828752]  req@ffff9ee005706940 x1874670273107328/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828777 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828752.532143:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706940 x1874670273107328/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828777 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828752.532150:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828752.532153:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828752.532156:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273107328:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828752.532161:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273107456:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828752.532183:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828752.532191:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828752/real 1787828752]  req@ffff9ee005707840 x1874670273107456/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828777 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828752.532199:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707840 x1874670273107456/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828777 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828752.532205:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828752.532207:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828752.532209:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273107456:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828752.532213:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273107584:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828752.532224:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828752.532230:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828752/real 1787828752]  req@ffff9ee0057061c0 x1874670273107584/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828777 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828752.532237:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057061c0 x1874670273107584/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828777 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828752.532242:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828752.532244:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828752.532246:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273107584:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828753.363598:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828753.555384:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828754.387564:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828754.579401:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828755.411583:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828755.603398:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828756.435463:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828756.627486:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828757.459501:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828757.651429:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:0.0:1787828757.651458:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828757.651467:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1787828757.651472:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828757.651483:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3921
00000100:00080000:0.0:1787828757.651495:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828757.651503:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787828757.651543:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8b40 x1874670273107712/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828757.651577:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828757.651583:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787828757.651587:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828757.651593:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3921
00000100:00080000:0.0:1787828757.651599:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828757.651605:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828757.651618:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787828757.651649:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9e00 x1874670273107840/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828757.651658:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273107712:192.168.203.121@tcp:250:kworker.0
00000100:00080000:0.0:1787828757.651665:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828757.651670:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787828757.651673:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828757.651678:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3921
00000100:00080000:0.0:1787828757.651683:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828757.651688:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828757.651695:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828757.651708:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb0c0 x1874670273107968/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828757.651721:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828757.651726:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787828757.651729:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828757.651734:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3921
00000800:00000100:1.0:1787828757.651735:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:0.0:1787828757.651738:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828757.651743:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828757.651749:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828757.651762:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9a40 x1874670273108096/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828757.651776:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828757.651781:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787828757.651783:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1787828757.651786:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828757/real 1787828757]  req@ffff9ee0056e8b40 x1874670273107712/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828782 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828757.651789:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3921
00000100:00080000:0.0:1787828757.651794:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828757.651817:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828757.651825:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787828757.651831:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8b40 x1874670273107712/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828782 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787828757.651842:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9680 x1874670273108224/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787828757.651851:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787828757.651859:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828757.651859:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:0.0:1787828757.651866:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00100000:1.0:1787828757.651866:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273107712:192.168.203.121@tcp:250:kworker.0
00000100:00080000:0.0:1787828757.651870:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828757.651876:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3921
00000100:00080000:0.0:1787828757.651889:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828757.651895:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828757.651904:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787828757.651913:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273107840:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787828757.651921:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8780 x1874670273108352/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828757.651939:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828757.651945:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787828757.651948:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:1.0:1787828757.651952:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:0.0:1787828757.651955:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3921
00000100:00100000:1.0:1787828757.651976:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828757/real 1787828757]  req@ffff9ee0056e9e00 x1874670273107840/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828782 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828757.652018:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828757.652024:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828757.652032:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787828757.652033:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9e00 x1874670273107840/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828782 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828757.652047:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:0.0:1787828757.652048:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ea940 x1874670273108480/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787828757.652052:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828757.652058:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273107840:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828757.652087:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273107968:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828757.652129:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828757.652153:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828757/real 1787828757]  req@ffff9ee0056eb0c0 x1874670273107968/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828782 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828757.652170:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb0c0 x1874670273107968/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828782 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828757.652189:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828757.652206:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828757.652225:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273107968:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828757.652254:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273108096:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828757.652288:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828757.652307:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828757/real 1787828757]  req@ffff9ee0056e9a40 x1874670273108096/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828782 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828757.652326:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9a40 x1874670273108096/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828782 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828757.652361:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828757.652365:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828757.652368:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273108096:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828757.652375:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273108224:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787828757.652400:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828757.652412:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828757/real 1787828757]  req@ffff9ee0056e9680 x1874670273108224/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828782 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828757.652433:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9680 x1874670273108224/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828782 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828757.652441:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828757.652444:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828757.652447:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273108224:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828757.652468:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273108352:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828757.652484:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828757.652494:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828757/real 1787828757]  req@ffff9ee0056e8780 x1874670273108352/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828782 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828757.652505:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8780 x1874670273108352/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828782 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828757.652513:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828757.652515:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828757.652518:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273108352:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828757.652523:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273108480:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828757.652538:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828757.652546:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828757/real 1787828757]  req@ffff9ee0056ea940 x1874670273108480/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828782 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828757.652557:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ea940 x1874670273108480/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828782 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828757.652564:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828757.652567:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828757.652570:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273108480:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828758.483520:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828758.675460:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828759.507490:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828759.699439:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828760.531537:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828760.723430:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828761.555592:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828761.747425:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828762.579548:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828762.771449:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:0.0:1787828762.771459:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828762.771468:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1787828762.771473:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828762.771501:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3926
00000100:00080000:0.0:1787828762.771515:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828762.771527:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787828762.771573:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ea580 x1874670273108608/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828762.771615:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828762.771621:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787828762.771625:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828762.771632:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3926
00000100:00080000:0.0:1787828762.771639:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828762.771646:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828762.771660:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787828762.771681:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273108608:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787828762.771685:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ead00 x1874670273108736/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828762.771709:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828762.771715:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787828762.771718:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828762.771725:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3926
00000100:00080000:0.0:1787828762.771733:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828762.771739:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828762.771748:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828762.771768:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ea940 x1874670273108864/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1787828762.771772:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:0.0:1787828762.771811:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828762.771819:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787828762.771824:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828762.771835:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3926
00000100:00080000:0.0:1787828762.771845:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1787828762.771854:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828762/real 1787828762]  req@ffff9ee0056ea580 x1874670273108608/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828787 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828762.771862:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828762.771884:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787828762.771896:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ea580 x1874670273108608/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828787 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828762.771913:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:0.0:1787828762.771917:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8780 x1874670273108992/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787828762.771924:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828762.771938:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273108608:192.168.203.121@tcp:250:kworker.0
00000100:00080000:0.0:1787828762.772001:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828762.772006:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787828762.772010:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1787828762.772012:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273108736:192.168.203.121@tcp:38:kworker.0
00000100:00080000:0.0:1787828762.772021:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3926
00000100:00080000:0.0:1787828762.772029:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828762.772052:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828762.772061:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000800:00000100:1.0:1787828762.772062:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828762.772085:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828762/real 1787828762]  req@ffff9ee0056ead00 x1874670273108736/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828787 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787828762.772091:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9680 x1874670273109120/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828762.772137:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ead00 x1874670273108736/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828787 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828762.772145:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828762.772155:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787828762.772158:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787828762.772165:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00080000:0.0:1787828762.772169:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1787828762.772176:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273108736:192.168.203.121@tcp:38:kworker.0
00000100:00080000:0.0:1787828762.772200:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3926
00000100:00100000:1.0:1787828762.772206:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273108864:192.168.203.121@tcp:8:kworker.0
00000100:00080000:0.0:1787828762.772209:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828762.772220:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828762.772228:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1787828762.772235:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787828762.772251:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9a40 x1874670273109248/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828762.772257:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828762/real 1787828762]  req@ffff9ee0056ea940 x1874670273108864/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828787 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828762.772295:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828762.772304:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787828762.772308:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1787828762.772314:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ea940 x1874670273108864/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828787 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828762.772320:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3926
00000100:00080000:0.0:1787828762.772332:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828762.772345:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00080000:1.0:1787828762.772357:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000008:00100000:0.0:1787828762.772359:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:1.0:1787828762.772366:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828762.772373:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273108864:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828762.772381:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273108992:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787828762.772424:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb0c0 x1874670273109376/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1787828762.772468:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828762.772486:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828762/real 1787828762]  req@ffff9ee0056e8780 x1874670273108992/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828787 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828762.772522:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8780 x1874670273108992/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828787 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828762.772536:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828762.772541:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828762.772547:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273108992:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828762.772571:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273109120:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787828762.772595:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828762.772607:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828762/real 1787828762]  req@ffff9ee0056e9680 x1874670273109120/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828787 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828762.772619:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9680 x1874670273109120/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828787 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828762.772627:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828762.772630:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828762.772634:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273109120:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828762.772639:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273109248:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828762.772654:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828762.772662:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828762/real 1787828762]  req@ffff9ee0056e9a40 x1874670273109248/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828787 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828762.772679:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9a40 x1874670273109248/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828787 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828762.772688:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828762.772692:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828762.772697:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273109248:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828762.772705:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273109376:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828762.772732:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828762.772750:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828762/real 1787828762]  req@ffff9ee0056eb0c0 x1874670273109376/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828787 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828762.772769:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb0c0 x1874670273109376/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828787 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828762.772778:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828762.772781:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828762.772784:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273109376:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828763.603531:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828763.795509:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828764.627537:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828764.819485:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828765.651572:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828765.843442:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828766.675514:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828766.867477:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828767.699533:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828767.891420:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:2.0:1787828767.891430:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828767.891439:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787828767.891444:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828767.891456:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3931
00000100:00080000:2.0:1787828767.891470:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828767.891478:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787828767.891522:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572bc00 x1874670273109504/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828767.891551:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828767.891554:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787828767.891555:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828767.891558:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3931
00000100:00080000:2.0:1787828767.891560:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828767.891563:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828767.891573:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787828767.891582:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057292c0 x1874670273109632/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828767.891591:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828767.891595:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787828767.891596:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828767.891600:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3931
00000100:00080000:2.0:1787828767.891609:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1787828767.891610:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273109504:192.168.203.121@tcp:250:kworker.0
00000100:00080000:2.0:1787828767.891616:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828767.891623:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828767.891632:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729680 x1874670273109760/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828767.891639:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828767.891642:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787828767.891643:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828767.891646:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3931
00000100:00080000:2.0:1787828767.891648:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828767.891651:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828767.891655:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828767.891663:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728780 x1874670273109888/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828767.891670:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828767.891673:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787828767.891674:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828767.891678:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3931
00000100:00080000:2.0:1787828767.891681:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828767.891684:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828767.891688:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000800:00000100:1.0:1787828767.891692:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828767.891700:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a940 x1874670273110016/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828767.891711:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828767.891714:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787828767.891715:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828767.891718:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3931
00000100:00080000:2.0:1787828767.891721:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828767.891725:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828767.891731:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787828767.891739:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828767/real 1787828767]  req@ffff9ee00572bc00 x1874670273109504/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828792 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828767.891743:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729e00 x1874670273110144/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828767.891799:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828767.891801:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:1.0:1787828767.891803:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572bc00 x1874670273109504/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828792 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828767.891804:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828767.891819:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3931
00000100:00080000:2.0:1787828767.891832:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828767.891836:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828767.891837:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00080000:1.0:1787828767.891848:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000008:00100000:2.0:1787828767.891848:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787828767.891862:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273109504:192.168.203.121@tcp:250:kworker.0
00000100:00100000:2.0:1787828767.891868:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a1c0 x1874670273110272/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828767.891889:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057292c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273109632:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787828767.891927:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828767.891938:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828767/real 1787828767]  req@ffff9ee0057292c0 x1874670273109632/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828792 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828767.891947:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057292c0 x1874670273109632/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828792 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828767.891953:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828767.891956:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828767.891958:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057292c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273109632:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828767.891963:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273109760:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828767.891976:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828767.891982:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828767/real 1787828767]  req@ffff9ee005729680 x1874670273109760/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828792 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828767.891994:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729680 x1874670273109760/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828792 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828767.891999:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828767.892001:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828767.892002:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273109760:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828767.892006:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273109888:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828767.892015:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828767.892021:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828767/real 1787828767]  req@ffff9ee005728780 x1874670273109888/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828792 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828767.892028:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728780 x1874670273109888/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828792 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828767.892033:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828767.892034:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828767.892036:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273109888:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828767.892040:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273110016:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787828767.892049:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828767.892054:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828767/real 1787828767]  req@ffff9ee00572a940 x1874670273110016/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828792 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828767.892061:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a940 x1874670273110016/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828792 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828767.892070:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828767.892072:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828767.892074:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273110016:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828767.892077:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273110144:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828767.892087:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828767.892092:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828767/real 1787828767]  req@ffff9ee005729e00 x1874670273110144/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828792 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828767.892099:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729e00 x1874670273110144/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828792 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828767.892104:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828767.892106:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828767.892107:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273110144:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828767.892111:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273110272:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828767.892120:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828767.892125:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828767/real 1787828767]  req@ffff9ee00572a1c0 x1874670273110272/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828792 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828767.892131:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a1c0 x1874670273110272/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828792 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828767.892136:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828767.892138:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828767.892140:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273110272:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828768.723582:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828768.915418:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828769.747448:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828769.939380:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828770.771457:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828770.963412:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828771.795463:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828771.987418:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828772.819559:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828773.011401:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:2.0:1787828773.011402:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828773.011412:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787828773.011418:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828773.011428:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3936
00000100:00080000:2.0:1787828773.011440:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828773.011448:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787828773.011493:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057283c0 x1874670273110400/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828773.011519:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828773.011521:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787828773.011523:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828773.011526:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3936
00000100:00080000:2.0:1787828773.011530:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828773.011533:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828773.011542:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787828773.011550:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273110400:192.168.203.121@tcp:250:kworker.0
00000100:00100000:2.0:1787828773.011555:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728000 x1874670273110528/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828773.011564:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828773.011567:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787828773.011568:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828773.011571:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3936
00000100:00080000:2.0:1787828773.011573:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828773.011576:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828773.011579:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828773.011594:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a580 x1874670273110656/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828773.011601:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828773.011603:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787828773.011604:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828773.011608:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3936
00000800:00000100:1.0:1787828773.011609:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:2.0:1787828773.011611:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828773.011614:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828773.011618:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828773.011632:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728b40 x1874670273110784/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828773.011642:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828773.011646:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787828773.011647:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828773.011652:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3936
00000100:00080000:2.0:1787828773.011656:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1787828773.011662:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828773/real 1787828773]  req@ffff9ee0057283c0 x1874670273110400/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828798 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828773.011663:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828773.011672:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787828773.011689:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728f00 x1874670273110912/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828773.011691:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057283c0 x1874670273110400/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828798 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828773.011705:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828773.011713:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787828773.011715:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787828773.011716:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828773.011720:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3936
00000100:00080000:1.0:1787828773.011724:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:2.0:1787828773.011726:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1787828773.011730:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273110400:192.168.203.121@tcp:250:kworker.0
00000100:00080000:2.0:1787828773.011732:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828773.011740:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828773.011748:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b840 x1874670273111040/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828773.011756:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1787828773.011758:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273110528:192.168.203.121@tcp:38:kworker.0
00000100:00080000:2.0:1787828773.011759:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787828773.011762:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828773.011767:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3936
00000100:00080000:2.0:1787828773.011770:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828773.011773:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828773.011777:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1787828773.011788:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828773.011789:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729a40 x1874670273111168/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828773.011803:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828773/real 1787828773]  req@ffff9ee005728000 x1874670273110528/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828798 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828773.011813:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728000 x1874670273110528/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828798 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828773.011819:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828773.011821:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828773.011824:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273110528:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828773.011828:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273110656:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828773.011840:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828773.011847:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828773/real 1787828773]  req@ffff9ee00572a580 x1874670273110656/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828798 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828773.011855:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a580 x1874670273110656/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828798 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828773.011863:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828773.011866:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828773.011869:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273110656:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828773.011887:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273110784:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828773.011908:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828773.011920:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828773/real 1787828773]  req@ffff9ee005728b40 x1874670273110784/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828798 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828773.011930:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728b40 x1874670273110784/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828798 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828773.011935:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828773.011937:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828773.011939:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273110784:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828773.011943:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273110912:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787828773.011956:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828773.011963:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828773/real 1787828773]  req@ffff9ee005728f00 x1874670273110912/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828798 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828773.011970:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728f00 x1874670273110912/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828798 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828773.011975:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828773.011977:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828773.011979:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273110912:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828773.011992:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273111040:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828773.012002:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828773.012008:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828773/real 1787828773]  req@ffff9ee00572b840 x1874670273111040/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828798 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828773.012015:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b840 x1874670273111040/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828798 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828773.012020:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828773.012021:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828773.012023:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273111040:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828773.012026:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273111168:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828773.012035:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828773.012041:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828773/real 1787828773]  req@ffff9ee005729a40 x1874670273111168/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828798 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828773.012047:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729a40 x1874670273111168/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828798 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828773.012052:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828773.012054:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828773.012056:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273111168:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828773.843567:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828774.035433:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828774.867567:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828775.059462:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828775.891462:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828776.083419:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828776.915483:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828777.107409:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828777.939481:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828778.131420:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:2.0:1787828778.131433:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828778.131439:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787828778.131442:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828778.131451:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3941
00000100:00080000:2.0:1787828778.131462:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828778.131469:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787828778.131503:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572ad00 x1874670273111296/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828778.131523:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828778.131526:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787828778.131527:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828778.131530:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3941
00000100:00080000:2.0:1787828778.131532:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828778.131535:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828778.131544:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787828778.131559:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273111296:192.168.203.121@tcp:250:kworker.0
00000100:00100000:2.0:1787828778.131567:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b480 x1874670273111424/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828778.131577:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828778.131580:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787828778.131582:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828778.131584:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3941
00000100:00080000:2.0:1787828778.131586:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828778.131589:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828778.131593:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828778.131601:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b0c0 x1874670273111552/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828778.131608:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828778.131610:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787828778.131612:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828778.131614:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3941
00000100:00080000:2.0:1787828778.131618:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828778.131620:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828778.131624:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1787828778.131630:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828778.131641:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729a40 x1874670273111680/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828778.131653:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828778.131657:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787828778.131658:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828778.131663:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3941
00000100:00080000:2.0:1787828778.131667:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828778.131672:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828778.131677:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787828778.131693:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828778/real 1787828778]  req@ffff9ee00572ad00 x1874670273111296/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828803 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828778.131695:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b840 x1874670273111808/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828778.131721:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1787828778.131726:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572ad00 x1874670273111296/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828803 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828778.131727:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787828778.131749:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787828778.131761:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828778.131762:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3941
00000100:00080000:1.0:1787828778.131770:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:2.0:1787828778.131772:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1787828778.131775:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273111296:192.168.203.121@tcp:250:kworker.0
00000100:00080000:2.0:1787828778.131783:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828778.131791:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787828778.131801:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273111424:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787828778.131809:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728f00 x1874670273111936/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828778.131826:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:1.0:1787828778.131829:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:2.0:1787828778.131831:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787828778.131850:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828778.131857:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3941
00000100:00080000:2.0:1787828778.131862:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1787828778.131866:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828778/real 1787828778]  req@ffff9ee00572b480 x1874670273111424/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828803 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828778.131870:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828778.131894:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787828778.131901:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b480 x1874670273111424/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828803 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828778.131908:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728b40 x1874670273112064/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787828778.131913:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828778.131922:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828778.131928:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273111424:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828778.131933:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273111552:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828778.131953:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828778.131961:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828778/real 1787828778]  req@ffff9ee00572b0c0 x1874670273111552/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828803 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828778.131969:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b0c0 x1874670273111552/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828803 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828778.131974:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828778.131976:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828778.131979:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273111552:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828778.131983:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273111680:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828778.131994:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828778.132000:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828778/real 1787828778]  req@ffff9ee005729a40 x1874670273111680/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828803 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828778.132007:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729a40 x1874670273111680/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828803 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828778.132012:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828778.132014:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828778.132017:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273111680:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828778.132021:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273111808:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787828778.132031:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828778.132037:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828778/real 1787828778]  req@ffff9ee00572b840 x1874670273111808/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828803 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828778.132044:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b840 x1874670273111808/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828803 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828778.132049:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828778.132051:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828778.132053:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273111808:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828778.132065:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273111936:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828778.132076:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828778.132082:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828778/real 1787828778]  req@ffff9ee005728f00 x1874670273111936/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828803 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828778.132089:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728f00 x1874670273111936/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828803 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828778.132095:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828778.132097:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828778.132099:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273111936:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828778.132102:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273112064:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828778.132112:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828778.132118:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828778/real 1787828778]  req@ffff9ee005728b40 x1874670273112064/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828803 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828778.132126:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728b40 x1874670273112064/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828803 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828778.132131:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828778.132133:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828778.132135:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273112064:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828778.963572:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828779.155413:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828779.987580:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828780.179412:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828781.011521:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828781.203409:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828782.035458:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828782.227401:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828783.059495:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828783.251447:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:0.0:1787828783.251456:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828783.251464:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1787828783.251469:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828783.251479:0:27626:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3946
00000100:00080000:0.0:1787828783.251488:0:27626:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828783.251494:0:27626:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787828783.251538:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9e00 x1874670273112192/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828783.251560:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828783.251563:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787828783.251565:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828783.251567:0:27626:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3946
00000100:00080000:0.0:1787828783.251570:0:27626:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828783.251574:0:27626:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828783.251582:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787828783.251591:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8b40 x1874670273112320/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828783.251615:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1787828783.251615:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273112192:192.168.203.121@tcp:250:kworker.0
00000100:00080000:0.0:1787828783.251632:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787828783.251635:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828783.251638:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3946
00000100:00080000:0.0:1787828783.251640:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828783.251643:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828783.251646:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828783.251658:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e92c0 x1874670273112448/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828783.251664:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828783.251667:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787828783.251669:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828783.251672:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3946
00000100:00080000:0.0:1787828783.251674:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828783.251677:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828783.251679:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828783.251687:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb840 x1874670273112576/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828783.251699:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828783.251701:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787828783.251702:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828783.251705:0:27626:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3946
00000100:00080000:0.0:1787828783.251709:0:27626:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828783.251711:0:27626:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828783.251714:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787828783.251722:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb480 x1874670273112704/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828783.251732:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828783.251736:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787828783.251740:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828783.251749:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3946
00000100:00080000:0.0:1787828783.251754:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828783.251759:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787828783.251763:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273112320:192.168.203.121@tcp:38:kworker.0
00000008:00100000:0.0:1787828783.251771:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828783.251792:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8000 x1874670273112832/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828783.251811:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273112448:192.168.203.121@tcp:8:kworker.0
00000100:00080000:0.0:1787828783.251821:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828783.251826:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787828783.251828:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828783.251833:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3946
00000100:00080000:0.0:1787828783.251839:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828783.251843:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828783.251858:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787828783.251869:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273112576:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787828783.251875:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e83c0 x1874670273112960/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828783.251910:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273112704:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828783.251932:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273112832:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828783.251947:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273112960:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828784.083533:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828784.275413:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828785.107469:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828785.299396:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828786.131496:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828786.323404:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000400:00000100:2.0:1787828786.323581:0:2352:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.203.121:988
00000400:00000100:2.0:1787828786.323622:0:2352:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.203.121@tcp at host 192.168.203.121 was unreachable: the network or that node may be down, or Lustre may be misconfigured.
00000800:00000100:2.0:1787828786.323638:0:2352:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:2.0:1787828786.323668:0:2352:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:2.0:1787828786.323675:0:2352:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:2.0:1787828786.323684:0:2352:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:2.0:1787828786.323696:0:2352:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:2.0:1787828786.323724:0:2352:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:2.0:1787828786.323733:0:2352:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000100:00100000:1.0:1787828786.323738:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828783/real 1787828786]  req@ffff9ee0056e8b40 x1874670273112320/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828808 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828786.323763:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8b40 x1874670273112320/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828808 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828786.323776:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828786.323796:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828786.323800:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273112320:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828786.323808:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828783/real 1787828786]  req@ffff9ee0056e92c0 x1874670273112448/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828808 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828786.323823:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e92c0 x1874670273112448/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828808 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828786.323832:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828786.323836:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828786.323840:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273112448:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828786.323847:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828783/real 1787828786]  req@ffff9ee0056eb840 x1874670273112576/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828808 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828786.323855:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb840 x1874670273112576/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828808 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828786.323861:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828786.323863:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828786.323866:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273112576:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828786.323872:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828783/real 1787828786]  req@ffff9ee0056eb480 x1874670273112704/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828808 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828786.323879:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb480 x1874670273112704/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828808 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828786.323885:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828786.323888:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828786.323891:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273112704:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828786.323897:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828783/real 1787828786]  req@ffff9ee0056e9e00 x1874670273112192/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828808 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828786.323910:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9e00 x1874670273112192/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828808 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828786.323919:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828786.323923:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828786.323926:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273112192:192.168.203.121@tcp:250:kworker.0
00000100:00100000:1.0:1787828786.323952:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828783/real 1787828786]  req@ffff9ee0056e8000 x1874670273112832/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828808 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828786.323965:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8000 x1874670273112832/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828808 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828786.323972:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828786.323976:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828786.323979:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273112832:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828786.323987:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828783/real 1787828786]  req@ffff9ee0056e83c0 x1874670273112960/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828808 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828786.324010:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e83c0 x1874670273112960/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828808 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828786.324019:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828786.324023:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828786.324026:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273112960:192.168.203.121@tcp:8:kworker.0
00010000:00010000:3.0:1787828787.155568:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828787.347442:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828788.179569:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1787828788.371454:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1787828788.371456:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:0.0:1787828788.371468:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1787828788.371474:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828788.371487:0:27626:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3952
00000100:00080000:0.0:1787828788.371502:0:27626:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828788.371513:0:27626:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787828788.371565:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8f00 x1874670273113088/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828788.371615:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828788.371621:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787828788.371623:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828788.371631:0:27626:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3952
00000100:00080000:0.0:1787828788.371638:0:27626:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828788.371645:0:27626:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828788.371665:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787828788.371673:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273113088:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787828788.371686:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ebc00 x1874670273113216/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828788.371708:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828788.371712:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787828788.371715:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828788.371720:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3952
00000100:00080000:0.0:1787828788.371750:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828788.371757:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000800:00000100:1.0:1787828788.371762:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000008:00100000:0.0:1787828788.371781:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828788.371802:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e83c0 x1874670273113344/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828788.371814:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828788.371819:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787828788.371824:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828788.371830:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3952
00000100:00080000:0.0:1787828788.371838:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828788.371844:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787828788.371850:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828788/real 1787828788]  req@ffff9ee0056e8f00 x1874670273113088/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828813 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:0.0:1787828788.371854:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828788.371880:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8000 x1874670273113472/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828788.371893:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1787828788.371896:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8f00 x1874670273113088/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828813 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828788.371899:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787828788.371904:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828788.371915:0:27626:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3952
00000100:00080000:1.0:1787828788.371922:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787828788.371924:0:27626:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828788.371934:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:0.0:1787828788.371935:0:27626:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828788.371945:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787828788.371946:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273113088:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787828788.371966:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9e00 x1874670273113600/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828788.371977:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828788.371982:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787828788.371984:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1787828788.371990:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273113216:192.168.203.121@tcp:38:kworker.0
00000100:00080000:0.0:1787828788.371991:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3952
00000100:00080000:0.0:1787828788.372000:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828788.372007:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828788.372013:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828788.372027:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb480 x1874670273113728/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1787828788.372038:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:0.0:1787828788.372042:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828788.372047:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787828788.372050:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828788.372056:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3952
00000100:00100000:1.0:1787828788.372060:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828788/real 1787828788]  req@ffff9ee0056ebc00 x1874670273113216/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828813 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828788.372063:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828788.372073:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828788.372082:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787828788.372100:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ebc00 x1874670273113216/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828813 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787828788.372102:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb840 x1874670273113856/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787828788.372134:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828788.372145:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828788.372152:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273113216:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828788.372167:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273113344:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828788.372196:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828788.372209:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828788/real 1787828788]  req@ffff9ee0056e83c0 x1874670273113344/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828813 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828788.372223:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e83c0 x1874670273113344/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828813 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828788.372232:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828788.372236:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828788.372240:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273113344:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828788.372248:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273113472:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828788.372276:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828788.372290:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828788/real 1787828788]  req@ffff9ee0056e8000 x1874670273113472/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828813 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828788.372304:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8000 x1874670273113472/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828813 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828788.372344:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828788.372347:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828788.372350:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273113472:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828788.372357:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273113600:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787828788.372380:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828788.372393:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828788/real 1787828788]  req@ffff9ee0056e9e00 x1874670273113600/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828813 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828788.372405:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9e00 x1874670273113600/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828813 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828788.372414:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828788.372418:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828788.372421:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273113600:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828788.372442:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273113728:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828788.372463:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828788.372476:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828788/real 1787828788]  req@ffff9ee0056eb480 x1874670273113728/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828813 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828788.372487:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb480 x1874670273113728/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828813 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828788.372495:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828788.372498:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828788.372502:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273113728:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828788.372508:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273113856:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828788.372526:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828788.372537:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828788/real 1787828788]  req@ffff9ee0056eb840 x1874670273113856/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828813 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828788.372549:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb840 x1874670273113856/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828813 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828788.372565:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828788.372569:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828788.372573:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273113856:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828789.203574:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828789.395441:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828790.227480:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828790.419424:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828791.251553:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828791.443425:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828792.275473:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828792.467401:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828793.299501:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828793.491448:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:2.0:1787828793.491448:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828793.491457:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787828793.491461:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828793.491469:0:27626:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3957
00000100:00080000:2.0:1787828793.491479:0:27626:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828793.491485:0:27626:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787828793.491518:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a580 x1874670273113984/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828793.491540:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828793.491543:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787828793.491544:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828793.491547:0:27626:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3957
00000100:00080000:2.0:1787828793.491549:0:27626:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828793.491552:0:27626:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828793.491560:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787828793.491569:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728000 x1874670273114112/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828793.491577:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1787828793.491579:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273113984:192.168.203.121@tcp:250:kworker.0
00000100:00080000:2.0:1787828793.491581:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787828793.491585:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828793.491592:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3957
00000100:00080000:2.0:1787828793.491596:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828793.491601:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828793.491606:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828793.491619:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057283c0 x1874670273114240/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828793.491630:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828793.491634:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787828793.491636:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828793.491639:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3957
00000100:00080000:2.0:1787828793.491642:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828793.491649:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000800:00000100:1.0:1787828793.491652:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000008:00100000:2.0:1787828793.491654:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828793.491667:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a1c0 x1874670273114368/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828793.491674:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828793.491676:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787828793.491677:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828793.491680:0:27626:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3957
00000100:00080000:2.0:1787828793.491682:0:27626:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828793.491685:0:27626:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828793.491689:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787828793.491697:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828793/real 1787828793]  req@ffff9ee00572a580 x1874670273113984/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828818 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828793.491698:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729e00 x1874670273114496/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828793.491720:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828793.491726:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787828793.491742:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828793.491747:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3957
00000100:00080000:2.0:1787828793.491751:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1787828793.491755:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a580 x1874670273113984/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828818 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828793.491757:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828793.491763:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828793.491776:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a940 x1874670273114624/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787828793.491777:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828793.491788:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:2.0:1787828793.491790:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828793.491795:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787828793.491797:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1787828793.491799:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273113984:192.168.203.121@tcp:250:kworker.0
00000100:00080000:2.0:1787828793.491802:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3957
00000100:00080000:2.0:1787828793.491806:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828793.491811:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828793.491814:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828793.491820:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728780 x1874670273114752/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828793.491834:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273114112:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787828793.491862:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828793.491878:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828793/real 1787828793]  req@ffff9ee005728000 x1874670273114112/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828818 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828793.491893:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728000 x1874670273114112/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828818 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828793.491902:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828793.491906:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828793.491910:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273114112:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828793.491917:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273114240:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828793.491938:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828793.491950:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828793/real 1787828793]  req@ffff9ee0057283c0 x1874670273114240/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828818 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828793.491963:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057283c0 x1874670273114240/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828818 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828793.491972:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828793.491986:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828793.491990:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273114240:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828793.492001:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273114368:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828793.492023:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828793.492036:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828793/real 1787828793]  req@ffff9ee00572a1c0 x1874670273114368/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828818 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828793.492049:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a1c0 x1874670273114368/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828818 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828793.492058:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828793.492061:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828793.492065:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273114368:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828793.492071:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273114496:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787828793.492093:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828793.492105:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828793/real 1787828793]  req@ffff9ee005729e00 x1874670273114496/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828818 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828793.492119:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729e00 x1874670273114496/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828818 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828793.492128:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828793.492131:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828793.492135:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273114496:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828793.492141:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273114624:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828793.492162:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828793.492175:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828793/real 1787828793]  req@ffff9ee00572a940 x1874670273114624/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828818 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828793.492189:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a940 x1874670273114624/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828818 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828793.492198:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828793.492201:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828793.492205:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273114624:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828793.492211:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273114752:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828793.492232:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828793.492243:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828793/real 1787828793]  req@ffff9ee005728780 x1874670273114752/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828818 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828793.492255:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728780 x1874670273114752/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828818 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828793.492264:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828793.492267:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828793.492271:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273114752:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828794.323534:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828794.515440:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828795.347478:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828795.539439:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828796.371501:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828796.563382:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828797.395455:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828797.587450:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828798.419477:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828798.611417:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:0.0:1787828798.611530:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828798.611544:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1787828798.611549:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828798.611576:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3962
00000100:00080000:0.0:1787828798.611588:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828798.611595:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787828798.611648:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e92c0 x1874670273114880/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828798.611679:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828798.611683:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787828798.611685:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828798.611689:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3962
00000100:00080000:0.0:1787828798.611710:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828798.611716:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828798.611744:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787828798.611748:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273114880:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787828798.611759:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8b40 x1874670273115008/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828798.611772:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828798.611775:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787828798.611778:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828798.611780:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3962
00000100:00080000:0.0:1787828798.611783:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828798.611787:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828798.611791:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828798.611800:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb0c0 x1874670273115136/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828798.611806:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828798.611808:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787828798.611810:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828798.611814:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3962
00000100:00080000:0.0:1787828798.611816:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828798.611818:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828798.611822:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1787828798.611827:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787828798.611833:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9a40 x1874670273115264/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828798.611841:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828798.611843:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787828798.611846:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828798.611851:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3962
00000100:00080000:0.0:1787828798.611858:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828798.611861:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828798.611863:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787828798.611872:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9680 x1874670273115392/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828798.611880:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1787828798.611883:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828798/real 1787828798]  req@ffff9ee0056e92c0 x1874670273114880/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828823 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828798.611884:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787828798.611888:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828798.611903:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3962
00000100:00080000:0.0:1787828798.611916:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1787828798.611916:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e92c0 x1874670273114880/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828823 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828798.611929:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828798.611945:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:1.0:1787828798.611948:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828798.611954:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787828798.611958:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8780 x1874670273115520/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828798.611959:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273114880:192.168.203.121@tcp:250:kworker.0
00000100:00080000:0.0:1787828798.611987:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828798.611989:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787828798.611992:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828798.611995:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3962
00000100:00080000:0.0:1787828798.611999:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828798.612001:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787828798.612007:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273115008:192.168.203.121@tcp:38:kworker.0
00000008:00100000:0.0:1787828798.612009:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828798.612027:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ea940 x1874670273115648/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1787828798.612039:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828798.612054:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828798/real 1787828798]  req@ffff9ee0056e8b40 x1874670273115008/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828823 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828798.612064:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8b40 x1874670273115008/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828823 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828798.612071:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828798.612073:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828798.612076:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273115008:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828798.612080:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273115136:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828798.612093:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828798.612099:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828798/real 1787828798]  req@ffff9ee0056eb0c0 x1874670273115136/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828823 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828798.612106:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb0c0 x1874670273115136/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828823 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828798.612111:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828798.612113:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828798.612115:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273115136:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828798.612120:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273115264:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828798.612130:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828798.612136:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828798/real 1787828798]  req@ffff9ee0056e9a40 x1874670273115264/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828823 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828798.612143:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9a40 x1874670273115264/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828823 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828798.612148:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828798.612150:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828798.612152:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273115264:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828798.612156:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273115392:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787828798.612166:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828798.612176:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828798/real 1787828798]  req@ffff9ee0056e9680 x1874670273115392/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828823 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828798.612188:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9680 x1874670273115392/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828823 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828798.612197:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828798.612200:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828798.612204:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273115392:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828798.612211:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273115520:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828798.612230:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828798.612241:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828798/real 1787828798]  req@ffff9ee0056e8780 x1874670273115520/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828823 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828798.612253:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8780 x1874670273115520/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828823 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828798.612262:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828798.612265:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828798.612267:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273115520:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828798.612283:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273115648:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828798.612298:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828798.612305:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828798/real 1787828798]  req@ffff9ee0056ea940 x1874670273115648/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828823 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828798.612313:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ea940 x1874670273115648/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828823 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828798.612338:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828798.612341:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828798.612343:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273115648:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828799.443505:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828799.635446:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828800.467479:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828800.659427:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828801.491648:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828801.683428:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828802.515467:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828802.707507:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828803.539517:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1787828803.731407:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1787828803.731409:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:0.0:1787828803.731419:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1787828803.731425:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828803.731435:0:27626:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3967
00000100:00080000:0.0:1787828803.731448:0:27626:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828803.731457:0:27626:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787828803.731511:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ead00 x1874670273115776/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828803.731538:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828803.731541:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787828803.731542:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828803.731546:0:27626:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3967
00000100:00080000:0.0:1787828803.731549:0:27626:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828803.731552:0:27626:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828803.731562:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787828803.731573:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ea580 x1874670273115904/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828803.731582:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828803.731586:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787828803.731589:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1787828803.731589:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273115776:192.168.203.121@tcp:250:kworker.0
00000100:00080000:0.0:1787828803.731597:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3967
00000100:00080000:0.0:1787828803.731600:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828803.731603:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828803.731606:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828803.731616:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ea940 x1874670273116032/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828803.731628:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828803.731631:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787828803.731633:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828803.731635:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3967
00000100:00080000:0.0:1787828803.731655:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828803.731673:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828803.731677:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1787828803.731683:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787828803.731689:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8780 x1874670273116160/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828803.731728:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828803.731732:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787828803.731735:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828803.731739:0:27626:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3967
00000100:00080000:0.0:1787828803.731744:0:27626:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828803.731748:0:27626:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828803.731753:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787828803.731765:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9680 x1874670273116288/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828803.731775:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828803.731780:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787828803.731784:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1787828803.731786:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828803/real 1787828803]  req@ffff9ee0056ead00 x1874670273115776/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828828 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828803.731799:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3967
00000100:00080000:0.0:1787828803.731807:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828803.731817:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828803.731822:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787828803.731827:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ead00 x1874670273115776/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828828 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787828803.731852:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9a40 x1874670273116416/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787828803.731858:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787828803.731864:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828803.731867:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:0.0:1787828803.731869:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787828803.731873:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1787828803.731877:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273115776:192.168.203.121@tcp:250:kworker.0
00000100:00080000:0.0:1787828803.731880:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3967
00000100:00080000:0.0:1787828803.731888:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828803.731891:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828803.731894:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828803.731902:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb0c0 x1874670273116544/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828803.731912:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273115904:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787828803.731965:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828803.731985:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828803/real 1787828803]  req@ffff9ee0056ea580 x1874670273115904/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828828 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828803.732001:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ea580 x1874670273115904/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828828 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828803.732012:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828803.732016:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828803.732020:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273115904:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828803.732027:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273116032:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828803.732050:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828803.732061:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828803/real 1787828803]  req@ffff9ee0056ea940 x1874670273116032/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828828 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828803.732075:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ea940 x1874670273116032/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828828 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828803.732109:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828803.732112:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828803.732116:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273116032:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828803.732121:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273116160:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828803.732136:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828803.732144:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828803/real 1787828803]  req@ffff9ee0056e8780 x1874670273116160/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828828 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828803.732170:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8780 x1874670273116160/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828828 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828803.732176:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828803.732178:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828803.732180:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273116160:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828803.732183:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273116288:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787828803.732196:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828803.732201:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828803/real 1787828803]  req@ffff9ee0056e9680 x1874670273116288/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828828 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828803.732208:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9680 x1874670273116288/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828828 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828803.732213:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828803.732215:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828803.732217:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273116288:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828803.732239:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273116416:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828803.732251:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828803.732257:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828803/real 1787828803]  req@ffff9ee0056e9a40 x1874670273116416/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828828 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828803.732265:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9a40 x1874670273116416/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828828 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828803.732271:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828803.732273:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828803.732275:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273116416:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828803.732298:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273116544:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828803.732311:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828803.732353:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828803/real 1787828803]  req@ffff9ee0056eb0c0 x1874670273116544/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828828 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828803.732361:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb0c0 x1874670273116544/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828828 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828803.732367:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828803.732369:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828803.732372:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273116544:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828804.563525:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828804.755430:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828805.587706:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828805.779403:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828806.611585:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828806.803403:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828807.635480:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828807.827478:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828808.659620:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1787828808.851515:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828808.851532:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00100000:1.0:1787828808.851538:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:0.0:1787828808.851541:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828808.851562:0:27626:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3972
00000100:00080000:0.0:1787828808.851581:0:27626:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828808.851594:0:27626:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787828808.851707:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8b40 x1874670273116672/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828808.851758:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828808.851764:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787828808.851766:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828808.851771:0:27626:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3972
00000100:00080000:0.0:1787828808.851776:0:27626:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828808.851781:0:27626:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828808.851797:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787828808.851820:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e92c0 x1874670273116800/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828808.851842:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828808.851850:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00100000:1.0:1787828808.851859:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273116672:192.168.203.121@tcp:250:kworker.0
00000100:00080000:0.0:1787828808.851860:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828808.851880:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3972
00000100:00080000:0.0:1787828808.851886:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828808.851893:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828808.851901:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828808.851919:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb840 x1874670273116928/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828808.851933:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828808.851937:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787828808.851940:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828808.851945:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3972
00000100:00080000:0.0:1787828808.851962:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828808.851967:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828808.851974:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1787828808.851981:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787828808.851997:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb480 x1874670273117056/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828808.852012:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828808.852017:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787828808.852021:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828808.852030:0:27626:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3972
00000100:00080000:0.0:1787828808.852038:0:27626:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828808.852047:0:27626:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828808.852057:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787828808.852064:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828808/real 1787828808]  req@ffff9ee0056e8b40 x1874670273116672/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828833 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787828808.852086:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9e00 x1874670273117184/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828808.852109:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1787828808.852111:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8b40 x1874670273116672/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828833 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828808.852124:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787828808.852131:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828808.852162:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3972
00000100:00080000:1.0:1787828808.852165:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787828808.852167:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828808.852173:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:0.0:1787828808.852178:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787828808.852183:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273116672:192.168.203.121@tcp:250:kworker.0
00000008:00100000:0.0:1787828808.852191:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828808.852213:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8000 x1874670273117312/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828808.852218:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273116800:192.168.203.121@tcp:38:kworker.0
00000100:00080000:0.0:1787828808.852244:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828808.852249:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787828808.852252:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828808.852260:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3972
00000800:00000100:1.0:1787828808.852265:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:0.0:1787828808.852270:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828808.852280:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828808.852288:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787828808.852305:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828808/real 1787828808]  req@ffff9ee0056e92c0 x1874670273116800/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828833 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787828808.852311:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e83c0 x1874670273117440/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828808.852353:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e92c0 x1874670273116800/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828833 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828808.852376:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828808.852382:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828808.852390:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273116800:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828808.852401:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273116928:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828808.852438:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828808.852450:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828808/real 1787828808]  req@ffff9ee0056eb840 x1874670273116928/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828833 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828808.852461:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb840 x1874670273116928/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828833 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828808.852469:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828808.852472:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828808.852475:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273116928:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828808.852480:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273117056:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828808.852495:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828808.852502:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828808/real 1787828808]  req@ffff9ee0056eb480 x1874670273117056/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828833 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828808.852512:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb480 x1874670273117056/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828833 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828808.852519:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828808.852521:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828808.852523:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273117056:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828808.852528:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273117184:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787828808.852559:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828808.852570:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828808/real 1787828808]  req@ffff9ee0056e9e00 x1874670273117184/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828833 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828808.852593:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9e00 x1874670273117184/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828833 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828808.852603:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828808.852606:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828808.852609:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273117184:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828808.852681:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273117312:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828808.852700:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828808.852710:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828808/real 1787828808]  req@ffff9ee0056e8000 x1874670273117312/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828833 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828808.852719:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8000 x1874670273117312/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828833 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828808.852726:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828808.852729:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828808.852732:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273117312:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828808.852737:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273117440:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828808.852750:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828808.852757:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828808/real 1787828808]  req@ffff9ee0056e83c0 x1874670273117440/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828833 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828808.852766:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e83c0 x1874670273117440/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828833 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828808.852779:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828808.852782:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828808.852784:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273117440:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828809.683596:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828809.875459:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828810.707577:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828810.899484:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828811.731525:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828811.923412:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828812.755499:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828812.947494:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828813.779654:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828813.971414:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:2.0:1787828813.971462:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828813.971471:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787828813.971476:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828813.971484:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3977
00000100:00080000:2.0:1787828813.971494:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828813.971500:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787828813.971532:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729680 x1874670273117568/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828813.971560:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828813.971563:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787828813.971565:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828813.971568:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3977
00000100:00080000:2.0:1787828813.971571:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828813.971576:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828813.971598:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787828813.971614:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273117568:192.168.203.121@tcp:250:kworker.0
00000100:00100000:2.0:1787828813.971618:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057292c0 x1874670273117696/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828813.971658:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828813.971662:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787828813.971664:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828813.971670:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3977
00000100:00080000:2.0:1787828813.971673:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828813.971678:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828813.971683:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828813.971695:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572bc00 x1874670273117824/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828813.971705:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828813.971709:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787828813.971711:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828813.971714:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3977
00000100:00080000:2.0:1787828813.971718:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828813.971720:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828813.971724:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828813.971732:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728780 x1874670273117952/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828813.971740:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828813.971742:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787828813.971744:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:1.0:1787828813.971754:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:2.0:1787828813.971762:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3977
00000100:00080000:2.0:1787828813.971768:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828813.971771:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828813.971776:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787828813.971791:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a940 x1874670273118080/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828813.971797:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828813.971801:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787828813.971802:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828813.971806:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3977
00000100:00080000:2.0:1787828813.971811:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828813.971814:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828813.971818:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828813.971836:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729e00 x1874670273118208/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828813.971843:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828813.971846:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787828813.971850:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1787828813.971852:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828813/real 1787828813]  req@ffff9ee005729680 x1874670273117568/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828838 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828813.971860:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3977
00000100:00080000:2.0:1787828813.971871:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828813.971883:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828813.971899:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828813.971910:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a1c0 x1874670273118336/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828813.971923:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729680 x1874670273117568/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828838 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828813.971940:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828813.971945:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828813.971950:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273117568:192.168.203.121@tcp:250:kworker.0
00000100:00100000:1.0:1787828813.971998:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057292c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273117696:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787828813.972031:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828813.972041:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828813/real 1787828813]  req@ffff9ee0057292c0 x1874670273117696/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828838 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828813.972049:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057292c0 x1874670273117696/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828838 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828813.972056:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828813.972059:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828813.972061:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057292c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273117696:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828813.972066:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273117824:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828813.972078:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828813.972092:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828813/real 1787828813]  req@ffff9ee00572bc00 x1874670273117824/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828838 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828813.972100:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572bc00 x1874670273117824/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828838 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828813.972106:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828813.972108:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828813.972110:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273117824:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828813.972114:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273117952:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828813.972123:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828813.972129:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828813/real 1787828813]  req@ffff9ee005728780 x1874670273117952/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828838 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828813.972137:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728780 x1874670273117952/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828838 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828813.972142:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828813.972144:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828813.972147:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273117952:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828813.972151:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273118080:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787828813.972164:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828813.972169:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828813/real 1787828813]  req@ffff9ee00572a940 x1874670273118080/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828838 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828813.972176:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a940 x1874670273118080/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828838 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828813.972182:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828813.972184:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828813.972186:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273118080:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828813.972190:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273118208:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828813.972208:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828813.972214:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828813/real 1787828813]  req@ffff9ee005729e00 x1874670273118208/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828838 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828813.972221:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729e00 x1874670273118208/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828838 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828813.972226:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828813.972228:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828813.972230:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273118208:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828813.972234:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273118336:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828813.972245:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828813.972252:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828813/real 1787828813]  req@ffff9ee00572a1c0 x1874670273118336/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828838 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828813.972259:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a1c0 x1874670273118336/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828838 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828813.972265:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828813.972267:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828813.972270:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273118336:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828814.803499:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828814.995557:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828815.827625:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828816.019411:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828816.851646:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828817.043396:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828817.875514:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828818.067380:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828818.899506:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828819.091404:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:2.0:1787828819.091452:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828819.091460:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787828819.091464:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828819.091473:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3982
00000100:00080000:2.0:1787828819.091484:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828819.091490:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787828819.091529:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057283c0 x1874670273118464/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828819.091549:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828819.091562:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787828819.091564:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828819.091567:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3982
00000100:00080000:2.0:1787828819.091570:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828819.091573:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828819.091581:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787828819.091594:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728000 x1874670273118592/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828819.091605:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1787828819.091611:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273118464:192.168.203.121@tcp:250:kworker.0
00000100:00080000:2.0:1787828819.091613:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787828819.091620:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828819.091631:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3982
00000100:00080000:2.0:1787828819.091634:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828819.091636:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828819.091640:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828819.091648:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a580 x1874670273118720/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828819.091655:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828819.091657:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787828819.091659:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828819.091662:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3982
00000100:00080000:2.0:1787828819.091664:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828819.091666:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828819.091670:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828819.091679:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728b40 x1874670273118848/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828819.091685:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828819.091687:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787828819.091689:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828819.091694:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3982
00000100:00080000:2.0:1787828819.091696:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828819.091699:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828819.091702:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000800:00000100:1.0:1787828819.091707:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828819.091714:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728f00 x1874670273118976/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828819.091726:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828819.091730:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787828819.091732:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828819.091735:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3982
00000100:00080000:2.0:1787828819.091738:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828819.091741:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828819.091746:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828819.091758:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b840 x1874670273119104/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828819.091760:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828819/real 1787828819]  req@ffff9ee0057283c0 x1874670273118464/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828844 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828819.091822:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828819.091827:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787828819.091828:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828819.091836:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3982
00000100:00080000:2.0:1787828819.091841:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1787828819.091844:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057283c0 x1874670273118464/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828844 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828819.091852:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828819.091868:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:1.0:1787828819.091878:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:2.0:1787828819.091887:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729a40 x1874670273119232/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787828819.091891:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828819.091919:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273118464:192.168.203.121@tcp:250:kworker.0
00000100:00100000:1.0:1787828819.091951:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273118592:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787828819.091992:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828819.092004:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828819/real 1787828819]  req@ffff9ee005728000 x1874670273118592/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828844 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828819.092021:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728000 x1874670273118592/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828844 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828819.092029:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828819.092031:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828819.092034:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273118592:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828819.092040:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273118720:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828819.092055:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828819.092062:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828819/real 1787828819]  req@ffff9ee00572a580 x1874670273118720/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828844 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828819.092072:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a580 x1874670273118720/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828844 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828819.092078:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828819.092080:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828819.092082:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273118720:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828819.092086:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273118848:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828819.092098:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828819.092105:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828819/real 1787828819]  req@ffff9ee005728b40 x1874670273118848/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828844 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828819.092113:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728b40 x1874670273118848/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828844 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828819.092125:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828819.092127:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828819.092130:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273118848:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828819.092134:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273118976:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787828819.092145:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828819.092168:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828819/real 1787828819]  req@ffff9ee005728f00 x1874670273118976/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828844 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828819.092176:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728f00 x1874670273118976/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828844 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828819.092181:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828819.092183:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828819.092185:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273118976:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828819.092188:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273119104:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828819.092199:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828819.092205:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828819/real 1787828819]  req@ffff9ee00572b840 x1874670273119104/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828844 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828819.092230:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b840 x1874670273119104/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828844 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828819.092236:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828819.092238:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828819.092241:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273119104:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828819.092245:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273119232:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828819.092259:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828819.092266:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828819/real 1787828819]  req@ffff9ee005729a40 x1874670273119232/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828844 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828819.092273:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729a40 x1874670273119232/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828844 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828819.092279:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828819.092282:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828819.092284:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273119232:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828819.923565:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828820.115373:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828820.947723:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828821.139358:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828821.971613:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828822.163475:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828822.995604:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828823.187393:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828824.019505:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828824.211428:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787828824.211494:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828824.211499:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787828824.211504:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828824.211529:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3987
00000100:00080000:3.0:1787828824.211542:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828824.211567:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787828824.211621:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707c00 x1874670273119360/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828824.211667:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828824.211672:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787828824.211674:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828824.211678:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3987
00000100:00080000:3.0:1787828824.211683:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1787828824.211688:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273119360:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787828824.211692:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828824.211711:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787828824.211729:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705680 x1874670273119488/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828824.211740:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828824.211743:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787828824.211745:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828824.211749:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3987
00000100:00080000:3.0:1787828824.211752:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828824.211756:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828824.211762:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:2.0:1787828824.211767:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787828824.211790:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057061c0 x1874670273119616/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828824.211803:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828824.211806:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787828824.211808:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828824.211811:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3987
00000100:00080000:3.0:1787828824.211814:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828824.211817:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828824.211821:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787828824.211829:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707840 x1874670273119744/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828824.211839:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828824.211854:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00100000:2.0:1787828824.211858:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828824/real 1787828824]  req@ffff9ee005707c00 x1874670273119360/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828849 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828824.211858:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828824.211874:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3987
00000100:00080000:3.0:1787828824.211884:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828824.211896:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828824.211901:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787828824.211909:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707c00 x1874670273119360/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828849 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787828824.211920:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706940 x1874670273119872/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828824.211925:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828824.211930:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828824.211934:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273119360:192.168.203.121@tcp:250:kworker.0
00000100:00100000:2.0:1787828824.211954:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273119488:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787828824.211973:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828824.211982:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828824/real 1787828824]  req@ffff9ee005705680 x1874670273119488/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828849 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828824.211992:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705680 x1874670273119488/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828849 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828824.212002:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828824.212005:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828824.212018:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273119488:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787828824.212037:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273119616:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787828824.212051:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828824.212058:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828824/real 1787828824]  req@ffff9ee0057061c0 x1874670273119616/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828849 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828824.212067:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057061c0 x1874670273119616/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828849 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828824.212073:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828824.212075:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828824.212078:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273119616:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787828824.212082:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273119744:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787828824.212092:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828824.212098:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828824/real 1787828824]  req@ffff9ee005707840 x1874670273119744/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828849 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828824.212105:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707840 x1874670273119744/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828849 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828824.212111:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828824.212113:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828824.212115:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273119744:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787828824.212129:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273119872:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787828824.212146:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787828824.212157:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1787828824.212158:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828824/real 1787828824]  req@ffff9ee005706940 x1874670273119872/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828849 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828824.212171:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787828824.212174:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1787828824.212195:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706940 x1874670273119872/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828849 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828824.212206:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828824.212210:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828824.212214:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273119872:192.168.203.121@tcp:38:kworker.0
00000100:00080000:3.0:1787828824.212245:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3987
00000100:00080000:3.0:1787828824.212253:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828824.212258:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828824.212266:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787828824.212280:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057052c0 x1874670273120000/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828824.212297:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828824.212300:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787828824.212302:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828824.212309:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3987
00000100:00100000:2.0:1787828824.212336:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273120000:192.168.203.121@tcp:8:kworker.0
00000100:00080000:3.0:1787828824.212348:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828824.212360:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828824.212369:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:2.0:1787828824.212376:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787828824.212400:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707480 x1874670273120128/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787828824.212407:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828824/real 1787828824]  req@ffff9ee0057052c0 x1874670273120000/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828849 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828824.212439:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057052c0 x1874670273120000/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828849 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828824.212450:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828824.212454:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828824.212457:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273120000:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787828824.212474:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273120128:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787828824.212487:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828824.212494:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828824/real 1787828824]  req@ffff9ee005707480 x1874670273120128/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828849 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828824.212501:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707480 x1874670273120128/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828849 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828824.212506:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828824.212508:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828824.212510:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273120128:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828825.043465:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828825.235417:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828826.067672:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828826.259380:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828827.091549:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828827.283411:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828828.115454:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828828.307446:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828829.139549:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828829.331425:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:0.0:1787828829.331432:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828829.331438:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1787828829.331442:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828829.331451:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3993
00000100:00080000:0.0:1787828829.331461:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828829.331468:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787828829.331514:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ebc00 x1874670273120256/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828829.331543:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828829.331547:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787828829.331548:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828829.331552:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3993
00000100:00080000:0.0:1787828829.331554:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828829.331557:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828829.331567:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787828829.331584:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8f00 x1874670273120384/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787828829.331599:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273120256:192.168.203.121@tcp:250:kworker.0
00000100:00080000:0.0:1787828829.331600:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828829.331611:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787828829.331614:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828829.331619:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3993
00000100:00080000:0.0:1787828829.331625:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828829.331631:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828829.331638:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828829.331655:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e83c0 x1874670273120512/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1787828829.331667:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:0.0:1787828829.331673:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828829.331679:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787828829.331682:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828829.331688:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3993
00000100:00080000:0.0:1787828829.331694:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828829.331700:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828829.331707:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828829.331709:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828829/real 1787828829]  req@ffff9ee0056ebc00 x1874670273120256/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828854 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787828829.331729:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8000 x1874670273120640/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787828829.331730:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ebc00 x1874670273120256/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828854 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828829.331773:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787828829.331774:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828829.331778:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:0.0:1787828829.331781:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00100000:2.0:1787828829.331786:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273120256:192.168.203.121@tcp:250:kworker.0
00000100:00080000:0.0:1787828829.331787:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828829.331799:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3993
00000100:00080000:0.0:1787828829.331804:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828829.331807:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828829.331814:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787828829.331815:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273120384:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787828829.331831:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9e00 x1874670273120768/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1787828829.331841:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:0.0:1787828829.331844:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828829.331849:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787828829.331851:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1787828829.331856:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828829/real 1787828829]  req@ffff9ee0056e8f00 x1874670273120384/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828854 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828829.331858:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3993
00000100:00080000:0.0:1787828829.331865:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828829.331872:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828829.331880:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828829.331888:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8f00 x1874670273120384/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828854 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787828829.331894:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb480 x1874670273120896/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828829.331898:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828829.331910:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828829.331920:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273120384:192.168.203.121@tcp:38:kworker.0
00000100:00080000:0.0:1787828829.331928:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828829.331931:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787828829.331933:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1787828829.331935:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273120512:192.168.203.121@tcp:8:kworker.0
00000100:00080000:0.0:1787828829.331939:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3993
00000100:00080000:0.0:1787828829.331947:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828829.331950:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828829.331954:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828829.331965:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb840 x1874670273121024/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1787828829.331988:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828829.332005:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828829/real 1787828829]  req@ffff9ee0056e83c0 x1874670273120512/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828854 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828829.332022:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e83c0 x1874670273120512/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828854 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828829.332032:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828829.332036:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828829.332041:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273120512:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787828829.332049:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273120640:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787828829.332073:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828829.332084:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828829/real 1787828829]  req@ffff9ee0056e8000 x1874670273120640/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828854 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828829.332093:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8000 x1874670273120640/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828854 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828829.332104:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828829.332107:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828829.332110:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273120640:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787828829.332123:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273120768:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787828829.332137:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828829.332144:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828829/real 1787828829]  req@ffff9ee0056e9e00 x1874670273120768/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828854 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828829.332153:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9e00 x1874670273120768/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828854 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828829.332163:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828829.332167:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828829.332171:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273120768:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787828829.332178:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273120896:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787828829.332201:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828829.332215:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828829/real 1787828829]  req@ffff9ee0056eb480 x1874670273120896/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828854 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828829.332230:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb480 x1874670273120896/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828854 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828829.332236:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828829.332239:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828829.332242:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273120896:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787828829.332246:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273121024:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787828829.332262:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828829.332273:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828829/real 1787828829]  req@ffff9ee0056eb840 x1874670273121024/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828854 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828829.332288:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb840 x1874670273121024/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828854 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828829.332298:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828829.332302:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828829.332305:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273121024:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828830.163640:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828830.355410:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828831.187552:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828831.379412:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828832.211511:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828832.403432:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828833.235498:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828833.427406:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828834.259471:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1787828834.451383:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1787828834.451383:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:0.0:1787828834.451402:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1787828834.451407:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828834.451416:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 3998
00000100:00080000:0.0:1787828834.451433:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828834.451442:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787828834.451517:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e92c0 x1874670273121152/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828834.451545:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828834.451549:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787828834.451550:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828834.451554:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3998
00000100:00080000:0.0:1787828834.451559:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828834.451563:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828834.451573:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787828834.451585:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8b40 x1874670273121280/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828834.451598:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1787828834.451598:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273121152:192.168.203.121@tcp:250:kworker.0
00000100:00080000:0.0:1787828834.451624:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787828834.451626:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828834.451629:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3998
00000100:00080000:0.0:1787828834.451632:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828834.451634:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828834.451638:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828834.451646:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb0c0 x1874670273121408/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828834.451653:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828834.451656:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787828834.451657:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828834.451659:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 3998
00000100:00080000:0.0:1787828834.451662:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828834.451664:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828834.451667:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828834.451674:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9a40 x1874670273121536/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1787828834.451678:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:0.0:1787828834.451692:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828834.451694:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787828834.451696:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828834.451699:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3998
00000100:00080000:0.0:1787828834.451702:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828834.451704:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828834.451709:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787828834.451717:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828834/real 1787828834]  req@ffff9ee0056e92c0 x1874670273121152/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828859 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787828834.451718:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9680 x1874670273121664/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828834.451742:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828834.451748:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787828834.451749:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828834.451752:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3998
00000100:00080000:0.0:1787828834.451755:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828834.451757:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828834.451760:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828834.451762:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e92c0 x1874670273121152/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828859 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787828834.451769:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8780 x1874670273121792/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828834.451782:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828834.451787:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:0.0:1787828834.451790:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1787828834.451791:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273121152:192.168.203.121@tcp:250:kworker.0
00000100:00080000:0.0:1787828834.451795:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787828834.451799:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828834.451803:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 3998
00000100:00080000:0.0:1787828834.451806:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828834.451809:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828834.451812:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828834.451818:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273121280:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787828834.451822:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ea940 x1874670273121920/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1787828834.451847:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828834.451858:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828834/real 1787828834]  req@ffff9ee0056e8b40 x1874670273121280/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828859 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828834.451867:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8b40 x1874670273121280/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828859 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828834.451872:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828834.451875:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828834.451877:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273121280:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787828834.451881:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273121408:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787828834.451893:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828834.451899:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828834/real 1787828834]  req@ffff9ee0056eb0c0 x1874670273121408/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828859 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828834.451907:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb0c0 x1874670273121408/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828859 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828834.451912:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828834.451913:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828834.451915:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273121408:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787828834.451919:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273121536:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787828834.451929:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828834.451934:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828834/real 1787828834]  req@ffff9ee0056e9a40 x1874670273121536/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828859 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828834.451947:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9a40 x1874670273121536/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828859 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828834.451952:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828834.451953:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828834.451955:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273121536:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787828834.451959:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273121664:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787828834.451968:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828834.451973:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828834/real 1787828834]  req@ffff9ee0056e9680 x1874670273121664/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828859 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828834.451979:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9680 x1874670273121664/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828859 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828834.451984:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828834.451986:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828834.451988:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273121664:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787828834.451991:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273121792:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787828834.452000:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828834.452006:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828834/real 1787828834]  req@ffff9ee0056e8780 x1874670273121792/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828859 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828834.452012:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8780 x1874670273121792/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828859 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828834.452021:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828834.452023:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828834.452025:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273121792:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787828834.452036:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273121920:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787828834.452046:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828834.452052:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828834/real 1787828834]  req@ffff9ee0056ea940 x1874670273121920/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828859 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828834.452059:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ea940 x1874670273121920/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828859 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828834.452064:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828834.452066:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828834.452068:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273121920:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828835.283490:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828835.475373:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828836.307455:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828836.499413:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828837.331483:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828837.523437:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787828838.355476:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828838.547410:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828839.379502:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1787828839.571438:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1787828839.571439:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:1.0:1787828839.571452:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1787828839.571458:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787828839.571471:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4003
00000100:00080000:1.0:1787828839.571486:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828839.571495:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787828839.571543:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a03c0 x1874670273122048/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787828839.571569:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828839.571572:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787828839.571573:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787828839.571576:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4003
00000100:00080000:1.0:1787828839.571579:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828839.571583:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787828839.571593:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787828839.571603:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1e00 x1874670273122176/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787828839.571611:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828839.571614:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787828839.571615:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787828839.571618:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4003
00000100:00080000:1.0:1787828839.571621:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828839.571624:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787828839.571628:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787828839.571636:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0b40 x1874670273122304/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787828839.571644:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828839.571647:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787828839.571649:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787828839.571654:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4003
00000100:00080000:1.0:1787828839.571661:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1787828839.571663:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273122048:192.168.203.121@tcp:250:kworker.0
00000100:00080000:1.0:1787828839.571669:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787828839.571682:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787828839.571701:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a2580 x1874670273122432/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787828839.571713:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828839.571718:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787828839.571721:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787828839.571726:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4003
00000100:00080000:1.0:1787828839.571734:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828839.571740:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000800:00000100:2.0:1787828839.571742:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000008:00100000:1.0:1787828839.571752:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787828839.571770:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0000 x1874670273122560/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787828839.571782:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828839.571786:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787828839.571789:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1787828839.571791:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828839/real 1787828839]  req@ffff9ee0056a03c0 x1874670273122048/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828864 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828839.571799:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4003
00000100:00080000:1.0:1787828839.571813:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1787828839.571820:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a03c0 x1874670273122048/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828864 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828839.571822:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787828839.571842:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:2.0:1787828839.571843:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828839.571852:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828839.571857:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273122048:192.168.203.121@tcp:250:kworker.0
00000100:00100000:2.0:1787828839.571864:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273122176:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828839.571870:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0780 x1874670273122688/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787828839.571886:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:2.0:1787828839.571890:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:1.0:1787828839.571895:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787828839.571898:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787828839.571904:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4003
00000100:00100000:2.0:1787828839.571908:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828839/real 1787828839]  req@ffff9ee0056a1e00 x1874670273122176/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828864 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828839.571910:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1787828839.571924:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1e00 x1874670273122176/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828864 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828839.571929:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787828839.571944:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:2.0:1787828839.571946:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828839.571953:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828839.571956:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273122176:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828839.571968:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a3480 x1874670273122816/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787828839.571981:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273122304:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787828839.572003:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828839.572019:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828839/real 1787828839]  req@ffff9ee0056a0b40 x1874670273122304/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828864 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828839.572030:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0b40 x1874670273122304/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828864 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828839.572036:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828839.572039:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828839.572041:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273122304:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787828839.572044:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273122432:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787828839.572055:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828839.572061:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828839/real 1787828839]  req@ffff9ee0056a2580 x1874670273122432/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828864 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828839.572068:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a2580 x1874670273122432/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828864 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828839.572073:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828839.572075:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828839.572077:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273122432:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787828839.572080:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273122560:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787828839.572090:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828839.572096:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828839/real 1787828839]  req@ffff9ee0056a0000 x1874670273122560/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828864 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828839.572102:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0000 x1874670273122560/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828864 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828839.572107:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828839.572109:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828839.572111:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273122560:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787828839.572115:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273122688:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787828839.572124:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828839.572129:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828839/real 1787828839]  req@ffff9ee0056a0780 x1874670273122688/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828864 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828839.572141:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0780 x1874670273122688/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828864 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828839.572145:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828839.572147:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828839.572149:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273122688:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787828839.572159:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273122816:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787828839.572181:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828839.572188:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828839/real 1787828839]  req@ffff9ee0056a3480 x1874670273122816/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828864 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828839.572195:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a3480 x1874670273122816/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828864 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828839.572211:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828839.572213:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828839.572215:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273122816:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828840.403534:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828840.595490:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828841.427494:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828841.619374:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828842.451609:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828842.643413:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828843.475479:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828843.667457:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828844.499525:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1787828844.691488:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828844.691498:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787828844.691503:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1787828844.691513:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787828844.691513:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4008
00000100:00080000:3.0:1787828844.691528:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828844.691536:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787828844.691571:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706d00 x1874670273122944/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828844.691598:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828844.691601:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787828844.691603:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828844.691622:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4008
00000100:00080000:3.0:1787828844.691624:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828844.691627:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828844.691634:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787828844.691642:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704000 x1874670273123072/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828844.691649:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828844.691652:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787828844.691654:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828844.691656:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4008
00000100:00080000:3.0:1787828844.691658:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828844.691661:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828844.691664:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787828844.691672:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057070c0 x1874670273123200/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787828844.691679:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273122944:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787828844.691681:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828844.691687:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787828844.691691:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828844.691694:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4008
00000100:00080000:3.0:1787828844.691697:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828844.691699:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828844.691702:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787828844.691711:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057043c0 x1874670273123328/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828844.691724:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828844.691727:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787828844.691728:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828844.691731:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4008
00000100:00080000:3.0:1787828844.691737:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828844.691741:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828844.691746:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000800:00000100:2.0:1787828844.691753:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787828844.691760:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706580 x1874670273123456/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828844.691771:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828844.691775:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787828844.691777:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828844.691781:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4008
00000100:00080000:3.0:1787828844.691786:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828844.691790:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828844.691795:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787828844.691806:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704b40 x1874670273123584/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787828844.691812:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828844/real 1787828844]  req@ffff9ee005706d00 x1874670273122944/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828869 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828844.691834:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828844.691839:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787828844.691841:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828844.691844:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4008
00000100:00080000:3.0:1787828844.691847:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828844.691850:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787828844.691854:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706d00 x1874670273122944/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828869 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:3.0:1787828844.691855:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787828844.691867:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705e00 x1874670273123712/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828844.691872:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828844.691881:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828844.691891:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273122944:192.168.203.121@tcp:250:kworker.0
00000100:00100000:2.0:1787828844.691902:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273123072:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787828844.691929:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828844.691942:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828844/real 1787828844]  req@ffff9ee005704000 x1874670273123072/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828869 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828844.691955:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704000 x1874670273123072/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828869 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828844.691964:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828844.691968:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828844.691971:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273123072:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787828844.691995:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273123200:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787828844.692015:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828844.692027:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828844/real 1787828844]  req@ffff9ee0057070c0 x1874670273123200/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828869 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828844.692039:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057070c0 x1874670273123200/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828869 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828844.692048:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828844.692052:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828844.692066:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273123200:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787828844.692078:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273123328:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787828844.692106:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828844.692118:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828844/real 1787828844]  req@ffff9ee0057043c0 x1874670273123328/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828869 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828844.692131:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057043c0 x1874670273123328/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828869 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828844.692140:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828844.692144:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828844.692147:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273123328:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787828844.692154:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273123456:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787828844.692193:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828844.692207:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828844/real 1787828844]  req@ffff9ee005706580 x1874670273123456/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828869 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828844.692222:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706580 x1874670273123456/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828869 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828844.692233:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828844.692237:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828844.692241:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273123456:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787828844.692248:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273123584:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787828844.692284:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828844.692314:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828844/real 1787828844]  req@ffff9ee005704b40 x1874670273123584/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828869 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828844.692336:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704b40 x1874670273123584/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828869 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828844.692368:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828844.692384:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828844.692388:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273123584:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787828844.692395:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273123712:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787828844.692416:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828844.692433:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828844/real 1787828844]  req@ffff9ee005705e00 x1874670273123712/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828869 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828844.692446:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705e00 x1874670273123712/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828869 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828844.692454:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828844.692457:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828844.692460:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273123712:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828845.523495:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828845.715497:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828846.547558:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828846.739411:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828847.571585:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828847.763394:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828848.595567:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828848.787434:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828849.619499:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1787828849.811437:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1787828849.811440:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:0.0:1787828849.811451:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1787828849.811457:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828849.811469:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4013
00000100:00080000:0.0:1787828849.811484:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828849.811499:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787828849.811543:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ea580 x1874670273123840/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828849.811567:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828849.811570:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787828849.811571:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828849.811574:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4013
00000100:00080000:0.0:1787828849.811577:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828849.811581:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828849.811591:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787828849.811600:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ead00 x1874670273123968/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828849.811609:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1787828849.811611:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273123840:192.168.203.121@tcp:250:kworker.0
00000100:00080000:0.0:1787828849.811613:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787828849.811617:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828849.811621:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4013
00000100:00080000:0.0:1787828849.811624:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828849.811626:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828849.811630:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828849.811640:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ea940 x1874670273124096/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828849.811647:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828849.811650:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787828849.811651:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828849.811654:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4013
00000100:00080000:0.0:1787828849.811656:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828849.811658:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828849.811661:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828849.811668:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8780 x1874670273124224/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828849.811674:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828849.811677:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787828849.811679:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828849.811682:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4013
00000100:00080000:0.0:1787828849.811685:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828849.811687:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828849.811690:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787828849.811698:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9680 x1874670273124352/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828849.811704:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828849.811707:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787828849.811708:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828849.811711:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4013
00000100:00080000:0.0:1787828849.811713:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828849.811716:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828849.811720:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828849.811729:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9a40 x1874670273124480/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787828849.811733:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273123968:192.168.203.121@tcp:38:kworker.0
00000100:00080000:0.0:1787828849.811743:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828849.811746:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787828849.811747:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828849.811750:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4013
00000100:00080000:0.0:1787828849.811752:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828849.811755:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828849.811761:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828849.811768:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273124096:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787828849.811773:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb0c0 x1874670273124608/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787828849.811795:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273124224:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787828849.811809:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273124352:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787828849.811825:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273124480:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787828849.811840:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273124608:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828850.643533:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828850.835520:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828851.667604:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828851.859411:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828852.691484:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828852.883416:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000400:00000100:2.0:1787828852.883840:0:2355:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.203.121:988
00000400:00000100:2.0:1787828852.883897:0:2355:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.203.121@tcp at host 192.168.203.121 was unreachable: the network or that node may be down, or Lustre may be misconfigured.
00000800:00000100:2.0:1787828852.883921:0:2355:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:2.0:1787828852.883967:0:2355:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:2.0:1787828852.883978:0:2355:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:2.0:1787828852.883988:0:2355:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:2.0:1787828852.884001:0:2355:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000100:00100000:1.0:1787828852.884005:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828849/real 1787828852]  req@ffff9ee0056ead00 x1874670273123968/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828874 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000800:00000100:2.0:1787828852.884014:0:2355:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:2.0:1787828852.884029:0:2355:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000100:00100000:1.0:1787828852.884047:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ead00 x1874670273123968/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828874 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828852.884064:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828852.884071:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828852.884077:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273123968:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828852.884087:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828849/real 1787828852]  req@ffff9ee0056ea940 x1874670273124096/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828874 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828852.884103:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ea940 x1874670273124096/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828874 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828852.884118:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828852.884122:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828852.884126:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273124096:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828852.884134:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828849/real 1787828852]  req@ffff9ee0056e8780 x1874670273124224/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828874 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828852.884148:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8780 x1874670273124224/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828874 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828852.884163:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828852.884166:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828852.884170:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273124224:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828852.884177:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828849/real 1787828852]  req@ffff9ee0056e9680 x1874670273124352/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828874 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828852.884192:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9680 x1874670273124352/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828874 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828852.884200:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828852.884204:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828852.884208:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273124352:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828852.884215:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828849/real 1787828852]  req@ffff9ee0056ea580 x1874670273123840/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828874 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828852.884228:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ea580 x1874670273123840/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828874 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828852.884236:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828852.884240:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828852.884243:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273123840:192.168.203.121@tcp:250:kworker.0
00000100:00100000:1.0:1787828852.884275:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828849/real 1787828852]  req@ffff9ee0056e9a40 x1874670273124480/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828874 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828852.884289:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9a40 x1874670273124480/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828874 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828852.884298:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828852.884302:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828852.884305:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273124480:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828852.884312:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828849/real 1787828852]  req@ffff9ee0056eb0c0 x1874670273124608/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828874 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828852.884375:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb0c0 x1874670273124608/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828874 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828852.884385:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828852.884390:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828852.884394:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273124608:192.168.203.121@tcp:8:kworker.0
00010000:00010000:0.0:1787828853.715533:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828853.907416:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828854.739659:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828854.931406:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:0.0:1787828854.931434:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828854.931439:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1787828854.931443:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828854.931452:0:27626:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4018
00000100:00080000:0.0:1787828854.931461:0:27626:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828854.931467:0:27626:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787828854.931493:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8b40 x1874670273124736/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828854.931513:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828854.931516:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787828854.931518:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828854.931520:0:27626:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4018
00000100:00080000:0.0:1787828854.931522:0:27626:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828854.931525:0:27626:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828854.931533:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787828854.931551:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e92c0 x1874670273124864/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828854.931551:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273124736:192.168.203.121@tcp:250:kworker.0
00000100:00080000:0.0:1787828854.931569:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828854.931573:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787828854.931576:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828854.931580:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4018
00000100:00080000:0.0:1787828854.931584:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828854.931589:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828854.931594:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828854.931607:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb840 x1874670273124992/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828854.931619:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828854.931625:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000800:00000100:1.0:1787828854.931626:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:0.0:1787828854.931629:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828854.931635:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4018
00000100:00080000:0.0:1787828854.931639:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828854.931642:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828854.931647:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828854.931657:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb480 x1874670273125120/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828854.931664:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828854.931667:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787828854.931669:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1787828854.931674:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828854/real 1787828854]  req@ffff9ee0056e8b40 x1874670273124736/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828879 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828854.931677:0:27626:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4018
00000100:00080000:0.0:1787828854.931684:0:27626:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828854.931692:0:27626:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828854.931699:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787828854.931703:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8b40 x1874670273124736/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828879 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787828854.931715:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9e00 x1874670273125248/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787828854.931717:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828854.931726:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:0.0:1787828854.931733:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1787828854.931734:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273124736:192.168.203.121@tcp:250:kworker.0
00000100:00080000:0.0:1787828854.931741:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787828854.931745:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828854.931751:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4018
00000100:00080000:0.0:1787828854.931755:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828854.931760:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787828854.931763:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273124864:192.168.203.121@tcp:38:kworker.0
00000008:00100000:0.0:1787828854.931768:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828854.931786:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8000 x1874670273125376/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828854.931797:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828854.931802:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787828854.931804:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828854.931808:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4018
00000100:00080000:0.0:1787828854.931813:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000800:00000100:1.0:1787828854.931813:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:0.0:1787828854.931822:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828854.931828:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787828854.931837:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828854/real 1787828854]  req@ffff9ee0056e92c0 x1874670273124864/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828879 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787828854.931843:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e83c0 x1874670273125504/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828854.931862:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e92c0 x1874670273124864/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828879 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828854.931874:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828854.931879:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828854.931882:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273124864:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828854.931890:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273124992:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828854.931912:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828854.931925:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828854/real 1787828854]  req@ffff9ee0056eb840 x1874670273124992/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828879 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828854.931937:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb840 x1874670273124992/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828879 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828854.931946:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828854.931950:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828854.931953:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273124992:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828854.931960:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273125120:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828854.931981:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828854.931995:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828854/real 1787828854]  req@ffff9ee0056eb480 x1874670273125120/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828879 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828854.932015:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb480 x1874670273125120/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828879 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828854.932039:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828854.932043:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828854.932046:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273125120:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828854.932053:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273125248:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787828854.932075:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828854.932087:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828854/real 1787828854]  req@ffff9ee0056e9e00 x1874670273125248/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828879 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828854.932098:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9e00 x1874670273125248/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828879 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828854.932106:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828854.932109:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828854.932112:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273125248:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828854.932132:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273125376:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828854.932153:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828854.932166:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828854/real 1787828854]  req@ffff9ee0056e8000 x1874670273125376/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828879 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828854.932179:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8000 x1874670273125376/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828879 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828854.932194:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828854.932197:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828854.932202:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273125376:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828854.932207:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273125504:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828854.932228:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828854.932240:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828854/real 1787828854]  req@ffff9ee0056e83c0 x1874670273125504/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828879 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828854.932251:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e83c0 x1874670273125504/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828879 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828854.932259:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828854.932262:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828854.932266:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273125504:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828855.763585:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828855.955478:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828856.787521:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828856.979379:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828857.811511:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828858.003472:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828858.835575:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828859.027423:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828859.859558:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1787828860.051425:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828860.051437:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1787828860.051444:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1787828860.051455:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:0.0:1787828860.051457:0:27626:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4023
00000100:00080000:0.0:1787828860.051475:0:27626:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828860.051485:0:27626:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787828860.051542:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8f00 x1874670273125632/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828860.051581:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828860.051598:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787828860.051601:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828860.051608:0:27626:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4023
00000100:00080000:0.0:1787828860.051615:0:27626:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828860.051623:0:27626:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828860.051637:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787828860.051664:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ebc00 x1874670273125760/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828860.051685:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273125632:192.168.203.121@tcp:250:kworker.0
00000100:00080000:0.0:1787828860.051686:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828860.051701:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787828860.051704:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828860.051710:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4023
00000100:00080000:0.0:1787828860.051733:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828860.051739:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828860.051749:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828860.051769:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e83c0 x1874670273125888/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828860.051784:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828860.051788:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787828860.051791:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828860.051801:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4023
00000800:00000100:1.0:1787828860.051804:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:0.0:1787828860.051808:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828860.051849:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828860.051858:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787828860.051875:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828860/real 1787828860]  req@ffff9ee0056e8f00 x1874670273125632/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828885 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787828860.051879:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8000 x1874670273126016/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828860.051919:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828860.051929:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787828860.051932:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828860.051939:0:27626:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4023
00000100:00080000:0.0:1787828860.051955:0:27626:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1787828860.051965:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8f00 x1874670273125632/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828885 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828860.051967:0:27626:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828860.051979:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787828860.052001:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9e00 x1874670273126144/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787828860.052003:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828860.052026:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:0.0:1787828860.052028:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828860.052040:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00100000:1.0:1787828860.052046:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273125632:192.168.203.121@tcp:250:kworker.0
00000100:00080000:0.0:1787828860.052047:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828860.052064:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4023
00000100:00080000:0.0:1787828860.052070:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828860.052075:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828860.052080:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787828860.052100:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273125760:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787828860.052102:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb480 x1874670273126272/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828860.052130:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828860.052134:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787828860.052138:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828860.052143:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4023
00000800:00000100:1.0:1787828860.052160:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:0.0:1787828860.052161:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828860.052174:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828860.052182:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787828860.052193:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828860/real 1787828860]  req@ffff9ee0056ebc00 x1874670273125760/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828885 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787828860.052203:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb840 x1874670273126400/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828860.052236:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ebc00 x1874670273125760/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828885 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828860.052251:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828860.052256:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828860.052261:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273125760:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828860.052327:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273125888:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828860.052405:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828860.052437:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828860/real 1787828860]  req@ffff9ee0056e83c0 x1874670273125888/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828885 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828860.052461:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e83c0 x1874670273125888/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828885 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828860.052477:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828860.052485:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828860.052491:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273125888:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828860.052502:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273126016:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828860.052546:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828860.052585:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828860/real 1787828860]  req@ffff9ee0056e8000 x1874670273126016/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828885 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828860.052613:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8000 x1874670273126016/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828885 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828860.052629:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828860.052636:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828860.052643:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273126016:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828860.052657:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273126144:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787828860.052693:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828860.052715:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828860/real 1787828860]  req@ffff9ee0056e9e00 x1874670273126144/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828885 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828860.052734:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9e00 x1874670273126144/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828885 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828860.052744:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828860.052751:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828860.052755:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273126144:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828860.052799:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273126272:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828860.052840:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828860.052864:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828860/real 1787828860]  req@ffff9ee0056eb480 x1874670273126272/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828885 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828860.052886:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb480 x1874670273126272/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828885 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828860.052915:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828860.052923:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828860.052941:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273126272:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828860.052956:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273126400:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828860.052992:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828860.053014:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828860/real 1787828860]  req@ffff9ee0056eb840 x1874670273126400/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828885 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828860.053034:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb840 x1874670273126400/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828885 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828860.053048:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828860.053054:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828860.053070:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273126400:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828860.883444:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828861.075416:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828861.907547:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828862.099444:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828862.931454:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828863.123431:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828863.955524:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828864.147425:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828864.979620:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828865.171369:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:2.0:1787828865.171405:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828865.171424:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787828865.171428:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828865.171439:0:27626:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4028
00000100:00080000:2.0:1787828865.171450:0:27626:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828865.171458:0:27626:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787828865.171536:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b0c0 x1874670273126528/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828865.171576:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828865.171590:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787828865.171593:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828865.171600:0:27626:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4028
00000100:00080000:2.0:1787828865.171606:0:27626:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828865.171612:0:27626:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787828865.171619:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273126528:192.168.203.121@tcp:250:kworker.0
00000008:00100000:2.0:1787828865.171633:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787828865.171652:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b480 x1874670273126656/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828865.171667:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828865.171671:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787828865.171674:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828865.171678:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4028
00000100:00080000:2.0:1787828865.171683:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828865.171689:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000800:00000100:1.0:1787828865.171693:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000008:00100000:2.0:1787828865.171696:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828865.171709:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572ad00 x1874670273126784/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828865.171722:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828865.171727:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787828865.171729:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828865.171734:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4028
00000100:00100000:1.0:1787828865.171739:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828865/real 1787828865]  req@ffff9ee00572b0c0 x1874670273126528/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828890 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828865.171740:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828865.171745:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828865.171751:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787828865.171765:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b0c0 x1874670273126528/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828890 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828865.171765:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729a40 x1874670273126912/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828865.171780:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828865.171784:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787828865.171787:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828865.171793:0:27626:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4028
00000100:00080000:1.0:1787828865.171794:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828865.171797:0:27626:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828865.171800:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:2.0:1787828865.171802:0:27626:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787828865.171806:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273126528:192.168.203.121@tcp:250:kworker.0
00000008:00100000:2.0:1787828865.171809:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787828865.171822:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b840 x1874670273127040/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828865.171835:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1787828865.171836:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273126656:192.168.203.121@tcp:38:kworker.0
00000100:00080000:2.0:1787828865.171841:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787828865.171844:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828865.171849:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4028
00000100:00080000:2.0:1787828865.171853:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828865.171858:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828865.171865:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1787828865.171867:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828865.171879:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728f00 x1874670273127168/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828865.171886:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828865/real 1787828865]  req@ffff9ee00572b480 x1874670273126656/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828890 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828865.171920:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828865.171924:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787828865.171926:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828865.171929:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4028
00000100:00100000:1.0:1787828865.171932:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b480 x1874670273126656/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828890 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828865.171932:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828865.171936:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00080000:1.0:1787828865.171941:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000008:00100000:2.0:1787828865.171941:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:1.0:1787828865.171944:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828865.171948:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273126656:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828865.171954:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273126784:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787828865.171958:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728b40 x1874670273127296/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1787828865.171975:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828865.171998:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828865/real 1787828865]  req@ffff9ee00572ad00 x1874670273126784/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828890 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828865.172012:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572ad00 x1874670273126784/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828890 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828865.172019:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828865.172021:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828865.172024:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273126784:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828865.172047:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273126912:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828865.172080:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828865.172092:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828865/real 1787828865]  req@ffff9ee005729a40 x1874670273126912/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828890 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828865.172104:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729a40 x1874670273126912/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828890 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828865.172112:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828865.172115:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828865.172118:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273126912:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828865.172135:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273127040:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787828865.172150:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828865.172159:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828865/real 1787828865]  req@ffff9ee00572b840 x1874670273127040/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828890 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828865.172170:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b840 x1874670273127040/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828890 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828865.172177:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828865.172180:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828865.172183:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273127040:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828865.172188:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273127168:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828865.172201:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828865.172210:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828865/real 1787828865]  req@ffff9ee005728f00 x1874670273127168/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828890 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828865.172253:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728f00 x1874670273127168/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828890 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828865.172267:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828865.172270:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828865.172273:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273127168:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828865.172278:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273127296:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828865.172295:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828865.172305:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828865/real 1787828865]  req@ffff9ee005728b40 x1874670273127296/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828890 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828865.172340:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728b40 x1874670273127296/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828890 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828865.172348:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828865.172351:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828865.172354:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273127296:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828866.003523:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828866.195478:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828867.027466:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828867.219383:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828868.051433:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828868.243411:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828869.075454:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828869.267361:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828870.099480:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828870.291417:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:0.0:1787828870.291435:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828870.291441:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1787828870.291444:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828870.291453:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4034
00000100:00080000:0.0:1787828870.291463:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828870.291469:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787828870.291516:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e92c0 x1874670273127424/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828870.291542:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828870.291544:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787828870.291546:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828870.291549:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4034
00000100:00080000:0.0:1787828870.291552:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828870.291555:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828870.291562:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787828870.291573:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8b40 x1874670273127552/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828870.291583:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828870.291585:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787828870.291587:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1787828870.291594:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273127424:192.168.203.121@tcp:250:kworker.0
00000100:00080000:0.0:1787828870.291595:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4034
00000100:00080000:0.0:1787828870.291604:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828870.291611:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828870.291617:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828870.291633:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb0c0 x1874670273127680/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828870.291652:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828870.291656:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787828870.291658:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828870.291662:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4034
00000100:00080000:0.0:1787828870.291684:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000800:00000100:1.0:1787828870.291693:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:0.0:1787828870.291701:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828870.291710:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828870.291725:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9a40 x1874670273127808/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828870.291735:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828870.291738:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787828870.291740:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828870.291745:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4034
00000100:00080000:0.0:1787828870.291752:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1787828870.291752:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828870/real 1787828870]  req@ffff9ee0056e92c0 x1874670273127424/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828895 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828870.291779:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828870.291788:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787828870.291801:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e92c0 x1874670273127424/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828895 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787828870.291802:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ea580 x1874670273127936/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828870.291832:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828870.291835:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787828870.291835:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787828870.291840:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787828870.291844:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:0.0:1787828870.291860:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4034
00000100:00080000:0.0:1787828870.291864:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828870.291866:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787828870.291870:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273127424:192.168.203.121@tcp:250:kworker.0
00000008:00100000:0.0:1787828870.291871:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828870.291880:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9680 x1874670273128064/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828870.291887:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828870.291890:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787828870.291892:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828870.291894:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4034
00000100:00080000:0.0:1787828870.291896:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828870.291898:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828870.291902:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787828870.291905:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273127552:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787828870.291912:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8780 x1874670273128192/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1787828870.291947:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828870.291961:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828870/real 1787828870]  req@ffff9ee0056e8b40 x1874670273127552/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828895 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828870.291975:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8b40 x1874670273127552/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828895 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828870.291984:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828870.292013:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828870.292016:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273127552:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828870.292021:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273127680:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828870.292039:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828870.292048:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828870/real 1787828870]  req@ffff9ee0056eb0c0 x1874670273127680/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828895 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828870.292068:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb0c0 x1874670273127680/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828895 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828870.292074:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828870.292077:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828870.292079:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273127680:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828870.292083:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273127808:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828870.292093:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828870.292099:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828870/real 1787828870]  req@ffff9ee0056e9a40 x1874670273127808/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828895 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828870.292108:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9a40 x1874670273127808/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828895 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828870.292113:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828870.292115:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828870.292117:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273127808:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828870.292121:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273127936:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787828870.292140:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828870.292148:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828870/real 1787828870]  req@ffff9ee0056ea580 x1874670273127936/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828895 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828870.292157:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ea580 x1874670273127936/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828895 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828870.292162:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828870.292165:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828870.292167:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273127936:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828870.292171:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273128064:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828870.292186:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828870.292193:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828870/real 1787828870]  req@ffff9ee0056e9680 x1874670273128064/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828895 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828870.292220:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9680 x1874670273128064/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828895 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828870.292248:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828870.292251:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828870.292254:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273128064:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828870.292271:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273128192:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828870.292289:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828870.292298:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828870/real 1787828870]  req@ffff9ee0056e8780 x1874670273128192/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828895 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828870.292306:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8780 x1874670273128192/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828895 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828870.292312:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828870.292315:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828870.292317:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273128192:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828871.123460:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828871.315419:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828872.147450:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828872.339381:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828873.171473:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828873.363442:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828874.195503:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828874.387401:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828875.219518:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828875.411458:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787828875.411499:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828875.411504:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787828875.411508:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828875.411521:0:27626:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4039
00000100:00080000:3.0:1787828875.411533:0:27626:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828875.411541:0:27626:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787828875.411585:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705a40 x1874670273128320/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828875.411611:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828875.411614:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787828875.411616:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828875.411619:0:27626:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4039
00000100:00080000:3.0:1787828875.411622:0:27626:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828875.411626:0:27626:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828875.411637:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787828875.411649:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704780 x1874670273128448/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828875.411655:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273128320:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787828875.411663:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828875.411666:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787828875.411668:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828875.411672:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4039
00000100:00080000:3.0:1787828875.411674:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828875.411679:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828875.411683:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787828875.411695:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705e00 x1874670273128576/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828875.411701:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828875.411704:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787828875.411707:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828875.411710:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4039
00000100:00080000:3.0:1787828875.411712:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828875.411714:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828875.411718:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787828875.411728:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704b40 x1874670273128704/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1787828875.411736:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787828875.411749:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828875.411753:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787828875.411757:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828875.411763:0:27626:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4039
00000100:00080000:3.0:1787828875.411766:0:27626:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828875.411769:0:27626:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828875.411774:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787828875.411788:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828875/real 1787828875]  req@ffff9ee005705a40 x1874670273128320/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828900 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787828875.411789:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706580 x1874670273128832/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828875.411818:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828875.411824:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787828875.411827:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1787828875.411830:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705a40 x1874670273128320/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828900 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828875.411840:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4039
00000100:00080000:3.0:1787828875.411853:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828875.411857:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787828875.411861:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00080000:1.0:1787828875.411867:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000008:00100000:3.0:1787828875.411871:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787828875.411872:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273128320:192.168.203.121@tcp:250:kworker.0
00000100:00100000:3.0:1787828875.411902:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057043c0 x1874670273128960/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828875.411904:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273128448:192.168.203.121@tcp:38:kworker.0
00000100:00080000:3.0:1787828875.411928:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828875.411933:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000800:00000100:1.0:1787828875.411939:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787828875.411939:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828875.411951:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4039
00000100:00100000:1.0:1787828875.411959:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828875/real 1787828875]  req@ffff9ee005704780 x1874670273128448/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828900 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828875.411967:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828875.411978:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787828875.411981:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704780 x1874670273128448/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828900 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:3.0:1787828875.411986:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:1.0:1787828875.411996:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828875.412000:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787828875.412008:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057070c0 x1874670273129088/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828875.412009:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273128448:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828875.412031:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273128576:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828875.412053:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828875.412064:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828875/real 1787828875]  req@ffff9ee005705e00 x1874670273128576/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828900 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828875.412073:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705e00 x1874670273128576/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828900 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828875.412078:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828875.412081:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828875.412083:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273128576:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828875.412088:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273128704:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828875.412097:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828875.412103:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828875/real 1787828875]  req@ffff9ee005704b40 x1874670273128704/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828900 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828875.412111:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704b40 x1874670273128704/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828900 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828875.412116:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828875.412118:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828875.412120:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273128704:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828875.412123:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273128832:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787828875.412132:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828875.412138:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828875/real 1787828875]  req@ffff9ee005706580 x1874670273128832/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828900 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828875.412145:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706580 x1874670273128832/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828900 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828875.412150:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828875.412152:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828875.412154:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273128832:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828875.412181:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273128960:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828875.412195:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828875.412203:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828875/real 1787828875]  req@ffff9ee0057043c0 x1874670273128960/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828900 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828875.412210:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057043c0 x1874670273128960/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828900 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828875.412219:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828875.412221:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828875.412224:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273128960:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828875.412227:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273129088:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828875.412237:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828875.412242:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828875/real 1787828875]  req@ffff9ee0057070c0 x1874670273129088/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828900 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828875.412249:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057070c0 x1874670273129088/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828900 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828875.412254:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828875.412256:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828875.412258:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273129088:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828876.243495:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828876.435396:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828877.267507:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828877.459441:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828878.291543:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828878.483402:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828879.315500:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828879.507424:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828880.339466:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1787828880.531435:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828880.531445:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00100000:1.0:1787828880.531449:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787828880.531450:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828880.531464:0:27626:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4044
00000100:00080000:3.0:1787828880.531476:0:27626:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828880.531485:0:27626:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787828880.531522:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704000 x1874670273129216/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828880.531549:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828880.531554:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787828880.531556:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828880.531560:0:27626:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4044
00000100:00080000:3.0:1787828880.531564:0:27626:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828880.531568:0:27626:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828880.531578:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787828880.531590:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706d00 x1874670273129344/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828880.531610:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828880.531614:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787828880.531617:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828880.531622:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4044
00000100:00080000:3.0:1787828880.531627:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1787828880.531634:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273129216:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787828880.531634:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828880.531644:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787828880.531672:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707480 x1874670273129472/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828880.531686:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828880.531689:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787828880.531691:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828880.531696:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4044
00000100:00080000:3.0:1787828880.531700:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000800:00000100:1.0:1787828880.531707:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787828880.531708:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828880.531716:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787828880.531730:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057052c0 x1874670273129600/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828880.531752:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828880.531755:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787828880.531758:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1787828880.531763:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828880/real 1787828880]  req@ffff9ee005704000 x1874670273129216/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828905 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828880.531766:0:27626:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4044
00000100:00080000:3.0:1787828880.531774:0:27626:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828880.531781:0:27626:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787828880.531785:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704000 x1874670273129216/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828905 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:3.0:1787828880.531789:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00080000:1.0:1787828880.531797:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828880.531813:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828880.531821:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273129216:192.168.203.121@tcp:250:kworker.0
00000100:00100000:3.0:1787828880.531823:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706940 x1874670273129728/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828880.531829:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273129344:192.168.203.121@tcp:38:kworker.0
00000100:00080000:3.0:1787828880.531844:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828880.531849:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000800:00000100:1.0:1787828880.531853:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787828880.531853:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828880.531861:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4044
00000100:00080000:3.0:1787828880.531867:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1787828880.531868:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828880/real 1787828880]  req@ffff9ee005706d00 x1874670273129344/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828905 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828880.531876:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828880.531885:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787828880.531892:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706d00 x1874670273129344/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828905 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828880.531913:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:3.0:1787828880.531914:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707840 x1874670273129856/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787828880.531921:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828880.531930:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273129344:192.168.203.121@tcp:38:kworker.0
00000100:00080000:3.0:1787828880.531936:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828880.531942:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787828880.531944:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828880.531950:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4044
00000100:00080000:3.0:1787828880.531955:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1787828880.531959:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273129472:192.168.203.121@tcp:8:kworker.0
00000100:00080000:3.0:1787828880.531961:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828880.531970:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1787828880.531984:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828880.532001:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828880/real 1787828880]  req@ffff9ee005707480 x1874670273129472/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828905 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787828880.532002:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057061c0 x1874670273129984/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828880.532024:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707480 x1874670273129472/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828905 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828880.532032:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828880.532035:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828880.532038:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273129472:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828880.532042:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273129600:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828880.532054:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828880.532061:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828880/real 1787828880]  req@ffff9ee0057052c0 x1874670273129600/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828905 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828880.532068:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057052c0 x1874670273129600/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828905 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828880.532073:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828880.532075:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828880.532076:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273129600:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828880.532079:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273129728:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787828880.532089:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828880.532094:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828880/real 1787828880]  req@ffff9ee005706940 x1874670273129728/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828905 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828880.532101:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706940 x1874670273129728/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828905 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828880.532106:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828880.532108:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828880.532110:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273129728:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828880.532113:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273129856:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828880.532139:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828880.532149:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828880/real 1787828880]  req@ffff9ee005707840 x1874670273129856/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828905 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828880.532156:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707840 x1874670273129856/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828905 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828880.532162:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828880.532170:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828880.532173:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273129856:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828880.532198:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273129984:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828880.532211:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828880.532218:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828880/real 1787828880]  req@ffff9ee0057061c0 x1874670273129984/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828905 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828880.532225:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057061c0 x1874670273129984/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828905 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828880.532230:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828880.532233:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828880.532234:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273129984:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828881.363473:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828881.555475:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828882.387439:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828882.579390:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828883.411510:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828883.603429:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828884.435489:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828884.627371:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828885.459524:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828885.651378:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:2.0:1787828885.651406:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828885.651413:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787828885.651417:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828885.651427:0:27626:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4049
00000100:00080000:2.0:1787828885.651440:0:27626:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828885.651447:0:27626:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787828885.651486:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a580 x1874670273130112/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828885.651514:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828885.651517:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787828885.651519:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828885.651523:0:27626:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4049
00000100:00080000:2.0:1787828885.651526:0:27626:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828885.651529:0:27626:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828885.651539:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787828885.651547:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273130112:192.168.203.121@tcp:250:kworker.0
00000100:00100000:2.0:1787828885.651551:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728000 x1874670273130240/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828885.651567:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828885.651571:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787828885.651573:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828885.651578:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4049
00000100:00080000:2.0:1787828885.651582:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828885.651587:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828885.651594:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828885.651607:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057283c0 x1874670273130368/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828885.651615:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828885.651617:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787828885.651619:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828885.651622:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4049
00000100:00080000:2.0:1787828885.651626:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828885.651629:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828885.651634:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1787828885.651639:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828885.651645:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a1c0 x1874670273130496/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828885.651653:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828885.651656:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787828885.651658:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828885.651661:0:27626:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4049
00000100:00080000:2.0:1787828885.651663:0:27626:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828885.651665:0:27626:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828885.651669:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787828885.651677:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729e00 x1874670273130624/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828885.651684:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828885.651687:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787828885.651689:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1787828885.651692:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828885/real 1787828885]  req@ffff9ee00572a580 x1874670273130112/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828910 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828885.651694:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4049
00000100:00080000:2.0:1787828885.651699:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828885.651706:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828885.651713:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828885.651721:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a940 x1874670273130752/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828885.651732:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a580 x1874670273130112/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828910 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828885.651736:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828885.651743:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787828885.651747:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828885.651752:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4049
00000100:00080000:1.0:1787828885.651753:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828885.651755:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828885.651760:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:2.0:1787828885.651761:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787828885.651766:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273130112:192.168.203.121@tcp:250:kworker.0
00000008:00100000:2.0:1787828885.651774:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828885.651786:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728780 x1874670273130880/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828885.651812:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273130240:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787828885.651839:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828885.651854:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828885/real 1787828885]  req@ffff9ee005728000 x1874670273130240/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828910 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828885.651870:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728000 x1874670273130240/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828910 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828885.651879:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828885.651883:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828885.651887:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273130240:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828885.651905:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273130368:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828885.651929:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828885.651942:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828885/real 1787828885]  req@ffff9ee0057283c0 x1874670273130368/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828910 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828885.651954:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057283c0 x1874670273130368/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828910 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828885.651971:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828885.651982:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828885.651984:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273130368:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828885.651992:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273130496:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828885.652008:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828885.652015:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828885/real 1787828885]  req@ffff9ee00572a1c0 x1874670273130496/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828910 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828885.652023:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a1c0 x1874670273130496/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828910 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828885.652029:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828885.652031:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828885.652033:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273130496:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828885.652037:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273130624:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787828885.652048:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828885.652054:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828885/real 1787828885]  req@ffff9ee005729e00 x1874670273130624/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828910 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828885.652061:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729e00 x1874670273130624/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828910 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828885.652066:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828885.652068:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828885.652070:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273130624:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828885.652073:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273130752:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828885.652083:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828885.652113:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828885/real 1787828885]  req@ffff9ee00572a940 x1874670273130752/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828910 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828885.652128:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a940 x1874670273130752/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828910 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828885.652136:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828885.652140:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828885.652143:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273130752:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828885.652150:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273130880:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828885.652170:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828885.652178:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828885/real 1787828885]  req@ffff9ee005728780 x1874670273130880/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828910 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828885.652186:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728780 x1874670273130880/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828910 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828885.652191:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828885.652194:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828885.652195:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273130880:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828886.483514:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828886.675386:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828887.507520:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828887.699428:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828888.531554:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828888.723435:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828889.555494:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828889.747396:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828890.579519:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828890.771432:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:2.0:1787828890.771441:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828890.771451:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787828890.771456:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828890.771481:0:27626:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4054
00000100:00080000:2.0:1787828890.771494:0:27626:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828890.771502:0:27626:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787828890.771569:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572bc00 x1874670273131008/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828890.771599:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828890.771602:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787828890.771604:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828890.771607:0:27626:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4054
00000100:00080000:2.0:1787828890.771611:0:27626:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828890.771616:0:27626:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828890.771627:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787828890.771640:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057292c0 x1874670273131136/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828890.771651:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273131008:192.168.203.121@tcp:250:kworker.0
00000100:00080000:2.0:1787828890.771654:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828890.771658:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787828890.771660:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828890.771666:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4054
00000100:00080000:2.0:1787828890.771678:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828890.771685:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828890.771691:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828890.771711:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729680 x1874670273131264/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828890.771723:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828890.771727:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787828890.771730:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828890.771736:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4054
00000100:00080000:2.0:1787828890.771741:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828890.771748:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828890.771754:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1787828890.771764:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828890.771775:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728780 x1874670273131392/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828890.771809:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828890.771813:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787828890.771817:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828890.771824:0:27626:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4054
00000100:00080000:2.0:1787828890.771830:0:27626:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828890.771836:0:27626:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787828890.771843:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828890/real 1787828890]  req@ffff9ee00572bc00 x1874670273131008/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828915 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:2.0:1787828890.771844:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787828890.771870:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a940 x1874670273131520/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828890.771879:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1787828890.771883:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572bc00 x1874670273131008/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828915 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828890.771884:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787828890.771893:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828890.771899:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4054
00000100:00080000:2.0:1787828890.771915:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828890.771922:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00080000:1.0:1787828890.771923:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000008:00100000:2.0:1787828890.771928:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:1.0:1787828890.771934:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828890.771952:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729e00 x1874670273131648/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828890.771965:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273131008:192.168.203.121@tcp:250:kworker.0
00000100:00080000:2.0:1787828890.771970:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828890.771976:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787828890.771987:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828890.771991:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4054
00000100:00080000:2.0:1787828890.771995:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828890.771999:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828890.772003:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828890.772011:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a1c0 x1874670273131776/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828890.772022:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057292c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273131136:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787828890.772082:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828890.772101:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828890/real 1787828890]  req@ffff9ee0057292c0 x1874670273131136/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828915 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828890.772131:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057292c0 x1874670273131136/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828915 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828890.772143:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828890.772148:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828890.772153:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057292c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273131136:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828890.772162:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273131264:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828890.772187:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828890.772200:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828890/real 1787828890]  req@ffff9ee005729680 x1874670273131264/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828915 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828890.772216:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729680 x1874670273131264/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828915 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828890.772234:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828890.772238:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828890.772244:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273131264:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828890.772252:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273131392:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828890.772276:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828890.772289:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828890/real 1787828890]  req@ffff9ee005728780 x1874670273131392/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828915 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828890.772305:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728780 x1874670273131392/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828915 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828890.772344:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828890.772349:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828890.772354:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273131392:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828890.772362:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273131520:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787828890.772385:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828890.772398:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828890/real 1787828890]  req@ffff9ee00572a940 x1874670273131520/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828915 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828890.772414:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a940 x1874670273131520/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828915 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828890.772425:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828890.772430:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828890.772435:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273131520:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828890.772443:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273131648:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828890.772463:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828890.772490:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828890/real 1787828890]  req@ffff9ee005729e00 x1874670273131648/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828915 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828890.772504:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729e00 x1874670273131648/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828915 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828890.772514:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828890.772518:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828890.772522:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273131648:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828890.772564:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273131776:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828890.772584:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828890.772596:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828890/real 1787828890]  req@ffff9ee00572a1c0 x1874670273131776/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828915 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828890.772611:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a1c0 x1874670273131776/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828915 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828890.772622:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828890.772626:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828890.772631:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273131776:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828891.603560:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828891.795398:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828892.627472:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828892.819453:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828893.651524:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828893.843445:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828894.675477:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828894.867434:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828895.699481:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828895.891383:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:2.0:1787828895.891387:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828895.891396:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787828895.891401:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828895.891420:0:27626:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4059
00000100:00080000:2.0:1787828895.891429:0:27626:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828895.891434:0:27626:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787828895.891464:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057283c0 x1874670273131904/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828895.891496:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828895.891499:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787828895.891501:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828895.891504:0:27626:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4059
00000100:00080000:2.0:1787828895.891507:0:27626:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828895.891510:0:27626:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828895.891519:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787828895.891530:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273131904:192.168.203.121@tcp:250:kworker.0
00000100:00100000:2.0:1787828895.891534:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728000 x1874670273132032/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828895.891549:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828895.891552:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787828895.891554:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828895.891558:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4059
00000100:00080000:2.0:1787828895.891561:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828895.891563:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828895.891568:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828895.891577:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a580 x1874670273132160/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828895.891584:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828895.891588:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000800:00000100:3.0:1787828895.891593:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:2.0:1787828895.891594:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828895.891601:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4059
00000100:00080000:2.0:1787828895.891607:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828895.891613:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828895.891618:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787828895.891633:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828895/real 1787828895]  req@ffff9ee0057283c0 x1874670273131904/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828920 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828895.891637:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728b40 x1874670273132288/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828895.891656:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1787828895.891658:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057283c0 x1874670273131904/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828920 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828895.891664:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787828895.891668:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828895.891674:0:27626:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4059
00000100:00080000:3.0:1787828895.891674:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828895.891689:0:27626:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828895.891694:0:27626:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828895.891702:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00080000:3.0:1787828895.891706:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787828895.891714:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273131904:192.168.203.121@tcp:250:kworker.0
00000100:00100000:2.0:1787828895.891719:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728f00 x1874670273132416/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828895.891752:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1787828895.891752:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273132032:192.168.203.121@tcp:38:kworker.0
00000100:00080000:2.0:1787828895.891759:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787828895.891762:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828895.891766:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4059
00000100:00080000:2.0:1787828895.891770:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828895.891772:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828895.891778:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828895.891792:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b840 x1874670273132544/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828895.891802:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828895.891806:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787828895.891808:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828895.891811:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4059
00000100:00080000:2.0:1787828895.891815:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828895.891818:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828895.891821:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828895.891829:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729a40 x1874670273132672/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1787828895.891849:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787828895.891865:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828895/real 1787828895]  req@ffff9ee005728000 x1874670273132032/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828920 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787828895.891874:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728000 x1874670273132032/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828920 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828895.891880:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787828895.891882:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787828895.891885:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273132032:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787828895.891889:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273132160:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787828895.891904:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787828895.891910:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828895/real 1787828895]  req@ffff9ee00572a580 x1874670273132160/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828920 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787828895.891918:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a580 x1874670273132160/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828920 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828895.891927:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787828895.891930:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787828895.891932:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273132160:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787828895.891936:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273132288:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787828895.892085:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787828895.892096:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828895/real 1787828895]  req@ffff9ee005728b40 x1874670273132288/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828920 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787828895.892106:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728b40 x1874670273132288/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828920 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828895.892112:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787828895.892116:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787828895.892120:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273132288:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787828895.892136:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273132416:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787828895.892200:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787828895.892218:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828895/real 1787828895]  req@ffff9ee005728f00 x1874670273132416/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828920 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787828895.892231:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728f00 x1874670273132416/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828920 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828895.892240:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787828895.892243:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787828895.892247:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273132416:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787828895.892253:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273132544:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787828895.892284:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787828895.892292:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828895/real 1787828895]  req@ffff9ee00572b840 x1874670273132544/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828920 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787828895.892300:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b840 x1874670273132544/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828920 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828895.892306:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787828895.892308:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787828895.892310:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273132544:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787828895.892338:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273132672:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787828895.892355:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787828895.892364:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828895/real 1787828895]  req@ffff9ee005729a40 x1874670273132672/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828920 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787828895.892371:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729a40 x1874670273132672/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828920 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828895.892377:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787828895.892378:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787828895.892381:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273132672:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828896.723504:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828896.915456:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828897.747481:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828897.939422:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828898.771504:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828898.963427:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828899.795457:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828899.987389:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828900.819521:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1787828901.011429:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1787828901.011431:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787828901.011444:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787828901.011450:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828901.011461:0:27626:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4064
00000100:00080000:3.0:1787828901.011473:0:27626:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828901.011481:0:27626:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787828901.011525:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705680 x1874670273132800/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828901.011562:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828901.011567:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787828901.011570:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828901.011575:0:27626:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4064
00000100:00080000:3.0:1787828901.011580:0:27626:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828901.011584:0:27626:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828901.011596:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787828901.011603:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273132800:192.168.203.121@tcp:250:kworker.0
00000100:00100000:3.0:1787828901.011617:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707c00 x1874670273132928/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828901.011630:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828901.011633:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787828901.011635:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828901.011641:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4064
00000100:00080000:3.0:1787828901.011646:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828901.011649:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828901.011653:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787828901.011665:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057061c0 x1874670273133056/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1787828901.011675:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787828901.011694:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828901.011698:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787828901.011699:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828901.011703:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4064
00000100:00080000:3.0:1787828901.011705:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828901.011709:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828901.011713:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787828901.011725:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707840 x1874670273133184/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828901.011733:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828901/real 1787828901]  req@ffff9ee005705680 x1874670273132800/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828926 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828901.011736:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828901.011750:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787828901.011755:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828901.011766:0:27626:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4064
00000100:00080000:3.0:1787828901.011772:0:27626:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828901.011777:0:27626:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787828901.011781:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705680 x1874670273132800/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828926 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:3.0:1787828901.011789:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00080000:1.0:1787828901.011794:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828901.011798:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828901.011802:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273132800:192.168.203.121@tcp:250:kworker.0
00000100:00100000:3.0:1787828901.011809:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706940 x1874670273133312/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828901.011825:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1787828901.011830:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273132928:192.168.203.121@tcp:38:kworker.0
00000100:00080000:3.0:1787828901.011831:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787828901.011837:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828901.011846:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4064
00000800:00000100:1.0:1787828901.011853:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787828901.011853:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828901.011865:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787828901.011871:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828901/real 1787828901]  req@ffff9ee005707c00 x1874670273132928/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828926 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:3.0:1787828901.011876:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787828901.011885:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707c00 x1874670273132928/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828926 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828901.011894:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828901.011902:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787828901.011903:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057052c0 x1874670273133440/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828901.011912:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273132928:192.168.203.121@tcp:38:kworker.0
00000100:00080000:3.0:1787828901.011933:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1787828901.011940:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273133056:192.168.203.121@tcp:8:kworker.0
00000100:00080000:3.0:1787828901.011943:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787828901.011948:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828901.011957:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4064
00000100:00080000:3.0:1787828901.011962:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828901.011968:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828901.011973:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1787828901.011994:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787828901.012008:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707480 x1874670273133568/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828901.012017:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828901/real 1787828901]  req@ffff9ee0057061c0 x1874670273133056/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828926 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828901.012039:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057061c0 x1874670273133056/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828926 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828901.012049:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828901.012054:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828901.012058:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273133056:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828901.012066:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273133184:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828901.012088:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828901.012096:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828901/real 1787828901]  req@ffff9ee005707840 x1874670273133184/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828926 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828901.012104:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707840 x1874670273133184/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828926 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828901.012109:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828901.012112:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828901.012114:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273133184:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828901.012118:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273133312:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787828901.012129:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828901.012136:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828901/real 1787828901]  req@ffff9ee005706940 x1874670273133312/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828926 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828901.012143:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706940 x1874670273133312/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828926 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828901.012148:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828901.012150:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828901.012152:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273133312:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828901.012165:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273133440:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828901.012176:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828901.012182:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828901/real 1787828901]  req@ffff9ee0057052c0 x1874670273133440/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828926 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828901.012188:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057052c0 x1874670273133440/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828926 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828901.012193:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828901.012195:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828901.012197:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273133440:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828901.012200:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273133568:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828901.012210:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828901.012215:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828901/real 1787828901]  req@ffff9ee005707480 x1874670273133568/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828926 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828901.012222:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707480 x1874670273133568/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828926 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828901.012228:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828901.012230:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828901.012232:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273133568:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828901.843447:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828902.035384:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828902.867536:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828903.059416:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828903.891481:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828904.083380:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828904.915475:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828905.107383:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828905.939494:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828906.131398:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:0.0:1787828906.131419:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828906.131425:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1787828906.131429:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828906.131438:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4069
00000100:00080000:0.0:1787828906.131449:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828906.131455:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787828906.131486:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ea940 x1874670273133696/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828906.131508:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828906.131512:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787828906.131515:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828906.131518:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4069
00000100:00080000:0.0:1787828906.131522:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828906.131526:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828906.131536:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787828906.131552:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273133696:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787828906.131559:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ead00 x1874670273133824/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828906.131574:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828906.131577:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787828906.131579:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828906.131583:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4069
00000100:00080000:0.0:1787828906.131600:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828906.131605:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000800:00000100:1.0:1787828906.131619:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000008:00100000:0.0:1787828906.131620:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828906.131631:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8780 x1874670273133952/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828906.131639:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828906.131642:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787828906.131644:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828906.131647:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4069
00000100:00080000:0.0:1787828906.131650:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828906.131654:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787828906.131655:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828906/real 1787828906]  req@ffff9ee0056ea940 x1874670273133696/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828931 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:0.0:1787828906.131658:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828906.131667:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9680 x1874670273134080/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828906.131671:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ea940 x1874670273133696/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828931 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828906.131677:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828906.131680:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787828906.131681:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787828906.131682:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787828906.131685:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4069
00000100:00080000:1.0:1787828906.131685:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:0.0:1787828906.131689:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1787828906.131689:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273133696:192.168.203.121@tcp:250:kworker.0
00000100:00080000:0.0:1787828906.131692:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828906.131696:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787828906.131705:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ea580 x1874670273134208/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828906.131709:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273133824:192.168.203.121@tcp:38:kworker.0
00000100:00080000:0.0:1787828906.131715:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828906.131728:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787828906.131730:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828906.131733:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4069
00000100:00080000:0.0:1787828906.131737:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000800:00000100:1.0:1787828906.131740:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:0.0:1787828906.131741:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828906.131745:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787828906.131752:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828906/real 1787828906]  req@ffff9ee0056ead00 x1874670273133824/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828931 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787828906.131754:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9a40 x1874670273134336/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828906.131764:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1787828906.131765:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ead00 x1874670273133824/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828931 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828906.131768:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787828906.131770:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828906.131773:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4069
00000100:00080000:1.0:1787828906.131775:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787828906.131776:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828906.131778:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00080000:0.0:1787828906.131780:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787828906.131782:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273133824:192.168.203.121@tcp:38:kworker.0
00000008:00100000:0.0:1787828906.131784:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787828906.131788:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273133952:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787828906.131792:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb0c0 x1874670273134464/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1787828906.131814:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828906.131825:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828906/real 1787828906]  req@ffff9ee0056e8780 x1874670273133952/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828931 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828906.131837:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8780 x1874670273133952/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828931 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828906.131845:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828906.131849:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828906.131853:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273133952:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828906.131859:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273134080:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828906.131876:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828906.131883:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828906/real 1787828906]  req@ffff9ee0056e9680 x1874670273134080/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828931 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828906.131894:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9680 x1874670273134080/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828931 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828906.131899:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828906.131901:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828906.131904:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273134080:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828906.131916:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273134208:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787828906.131929:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828906.131941:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828906/real 1787828906]  req@ffff9ee0056ea580 x1874670273134208/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828931 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828906.131965:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ea580 x1874670273134208/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828931 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828906.131970:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828906.131972:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828906.131975:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273134208:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828906.131979:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273134336:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828906.131991:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828906.132013:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828906/real 1787828906]  req@ffff9ee0056e9a40 x1874670273134336/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828931 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828906.132021:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9a40 x1874670273134336/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828931 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828906.132026:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828906.132028:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828906.132030:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273134336:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828906.132033:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273134464:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828906.132043:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828906.132049:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828906/real 1787828906]  req@ffff9ee0056eb0c0 x1874670273134464/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828931 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828906.132056:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb0c0 x1874670273134464/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828931 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828906.132060:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828906.132062:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828906.132064:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273134464:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828906.963475:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828907.155441:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828907.987494:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828908.179386:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828909.011516:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828909.203433:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828910.035459:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828910.227505:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828911.059490:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787828911.251382:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:0.0:1787828911.251391:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828911.251397:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1787828911.251401:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828911.251414:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4074
00000100:00080000:0.0:1787828911.251423:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828911.251429:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787828911.251460:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8b40 x1874670273134592/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828911.251482:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828911.251485:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787828911.251486:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828911.251492:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4074
00000100:00080000:0.0:1787828911.251494:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828911.251497:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828911.251505:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787828911.251514:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e92c0 x1874670273134720/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828911.251522:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828911.251525:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787828911.251526:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828911.251532:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4074
00000100:00100000:1.0:1787828911.251532:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273134592:192.168.203.121@tcp:250:kworker.0
00000100:00080000:0.0:1787828911.251537:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828911.251541:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828911.251544:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828911.251553:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb840 x1874670273134848/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828911.251559:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828911.251562:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787828911.251563:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828911.251565:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4074
00000100:00080000:0.0:1787828911.251568:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828911.251570:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828911.251573:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828911.251580:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb480 x1874670273134976/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828911.251586:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828911.251588:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787828911.251589:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828911.251591:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4074
00000100:00080000:0.0:1787828911.251596:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828911.251599:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828911.251602:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787828911.251611:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9e00 x1874670273135104/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1787828911.251612:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:0.0:1787828911.251620:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828911.251623:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787828911.251624:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828911.251626:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4074
00000100:00080000:0.0:1787828911.251628:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828911.251630:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828911.251633:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828911.251639:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8000 x1874670273135232/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828911.251645:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828911.251647:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787828911.251648:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828911.251650:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4074
00000100:00080000:0.0:1787828911.251653:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828911.251655:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828911.251659:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787828911.251663:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828911/real 1787828911]  req@ffff9ee0056e8b40 x1874670273134592/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828936 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787828911.251670:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e83c0 x1874670273135360/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828911.251687:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8b40 x1874670273134592/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828936 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828911.251697:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828911.251700:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828911.251703:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273134592:192.168.203.121@tcp:250:kworker.0
00000100:00100000:1.0:1787828911.251728:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273134720:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787828911.251748:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828911.251759:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828911/real 1787828911]  req@ffff9ee0056e92c0 x1874670273134720/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828936 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828911.251773:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e92c0 x1874670273134720/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828936 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828911.251779:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828911.251781:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828911.251783:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273134720:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828911.251788:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273134848:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828911.251799:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828911.251805:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828911/real 1787828911]  req@ffff9ee0056eb840 x1874670273134848/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828936 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828911.251812:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb840 x1874670273134848/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828936 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828911.251817:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828911.251819:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828911.251821:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273134848:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828911.251824:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273134976:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828911.251833:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828911.251839:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828911/real 1787828911]  req@ffff9ee0056eb480 x1874670273134976/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828936 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828911.251845:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb480 x1874670273134976/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828936 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828911.251855:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828911.251857:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828911.251859:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273134976:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828911.251862:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273135104:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787828911.251871:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828911.251877:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828911/real 1787828911]  req@ffff9ee0056e9e00 x1874670273135104/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828936 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828911.251883:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9e00 x1874670273135104/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828936 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828911.251888:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828911.251890:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828911.251892:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273135104:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828911.251895:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273135232:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828911.251904:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828911.251926:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828911/real 1787828911]  req@ffff9ee0056e8000 x1874670273135232/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828936 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828911.251935:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8000 x1874670273135232/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828936 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828911.251940:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828911.251942:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828911.251945:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273135232:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828911.251949:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273135360:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828911.251962:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828911.251969:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828911/real 1787828911]  req@ffff9ee0056e83c0 x1874670273135360/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828936 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828911.251976:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e83c0 x1874670273135360/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828936 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828911.251981:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828911.251983:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828911.251985:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273135360:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828912.083481:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828912.275478:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828913.107493:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828913.299450:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828914.131425:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828914.323388:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828915.155475:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828915.347384:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828916.179459:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1787828916.371405:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828916.371416:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787828916.371421:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1787828916.371428:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787828916.371434:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4080
00000100:00080000:3.0:1787828916.371446:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828916.371455:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787828916.371487:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706d00 x1874670273135488/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828916.371513:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828916.371516:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787828916.371517:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828916.371520:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4080
00000100:00080000:3.0:1787828916.371524:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828916.371527:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828916.371534:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787828916.371543:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273135488:192.168.203.121@tcp:250:kworker.0
00000100:00100000:3.0:1787828916.371545:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704000 x1874670273135616/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828916.371558:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828916.371560:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787828916.371561:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828916.371564:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4080
00000100:00080000:3.0:1787828916.371566:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828916.371568:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828916.371571:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787828916.371581:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057070c0 x1874670273135744/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828916.371594:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828916.371596:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787828916.371597:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828916.371600:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4080
00000100:00080000:3.0:1787828916.371603:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828916.371605:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828916.371609:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787828916.371618:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057043c0 x1874670273135872/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828916.371624:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828916.371627:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787828916.371628:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828916.371631:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4080
00000100:00080000:3.0:1787828916.371633:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828916.371636:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828916.371639:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787828916.371641:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273135616:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787828916.371651:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706580 x1874670273136000/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828916.371661:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828916.371664:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787828916.371665:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1787828916.371671:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273135744:192.168.203.121@tcp:8:kworker.0
00000100:00080000:3.0:1787828916.371671:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4080
00000100:00080000:3.0:1787828916.371674:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828916.371679:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828916.371683:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787828916.371693:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704b40 x1874670273136128/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828916.371699:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273135872:192.168.203.121@tcp:8:kworker.0
00000100:00080000:3.0:1787828916.371713:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828916.371717:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787828916.371718:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828916.371722:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4080
00000100:00080000:3.0:1787828916.371726:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1787828916.371728:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273136000:192.168.203.121@tcp:38:kworker.0
00000100:00080000:3.0:1787828916.371731:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828916.371738:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787828916.371748:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705e00 x1874670273136256/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828916.371756:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273136128:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828916.371776:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273136256:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828917.203452:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828917.395439:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828918.227523:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828918.419419:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828919.251458:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828919.443394:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000400:00000100:2.0:1787828919.443550:0:2353:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.203.121:988
00000400:00000100:2.0:1787828919.443584:0:2353:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.203.121@tcp at host 192.168.203.121 was unreachable: the network or that node may be down, or Lustre may be misconfigured.
00000800:00000100:2.0:1787828919.443618:0:2353:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:2.0:1787828919.443649:0:2353:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:2.0:1787828919.443657:0:2353:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:2.0:1787828919.443668:0:2353:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:2.0:1787828919.443680:0:2353:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:2.0:1787828919.443691:0:2353:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000100:00100000:1.0:1787828919.443692:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828916/real 1787828919]  req@ffff9ee005704000 x1874670273135616/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828941 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000800:00000100:2.0:1787828919.443702:0:2353:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000100:00100000:1.0:1787828919.443721:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704000 x1874670273135616/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828941 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828919.443732:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828919.443736:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828919.443739:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273135616:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828919.443744:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828916/real 1787828919]  req@ffff9ee0057070c0 x1874670273135744/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828941 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828919.443757:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057070c0 x1874670273135744/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828941 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828919.443766:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828919.443769:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828919.443773:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273135744:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828919.443779:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828916/real 1787828919]  req@ffff9ee0057043c0 x1874670273135872/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828941 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828919.443791:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057043c0 x1874670273135872/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828941 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828919.443800:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828919.443803:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828919.443806:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273135872:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828919.443813:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828916/real 1787828919]  req@ffff9ee005706d00 x1874670273135488/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828941 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828919.443826:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706d00 x1874670273135488/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828941 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828919.443836:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828919.443839:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828919.443843:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273135488:192.168.203.121@tcp:250:kworker.0
00000100:00100000:1.0:1787828919.443883:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828916/real 1787828919]  req@ffff9ee005705e00 x1874670273136256/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828941 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828919.443897:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705e00 x1874670273136256/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828941 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828919.443915:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828919.443919:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828919.443923:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273136256:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828919.443930:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828916/real 1787828919]  req@ffff9ee005706580 x1874670273136000/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828941 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828919.443942:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706580 x1874670273136000/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828941 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828919.443950:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828919.443953:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828919.443956:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273136000:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828919.443962:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828916/real 1787828919]  req@ffff9ee005704b40 x1874670273136128/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828941 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828919.443974:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704b40 x1874670273136128/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828941 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828919.443982:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828919.443985:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828919.443988:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273136128:192.168.203.121@tcp:8:kworker.0
00010000:00010000:0.0:1787828920.275494:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828920.467444:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828921.299454:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828921.491443:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787828921.491569:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828921.491576:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787828921.491580:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828921.491590:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4085
00000100:00080000:3.0:1787828921.491601:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828921.491609:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787828921.491649:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704780 x1874670273136384/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828921.491710:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273136384:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787828921.491748:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828921.491760:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787828921.491766:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828921.491778:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4085
00000100:00080000:3.0:1787828921.491793:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000800:00000100:1.0:1787828921.491801:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787828921.491806:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828921.491827:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787828921.491889:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828921/real 1787828921]  req@ffff9ee005704780 x1874670273136384/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828946 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787828921.491906:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705a40 x1874670273136512/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828921.491927:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704780 x1874670273136384/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828946 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828921.491964:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828921.491966:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787828921.491981:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787828921.491986:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:3.0:1787828921.491989:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1787828921.491997:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273136384:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787828921.492022:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4085
00000100:00080000:3.0:1787828921.492036:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828921.492046:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828921.492058:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787828921.492068:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273136512:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787828921.492094:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704780 x1874670273136640/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1787828921.492117:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787828921.492121:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828921.492131:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787828921.492134:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1787828921.492143:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828921/real 1787828921]  req@ffff9ee005705a40 x1874670273136512/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828946 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828921.492146:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4085
00000100:00080000:3.0:1787828921.492166:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1787828921.492177:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705a40 x1874670273136512/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828946 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828921.492180:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828921.492196:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:1.0:1787828921.492201:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828921.492212:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828921.492217:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273136512:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787828921.492230:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704b40 x1874670273136768/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828921.492243:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273136640:192.168.203.121@tcp:8:kworker.0
00000100:00080000:3.0:1787828921.492265:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828921.492272:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787828921.492278:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828921.492290:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4085
00000800:00000100:1.0:1787828921.492291:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787828921.492308:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1787828921.492353:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828921/real 1787828921]  req@ffff9ee005704780 x1874670273136640/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828946 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828921.492370:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704780 x1874670273136640/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828946 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828921.492383:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828921.492388:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828921.492391:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273136640:192.168.203.121@tcp:8:kworker.0
00000100:00080000:3.0:1787828921.492417:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787828921.492418:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273136768:192.168.203.121@tcp:8:kworker.0
00000008:00100000:3.0:1787828921.492441:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000800:00000100:1.0:1787828921.492458:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787828921.492472:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706580 x1874670273136896/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828921.492483:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828921/real 1787828921]  req@ffff9ee005704b40 x1874670273136768/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828946 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828921.492536:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1787828921.492537:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704b40 x1874670273136768/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828946 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828921.492549:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787828921.492561:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787828921.492566:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787828921.492576:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4085
00000100:00080000:1.0:1787828921.492581:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828921.492592:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273136768:192.168.203.121@tcp:8:kworker.0
00000100:00080000:3.0:1787828921.492594:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828921.492606:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787828921.492615:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273136896:192.168.203.121@tcp:38:kworker.0
00000008:00100000:3.0:1787828921.492616:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787828921.492662:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705e00 x1874670273137024/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1787828921.492670:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787828921.492697:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1787828921.492704:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828921/real 1787828921]  req@ffff9ee005706580 x1874670273136896/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828946 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828921.492708:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787828921.492715:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828921.492736:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4085
00000100:00100000:1.0:1787828921.492751:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706580 x1874670273136896/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828946 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828921.492764:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828921.492768:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828921.492772:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273136896:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828921.492788:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273137024:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828921.492814:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828921.492826:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828921/real 1787828921]  req@ffff9ee005705e00 x1874670273137024/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828946 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828921.492859:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705e00 x1874670273137024/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828946 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828921.492874:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828921.492887:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787828921.492896:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00080000:1.0:1787828921.492904:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828921.492912:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273137024:192.168.203.121@tcp:8:kworker.0
00000008:00100000:3.0:1787828921.492913:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787828921.492947:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706d00 x1874670273137152/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828921.493406:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273137152:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828921.493504:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828921.493529:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828921/real 1787828921]  req@ffff9ee005706d00 x1874670273137152/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828946 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828921.493544:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706d00 x1874670273137152/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828946 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828921.493553:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828921.493557:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828921.493560:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273137152:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828922.323531:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828922.515401:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828923.347606:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828923.539462:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828924.371601:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828924.563442:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828925.395464:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828925.587395:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828926.419451:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828926.611402:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:0.0:1787828926.611424:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828926.611432:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1787828926.611437:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828926.611447:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4090
00000100:00080000:0.0:1787828926.611456:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828926.611462:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787828926.611503:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ebc00 x1874670273137280/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828926.611525:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828926.611527:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787828926.611529:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828926.611532:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4090
00000100:00080000:0.0:1787828926.611546:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828926.611549:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828926.611557:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787828926.611563:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273137280:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787828926.611568:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8f00 x1874670273137408/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828926.611577:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828926.611580:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787828926.611581:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828926.611583:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4090
00000100:00080000:0.0:1787828926.611586:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828926.611589:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828926.611592:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828926.611611:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e83c0 x1874670273137536/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828926.611618:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828926.611620:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787828926.611622:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828926.611624:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4090
00000100:00080000:0.0:1787828926.611634:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828926.611636:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828926.611639:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1787828926.611644:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787828926.611648:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8000 x1874670273137664/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828926.611656:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828926.611659:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787828926.611660:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828926.611663:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4090
00000100:00080000:0.0:1787828926.611665:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828926.611667:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828926.611670:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787828926.611679:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9e00 x1874670273137792/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828926.611683:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828926/real 1787828926]  req@ffff9ee0056ebc00 x1874670273137280/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828951 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828926.611717:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1787828926.611720:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ebc00 x1874670273137280/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828951 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828926.611721:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787828926.611725:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828926.611733:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4090
00000100:00080000:0.0:1787828926.611736:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828926.611737:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787828926.611740:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00080000:1.0:1787828926.611745:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000008:00100000:0.0:1787828926.611747:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787828926.611750:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273137280:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787828926.611759:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb480 x1874670273137920/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828926.611765:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828926.611768:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787828926.611769:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1787828926.611771:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273137408:192.168.203.121@tcp:38:kworker.0
00000100:00080000:0.0:1787828926.611775:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4090
00000100:00080000:0.0:1787828926.611779:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828926.611781:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828926.611784:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1787828926.611794:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787828926.611814:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb840 x1874670273138048/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828926.611824:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828926/real 1787828926]  req@ffff9ee0056e8f00 x1874670273137408/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828951 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828926.611838:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8f00 x1874670273137408/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828951 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828926.611845:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828926.611848:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828926.611850:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273137408:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828926.611854:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273137536:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828926.611870:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828926.611877:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828926/real 1787828926]  req@ffff9ee0056e83c0 x1874670273137536/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828951 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828926.611885:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e83c0 x1874670273137536/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828951 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828926.611890:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828926.611892:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828926.611894:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273137536:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828926.611898:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273137664:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828926.611908:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828926.611913:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828926/real 1787828926]  req@ffff9ee0056e8000 x1874670273137664/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828951 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828926.611921:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8000 x1874670273137664/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828951 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828926.611925:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828926.611927:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828926.611929:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273137664:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828926.611932:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273137792:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787828926.611941:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828926.611947:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828926/real 1787828926]  req@ffff9ee0056e9e00 x1874670273137792/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828951 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828926.611953:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9e00 x1874670273137792/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828951 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828926.611958:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828926.611960:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828926.611962:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273137792:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828926.611965:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273137920:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828926.611974:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828926.611980:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828926/real 1787828926]  req@ffff9ee0056eb480 x1874670273137920/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828951 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828926.611987:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb480 x1874670273137920/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828951 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828926.611991:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828926.611993:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828926.611995:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273137920:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828926.612008:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273138048:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828926.612017:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828926.612023:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828926/real 1787828926]  req@ffff9ee0056eb840 x1874670273138048/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828951 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828926.612029:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb840 x1874670273138048/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828951 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828926.612036:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828926.612039:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828926.612042:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273138048:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828927.443444:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828927.635415:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828928.467541:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828928.659441:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828929.491477:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828929.683425:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828930.515483:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828930.707420:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828931.539500:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1787828931.731444:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1787828931.731451:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:0.0:1787828931.731452:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1787828931.731459:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828931.731468:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4095
00000100:00080000:0.0:1787828931.731478:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828931.731484:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787828931.731517:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e92c0 x1874670273138176/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828931.731541:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828931.731543:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787828931.731545:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828931.731547:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4095
00000100:00080000:0.0:1787828931.731550:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828931.731553:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828931.731560:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787828931.731569:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8b40 x1874670273138304/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828931.731577:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828931.731580:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787828931.731582:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1787828931.731589:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273138176:192.168.203.121@tcp:250:kworker.0
00000100:00080000:0.0:1787828931.731590:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4095
00000100:00080000:0.0:1787828931.731598:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828931.731606:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828931.731609:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828931.731615:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb0c0 x1874670273138432/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828931.731627:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828931.731630:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787828931.731631:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828931.731635:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4095
00000100:00080000:0.0:1787828931.731637:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828931.731640:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828931.731643:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828931.731651:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9a40 x1874670273138560/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828931.731657:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828931.731659:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787828931.731660:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828931.731662:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4095
00000100:00080000:0.0:1787828931.731667:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828931.731670:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828931.731673:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000800:00000100:1.0:1787828931.731681:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787828931.731683:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ea580 x1874670273138688/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828931.731691:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828931.731694:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787828931.731695:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828931.731701:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4095
00000100:00080000:0.0:1787828931.731707:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828931.731710:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828931.731714:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828931.731723:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9680 x1874670273138816/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828931.731731:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1787828931.731733:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828931/real 1787828931]  req@ffff9ee0056e92c0 x1874670273138176/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828956 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828931.731735:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787828931.731740:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828931.731756:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4095
00000100:00080000:0.0:1787828931.731761:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828931.731764:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828931.731785:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787828931.731785:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e92c0 x1874670273138176/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828956 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828931.731806:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:0.0:1787828931.731810:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8780 x1874670273138944/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787828931.731816:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828931.731829:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273138176:192.168.203.121@tcp:250:kworker.0
00000100:00100000:1.0:1787828931.731861:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273138304:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787828931.731886:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828931.731901:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828931/real 1787828931]  req@ffff9ee0056e8b40 x1874670273138304/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828956 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828931.731919:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8b40 x1874670273138304/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828956 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828931.731928:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828931.731930:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828931.731933:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273138304:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828931.731938:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273138432:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828931.731962:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828931.731976:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828931/real 1787828931]  req@ffff9ee0056eb0c0 x1874670273138432/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828956 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828931.731989:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb0c0 x1874670273138432/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828956 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828931.732001:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828931.732005:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828931.732009:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273138432:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828931.732014:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273138560:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828931.732035:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828931.732045:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828931/real 1787828931]  req@ffff9ee0056e9a40 x1874670273138560/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828956 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828931.732058:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9a40 x1874670273138560/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828956 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828931.732067:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828931.732071:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828931.732075:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273138560:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828931.732081:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273138688:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787828931.732098:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828931.732107:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828931/real 1787828931]  req@ffff9ee0056ea580 x1874670273138688/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828956 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828931.732115:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ea580 x1874670273138688/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828956 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828931.732121:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828931.732123:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828931.732126:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273138688:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828931.732130:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273138816:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828931.732141:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828931.732148:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828931/real 1787828931]  req@ffff9ee0056e9680 x1874670273138816/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828956 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828931.732155:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9680 x1874670273138816/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828956 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828931.732162:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828931.732165:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828931.732169:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273138816:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828931.732184:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273138944:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828931.732207:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828931.732220:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828931/real 1787828931]  req@ffff9ee0056e8780 x1874670273138944/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828956 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828931.732229:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8780 x1874670273138944/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828956 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828931.732242:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828931.732247:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828931.732250:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273138944:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828932.563459:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828932.755388:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828933.587445:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828933.779404:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828934.611449:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828934.803392:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828935.635575:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828935.827407:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828936.659485:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1787828936.851446:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1787828936.851452:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:2.0:1787828936.851459:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787828936.851465:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828936.851475:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4100
00000100:00080000:2.0:1787828936.851486:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828936.851495:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787828936.851528:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572ad00 x1874670273139072/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828936.851550:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828936.851553:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787828936.851554:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828936.851557:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4100
00000100:00080000:2.0:1787828936.851560:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828936.851562:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828936.851570:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787828936.851578:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b480 x1874670273139200/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828936.851587:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1787828936.851590:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273139072:192.168.203.121@tcp:250:kworker.0
00000100:00080000:2.0:1787828936.851590:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787828936.851593:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828936.851599:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4100
00000100:00080000:2.0:1787828936.851604:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828936.851606:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828936.851610:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828936.851617:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b0c0 x1874670273139328/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828936.851628:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828936.851631:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787828936.851632:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828936.851634:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4100
00000100:00080000:2.0:1787828936.851637:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828936.851638:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828936.851642:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828936.851649:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729a40 x1874670273139456/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828936.851655:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828936.851657:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787828936.851658:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828936.851661:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4100
00000100:00080000:2.0:1787828936.851664:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000800:00000100:1.0:1787828936.851669:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:2.0:1787828936.851670:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828936.851677:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787828936.851684:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b840 x1874670273139584/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828936.851691:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828936.851694:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787828936.851696:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828936.851700:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4100
00000100:00080000:2.0:1787828936.851705:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828936.851710:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828936.851715:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787828936.851728:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828936/real 1787828936]  req@ffff9ee00572ad00 x1874670273139072/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828961 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828936.851742:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728f00 x1874670273139712/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828936.851792:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828936.851795:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787828936.851796:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828936.851803:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4100
00000100:00100000:1.0:1787828936.851804:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572ad00 x1874670273139072/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828961 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828936.851807:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828936.851815:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828936.851824:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:1.0:1787828936.851830:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828936.851838:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828936.851839:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728b40 x1874670273139840/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828936.851848:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273139072:192.168.203.121@tcp:250:kworker.0
00000100:00100000:1.0:1787828936.851876:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273139200:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787828936.851900:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828936.851925:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828936/real 1787828936]  req@ffff9ee00572b480 x1874670273139200/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828961 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828936.851949:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b480 x1874670273139200/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828961 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828936.851959:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828936.851962:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828936.851966:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273139200:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828936.851972:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273139328:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828936.852005:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828936.852016:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828936/real 1787828936]  req@ffff9ee00572b0c0 x1874670273139328/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828961 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828936.852029:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b0c0 x1874670273139328/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828961 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828936.852037:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828936.852040:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828936.852043:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273139328:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828936.852050:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273139456:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828936.852068:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828936.852076:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828936/real 1787828936]  req@ffff9ee005729a40 x1874670273139456/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828961 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828936.852084:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729a40 x1874670273139456/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828961 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828936.852089:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828936.852092:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828936.852094:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273139456:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828936.852097:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273139584:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787828936.852107:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828936.852113:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828936/real 1787828936]  req@ffff9ee00572b840 x1874670273139584/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828961 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828936.852133:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b840 x1874670273139584/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828961 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828936.852138:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828936.852140:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828936.852142:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273139584:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828936.852146:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273139712:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828936.852157:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828936.852163:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828936/real 1787828936]  req@ffff9ee005728f00 x1874670273139712/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828961 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828936.852171:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728f00 x1874670273139712/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828961 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828936.852175:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828936.852177:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828936.852179:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273139712:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828936.852182:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273139840:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828936.852192:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828936.852197:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828936/real 1787828936]  req@ffff9ee005728b40 x1874670273139840/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828961 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828936.852204:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728b40 x1874670273139840/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828961 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828936.852213:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828936.852215:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828936.852217:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273139840:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828937.683554:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828937.875461:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828938.707551:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828938.899455:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828939.731578:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828939.923447:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828940.755668:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828940.947504:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828941.779469:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828941.971396:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:2.0:1787828941.971399:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828941.971407:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787828941.971410:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828941.971418:0:27626:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4105
00000100:00080000:2.0:1787828941.971428:0:27626:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828941.971433:0:27626:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787828941.971465:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a580 x1874670273139968/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828941.971491:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828941.971494:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787828941.971495:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828941.971498:0:27626:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4105
00000100:00080000:2.0:1787828941.971500:0:27626:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828941.971502:0:27626:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828941.971510:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787828941.971519:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728000 x1874670273140096/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828941.971525:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273139968:192.168.203.121@tcp:250:kworker.0
00000100:00080000:2.0:1787828941.971531:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828941.971534:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787828941.971535:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828941.971538:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4105
00000100:00080000:2.0:1787828941.971540:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828941.971542:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828941.971546:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828941.971553:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057283c0 x1874670273140224/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828941.971559:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828941.971560:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787828941.971562:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828941.971565:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4105
00000100:00080000:2.0:1787828941.971568:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828941.971570:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828941.971573:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828941.971580:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a1c0 x1874670273140352/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1787828941.971585:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:2.0:1787828941.971594:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828941.971597:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787828941.971598:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828941.971603:0:27626:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4105
00000100:00080000:2.0:1787828941.971605:0:27626:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828941.971608:0:27626:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828941.971610:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787828941.971618:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729e00 x1874670273140480/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828941.971625:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828941.971628:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787828941.971629:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1787828941.971632:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828941/real 1787828941]  req@ffff9ee00572a580 x1874670273139968/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828966 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828941.971636:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4105
00000100:00080000:2.0:1787828941.971641:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828941.971646:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828941.971653:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787828941.971658:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a580 x1874670273139968/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828966 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828941.971669:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:2.0:1787828941.971670:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a940 x1874670273140608/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787828941.971676:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828941.971684:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273139968:192.168.203.121@tcp:250:kworker.0
00000100:00080000:2.0:1787828941.971709:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828941.971712:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787828941.971713:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828941.971717:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4105
00000100:00080000:2.0:1787828941.971720:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828941.971723:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787828941.971727:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273140096:192.168.203.121@tcp:38:kworker.0
00000008:00100000:2.0:1787828941.971729:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828941.971742:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728780 x1874670273140736/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1787828941.971753:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828941.971765:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828941/real 1787828941]  req@ffff9ee005728000 x1874670273140096/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828966 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828941.971774:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728000 x1874670273140096/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828966 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828941.971781:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828941.971783:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828941.971786:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273140096:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828941.971789:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273140224:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828941.971809:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828941.971816:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828941/real 1787828941]  req@ffff9ee0057283c0 x1874670273140224/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828966 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828941.971824:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057283c0 x1874670273140224/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828966 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828941.971829:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828941.971831:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828941.971833:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273140224:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828941.971837:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273140352:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828941.971846:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828941.971851:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828941/real 1787828941]  req@ffff9ee00572a1c0 x1874670273140352/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828966 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828941.971858:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a1c0 x1874670273140352/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828966 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828941.971863:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828941.971864:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828941.971867:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273140352:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828941.971871:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273140480:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787828941.971881:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828941.971886:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828941/real 1787828941]  req@ffff9ee005729e00 x1874670273140480/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828966 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828941.971893:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729e00 x1874670273140480/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828966 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828941.971903:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828941.971905:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828941.971907:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273140480:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828941.971911:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273140608:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828941.971921:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828941.971927:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828941/real 1787828941]  req@ffff9ee00572a940 x1874670273140608/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828966 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828941.971934:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a940 x1874670273140608/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828966 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828941.971939:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828941.971941:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828941.971943:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273140608:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828941.971962:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273140736:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828941.971972:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828941.971979:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828941/real 1787828941]  req@ffff9ee005728780 x1874670273140736/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828966 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828941.971986:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728780 x1874670273140736/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828966 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828941.971992:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828941.971994:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828941.971996:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273140736:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828942.803477:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828942.995375:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828943.827578:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828944.019487:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828944.851511:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828945.043464:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828945.875542:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828946.067475:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828946.899617:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1787828947.091383:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828947.091391:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787828947.091394:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828947.091402:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4110
00000100:00080000:2.0:1787828947.091412:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1787828947.091417:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:2.0:1787828947.091418:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787828947.091451:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729680 x1874670273140864/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828947.091489:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828947.091492:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787828947.091493:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828947.091496:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4110
00000100:00080000:2.0:1787828947.091498:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828947.091501:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828947.091510:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787828947.091520:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057292c0 x1874670273140992/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828947.091528:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828947.091530:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787828947.091531:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828947.091535:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4110
00000100:00080000:2.0:1787828947.091537:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1787828947.091543:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273140864:192.168.203.121@tcp:250:kworker.0
00000100:00080000:2.0:1787828947.091545:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828947.091558:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828947.091580:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572bc00 x1874670273141120/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828947.091587:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828947.091590:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787828947.091591:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828947.091594:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4110
00000100:00080000:2.0:1787828947.091596:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828947.091598:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828947.091602:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828947.091613:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728780 x1874670273141248/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828947.091625:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828947.091628:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787828947.091631:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828947.091633:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4110
00000100:00080000:2.0:1787828947.091643:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828947.091649:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828947.091653:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787828947.091678:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a940 x1874670273141376/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828947.091688:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828947.091692:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787828947.091694:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:1.0:1787828947.091698:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:2.0:1787828947.091705:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4110
00000100:00080000:2.0:1787828947.091714:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828947.091719:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828947.091726:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828947.091744:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729e00 x1874670273141504/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828947.091753:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828947.091756:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787828947.091758:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828947.091763:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4110
00000100:00080000:2.0:1787828947.091767:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1787828947.091777:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828947/real 1787828947]  req@ffff9ee005729680 x1874670273140864/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828972 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828947.091779:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787828947.091796:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828947.091819:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a1c0 x1874670273141632/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828947.091836:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729680 x1874670273140864/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828972 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828947.091870:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828947.091877:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828947.091882:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273140864:192.168.203.121@tcp:250:kworker.0
00000100:00100000:1.0:1787828947.091917:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057292c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273140992:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787828947.091961:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828947.091972:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828947/real 1787828947]  req@ffff9ee0057292c0 x1874670273140992/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828972 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828947.091981:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057292c0 x1874670273140992/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828972 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828947.091988:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828947.091990:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828947.091993:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057292c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273140992:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828947.091998:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273141120:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828947.092012:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828947.092019:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828947/real 1787828947]  req@ffff9ee00572bc00 x1874670273141120/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828972 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828947.092027:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572bc00 x1874670273141120/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828972 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828947.092032:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828947.092034:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828947.092036:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273141120:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828947.092039:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273141248:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828947.092050:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828947.092055:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828947/real 1787828947]  req@ffff9ee005728780 x1874670273141248/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828972 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828947.092071:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728780 x1874670273141248/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828972 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828947.092077:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828947.092080:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828947.092082:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273141248:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828947.092085:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273141376:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787828947.092097:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828947.092103:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828947/real 1787828947]  req@ffff9ee00572a940 x1874670273141376/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828972 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828947.092111:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a940 x1874670273141376/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828972 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828947.092116:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828947.092118:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828947.092120:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273141376:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828947.092123:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273141504:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828947.092134:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828947.092140:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828947/real 1787828947]  req@ffff9ee005729e00 x1874670273141504/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828972 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828947.092147:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729e00 x1874670273141504/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828972 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828947.092152:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828947.092154:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828947.092157:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273141504:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828947.092161:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273141632:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828947.092171:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828947.092176:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828947/real 1787828947]  req@ffff9ee00572a1c0 x1874670273141632/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828972 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828947.092183:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a1c0 x1874670273141632/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828972 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828947.092189:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828947.092191:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828947.092193:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273141632:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828947.923495:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828948.115395:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828948.947477:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828949.139407:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828949.971511:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828950.163377:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828950.995474:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828951.187374:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828952.019468:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828952.211387:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:0.0:1787828952.211420:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828952.211429:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1787828952.211432:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828952.211440:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4115
00000100:00080000:0.0:1787828952.211449:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828952.211456:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787828952.211485:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ead00 x1874670273141760/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828952.211510:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828952.211512:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787828952.211514:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828952.211517:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4115
00000100:00080000:0.0:1787828952.211519:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828952.211522:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828952.211530:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787828952.211539:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ea940 x1874670273141888/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828952.211546:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273141760:192.168.203.121@tcp:250:kworker.0
00000100:00080000:0.0:1787828952.211569:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828952.211572:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787828952.211573:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828952.211576:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4115
00000100:00080000:0.0:1787828952.211578:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828952.211580:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828952.211589:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828952.211602:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8780 x1874670273142016/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828952.211609:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828952.211612:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787828952.211613:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828952.211615:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4115
00000100:00080000:0.0:1787828952.211623:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828952.211640:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828952.211644:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1787828952.211650:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787828952.211657:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9680 x1874670273142144/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828952.211670:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828952.211674:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787828952.211676:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828952.211681:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4115
00000100:00080000:0.0:1787828952.211689:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828952.211696:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787828952.211698:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828952/real 1787828952]  req@ffff9ee0056ead00 x1874670273141760/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828977 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:0.0:1787828952.211703:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787828952.211720:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ea580 x1874670273142272/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828952.211727:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ead00 x1874670273141760/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828977 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828952.211739:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828952.211752:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787828952.211757:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787828952.211758:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828952.211771:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4115
00000100:00080000:0.0:1787828952.211776:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828952.211780:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:0.0:1787828952.211782:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828952.211791:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787828952.211793:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273141760:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787828952.211807:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9a40 x1874670273142400/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828952.211815:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828952.211817:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787828952.211818:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828952.211824:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4115
00000100:00080000:0.0:1787828952.211827:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1787828952.211828:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273141888:192.168.203.121@tcp:38:kworker.0
00000100:00080000:0.0:1787828952.211835:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828952.211840:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828952.211852:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb0c0 x1874670273142528/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1787828952.211861:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828952.211875:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828952/real 1787828952]  req@ffff9ee0056ea940 x1874670273141888/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828977 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828952.211889:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ea940 x1874670273141888/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828977 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828952.211895:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828952.211898:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828952.211901:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273141888:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828952.211905:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273142016:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828952.211917:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828952.211924:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828952/real 1787828952]  req@ffff9ee0056e8780 x1874670273142016/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828977 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828952.211931:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8780 x1874670273142016/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828977 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828952.211936:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828952.211938:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828952.211940:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273142016:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828952.211944:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273142144:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828952.211953:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828952.211960:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828952/real 1787828952]  req@ffff9ee0056e9680 x1874670273142144/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828977 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828952.211967:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9680 x1874670273142144/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828977 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828952.211972:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828952.211974:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828952.211976:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273142144:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828952.211980:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273142272:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787828952.211990:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828952.211996:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828952/real 1787828952]  req@ffff9ee0056ea580 x1874670273142272/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828977 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828952.212002:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ea580 x1874670273142272/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828977 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828952.212007:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828952.212009:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828952.212011:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273142272:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828952.212014:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273142400:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828952.212024:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828952.212029:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828952/real 1787828952]  req@ffff9ee0056e9a40 x1874670273142400/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828977 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828952.212036:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9a40 x1874670273142400/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828977 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828952.212041:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828952.212044:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828952.212046:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273142400:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828952.212060:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273142528:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828952.212069:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828952.212075:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828952/real 1787828952]  req@ffff9ee0056eb0c0 x1874670273142528/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828977 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828952.212082:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb0c0 x1874670273142528/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828977 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828952.212088:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828952.212090:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828952.212092:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273142528:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828953.043469:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828953.235421:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828954.067603:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828954.259411:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828955.091470:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828955.283410:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828956.115538:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828956.307420:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828957.139589:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1787828957.331457:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1787828957.331458:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:0.0:1787828957.331466:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1787828957.331470:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828957.331480:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4121
00000100:00080000:0.0:1787828957.331492:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828957.331501:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787828957.331543:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8b40 x1874670273142656/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828957.331570:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828957.331574:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787828957.331575:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828957.331579:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4121
00000100:00080000:0.0:1787828957.331583:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828957.331586:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828957.331612:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787828957.331628:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e92c0 x1874670273142784/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828957.331663:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1787828957.331666:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273142656:192.168.203.121@tcp:250:kworker.0
00000100:00080000:0.0:1787828957.331667:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787828957.331671:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828957.331678:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4121
00000100:00080000:0.0:1787828957.331681:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828957.331684:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828957.331688:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828957.331697:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb840 x1874670273142912/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828957.331704:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828957.331706:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787828957.331708:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828957.331711:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4121
00000100:00080000:0.0:1787828957.331720:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828957.331722:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000800:00000100:1.0:1787828957.331727:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000008:00100000:0.0:1787828957.331728:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787828957.331737:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb480 x1874670273143040/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787828957.331745:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828957.331748:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787828957.331749:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828957.331752:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4121
00000100:00080000:0.0:1787828957.331754:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828957.331756:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828957.331759:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787828957.331768:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9e00 x1874670273143168/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787828957.331771:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828957/real 1787828957]  req@ffff9ee0056e8b40 x1874670273142656/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828982 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828957.331786:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828957.331791:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787828957.331792:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828957.331797:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4121
00000100:00100000:1.0:1787828957.331799:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8b40 x1874670273142656/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828982 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787828957.331801:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828957.331807:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828957.331810:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:1.0:1787828957.331820:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:0.0:1787828957.331822:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8000 x1874670273143296/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787828957.331827:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828957.331834:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273142656:192.168.203.121@tcp:250:kworker.0
00000100:00080000:0.0:1787828957.331838:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787828957.331842:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787828957.331844:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787828957.331847:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4121
00000100:00080000:0.0:1787828957.331850:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787828957.331852:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787828957.331855:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787828957.331859:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273142784:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787828957.331865:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e83c0 x1874670273143424/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1787828957.331890:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828957.331907:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828957/real 1787828957]  req@ffff9ee0056e92c0 x1874670273142784/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828982 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828957.331921:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e92c0 x1874670273142784/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828982 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828957.331927:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828957.331929:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828957.331931:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273142784:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828957.331936:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273142912:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828957.331952:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828957.331959:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828957/real 1787828957]  req@ffff9ee0056eb840 x1874670273142912/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828982 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828957.331967:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb840 x1874670273142912/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828982 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828957.331972:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828957.331975:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828957.331977:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273142912:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828957.331980:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273143040:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828957.331990:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828957.331996:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828957/real 1787828957]  req@ffff9ee0056eb480 x1874670273143040/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828982 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828957.332003:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb480 x1874670273143040/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828982 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828957.332008:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828957.332010:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828957.332012:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273143040:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828957.332015:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273143168:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787828957.332025:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828957.332030:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828957/real 1787828957]  req@ffff9ee0056e9e00 x1874670273143168/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828982 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828957.332037:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9e00 x1874670273143168/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828982 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828957.332042:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828957.332044:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828957.332046:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273143168:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787828957.332049:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273143296:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828957.332058:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828957.332063:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828957/real 1787828957]  req@ffff9ee0056e8000 x1874670273143296/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828982 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828957.332070:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8000 x1874670273143296/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828982 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828957.332079:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828957.332081:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828957.332083:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273143296:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787828957.332095:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273143424:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787828957.332105:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787828957.332111:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828957/real 1787828957]  req@ffff9ee0056e83c0 x1874670273143424/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828982 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787828957.332118:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e83c0 x1874670273143424/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828982 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828957.332123:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828957.332124:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787828957.332126:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273143424:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828958.163458:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828958.355394:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828959.187497:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828959.379388:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828960.211467:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828960.403398:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828961.235621:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828961.427444:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828962.259460:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828962.451397:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:1.0:1787828962.451482:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828962.451488:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1787828962.451491:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787828962.451499:0:27626:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4126
00000100:00080000:1.0:1787828962.451508:0:27626:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828962.451514:0:27626:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787828962.451547:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a30c0 x1874670273143552/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787828962.451580:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828962.451583:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787828962.451584:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787828962.451587:0:27626:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4126
00000100:00080000:1.0:1787828962.451589:0:27626:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828962.451592:0:27626:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787828962.451600:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787828962.451610:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a3480 x1874670273143680/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787828962.451618:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828962.451623:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00100000:3.0:1787828962.451624:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273143552:192.168.203.121@tcp:250:kworker.0
00000100:00080000:1.0:1787828962.451625:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787828962.451632:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4126
00000100:00080000:1.0:1787828962.451635:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828962.451637:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787828962.451640:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787828962.451649:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0780 x1874670273143808/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787828962.451656:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828962.451658:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787828962.451659:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787828962.451662:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4126
00000100:00080000:1.0:1787828962.451664:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828962.451666:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787828962.451670:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787828962.451676:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0000 x1874670273143936/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787828962.451683:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:3.0:1787828962.451687:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:1.0:1787828962.451689:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787828962.451691:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787828962.451695:0:27626:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4126
00000100:00080000:1.0:1787828962.451698:0:27626:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828962.451701:0:27626:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787828962.451705:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787828962.451714:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a2580 x1874670273144064/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787828962.451720:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828962.451722:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787828962.451723:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787828962.451726:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4126
00000100:00080000:1.0:1787828962.451729:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787828962.451734:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787828962.451735:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828962/real 1787828962]  req@ffff9ee0056a30c0 x1874670273143552/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828987 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:1.0:1787828962.451738:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787828962.451752:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0b40 x1874670273144192/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787828962.451758:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a30c0 x1874670273143552/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828987 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787828962.451762:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787828962.451770:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787828962.451773:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828962.451778:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787828962.451779:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4126
00000100:00080000:1.0:1787828962.451784:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828962.451786:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:1.0:1787828962.451790:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787828962.451793:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273143552:192.168.203.121@tcp:250:kworker.0
00000008:00100000:1.0:1787828962.451795:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787828962.451805:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1e00 x1874670273144320/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787828962.451817:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273143680:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787828962.451836:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787828962.451845:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828962/real 1787828962]  req@ffff9ee0056a3480 x1874670273143680/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828987 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787828962.451858:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a3480 x1874670273143680/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828987 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828962.451866:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787828962.451869:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787828962.451873:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273143680:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787828962.451880:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273143808:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787828962.451906:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787828962.451915:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828962/real 1787828962]  req@ffff9ee0056a0780 x1874670273143808/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828987 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787828962.451923:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0780 x1874670273143808/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828987 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828962.451928:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787828962.451931:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787828962.451933:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273143808:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787828962.451936:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273143936:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787828962.451948:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787828962.451954:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828962/real 1787828962]  req@ffff9ee0056a0000 x1874670273143936/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828987 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787828962.451961:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0000 x1874670273143936/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828987 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828962.451965:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787828962.451967:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787828962.451969:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273143936:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787828962.451972:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273144064:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787828962.451982:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787828962.451987:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828962/real 1787828962]  req@ffff9ee0056a2580 x1874670273144064/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828987 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787828962.451999:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a2580 x1874670273144064/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828987 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828962.452004:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787828962.452006:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787828962.452008:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273144064:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787828962.452011:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273144192:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787828962.452020:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787828962.452025:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828962/real 1787828962]  req@ffff9ee0056a0b40 x1874670273144192/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828987 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787828962.452032:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0b40 x1874670273144192/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828987 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828962.452036:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787828962.452038:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787828962.452040:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273144192:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787828962.452044:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273144320:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787828962.452053:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787828962.452058:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828962/real 1787828962]  req@ffff9ee0056a1e00 x1874670273144320/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828987 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787828962.452073:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1e00 x1874670273144320/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828987 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828962.452082:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787828962.452085:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787828962.452087:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273144320:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828963.283631:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828963.475463:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828964.307507:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828964.499434:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828965.331486:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828965.523398:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828966.355473:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828966.547364:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828967.379494:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1787828967.571424:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828967.571434:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787828967.571439:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1787828967.571441:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787828967.571451:0:27626:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4131
00000100:00080000:3.0:1787828967.571464:0:27626:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828967.571471:0:27626:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787828967.571530:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057043c0 x1874670273144448/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828967.571563:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828967.571567:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787828967.571569:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828967.571573:0:27626:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4131
00000100:00080000:3.0:1787828967.571579:0:27626:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828967.571584:0:27626:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828967.571597:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787828967.571599:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273144448:192.168.203.121@tcp:250:kworker.0
00000100:00100000:3.0:1787828967.571615:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057070c0 x1874670273144576/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828967.571627:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828967.571631:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787828967.571634:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828967.571639:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4131
00000100:00080000:3.0:1787828967.571644:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828967.571649:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828967.571655:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787828967.571668:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704000 x1874670273144704/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1787828967.571678:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787828967.571682:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828967.571688:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787828967.571690:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828967.571695:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4131
00000100:00080000:3.0:1787828967.571700:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828967.571703:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787828967.571722:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828967/real 1787828967]  req@ffff9ee0057043c0 x1874670273144448/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828992 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828967.571737:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057043c0 x1874670273144448/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828992 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:3.0:1787828967.571764:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787828967.571777:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707480 x1874670273144832/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828967.571787:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787828967.571789:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828967.571794:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787828967.571795:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:3.0:1787828967.571796:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1787828967.571803:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273144448:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787828967.571804:0:27626:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4131
00000100:00100000:2.0:1787828967.571828:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273144576:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787828967.571848:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828967.571857:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828967/real 1787828967]  req@ffff9ee0057070c0 x1874670273144576/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828992 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828967.571865:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057070c0 x1874670273144576/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828992 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828967.571872:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828967.571874:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828967.571876:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273144576:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787828967.571880:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273144704:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787828967.571896:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828967.571904:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828967/real 1787828967]  req@ffff9ee005704000 x1874670273144704/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828992 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828967.571912:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704000 x1874670273144704/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828992 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828967.571922:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828967.571926:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00080000:3.0:1787828967.571928:0:27626:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1787828967.571929:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273144704:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787828967.571940:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273144832:192.168.203.121@tcp:8:kworker.0
00000100:00080000:3.0:1787828967.571940:0:27626:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828967.571951:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000800:00000100:2.0:1787828967.571959:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787828967.571973:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057052c0 x1874670273144960/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787828967.571974:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828967/real 1787828967]  req@ffff9ee005707480 x1874670273144832/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828992 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828967.571991:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707480 x1874670273144832/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828992 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828967.572002:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828967.572007:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828967.572012:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273144832:192.168.203.121@tcp:8:kworker.0
00000100:00080000:3.0:1787828967.572036:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1787828967.572040:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273144960:192.168.203.121@tcp:38:kworker.0
00000100:00080000:3.0:1787828967.572042:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787828967.572048:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828967.572054:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4131
00000100:00080000:3.0:1787828967.572059:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000800:00000100:2.0:1787828967.572065:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787828967.572065:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828967.572073:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828967.572078:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828967/real 1787828967]  req@ffff9ee0057052c0 x1874670273144960/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828992 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787828967.572087:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706940 x1874670273145088/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787828967.572092:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057052c0 x1874670273144960/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828992 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828967.572105:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787828967.572107:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787828967.572110:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787828967.572113:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00080000:3.0:1787828967.572114:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1787828967.572121:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273144960:192.168.203.121@tcp:38:kworker.0
00000100:00080000:3.0:1787828967.572122:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4131
00000100:00080000:3.0:1787828967.572129:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828967.572132:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787828967.572136:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273145088:192.168.203.121@tcp:8:kworker.0
00000008:00100000:3.0:1787828967.572137:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787828967.572150:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707840 x1874670273145216/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1787828967.572158:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828967.572170:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828967/real 1787828967]  req@ffff9ee005706940 x1874670273145088/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828992 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828967.572179:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706940 x1874670273145088/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828992 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828967.572185:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828967.572187:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828967.572190:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273145088:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787828967.572197:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273145216:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787828967.572207:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828967.572212:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828967/real 1787828967]  req@ffff9ee005707840 x1874670273145216/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828992 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828967.572219:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707840 x1874670273145216/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828992 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828967.572224:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828967.572226:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828967.572228:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273145216:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828968.403528:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828968.595434:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828969.427468:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828969.619382:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828970.451488:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828970.643380:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828971.475575:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828971.667392:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828972.499566:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1787828972.691413:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1787828972.691417:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787828972.691423:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787828972.691427:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828972.691436:0:27626:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4136
00000100:00080000:3.0:1787828972.691445:0:27626:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828972.691452:0:27626:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787828972.691481:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057061c0 x1874670273145344/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828972.691518:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828972.691532:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787828972.691534:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828972.691537:0:27626:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4136
00000100:00080000:3.0:1787828972.691540:0:27626:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828972.691543:0:27626:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828972.691551:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787828972.691562:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707c00 x1874670273145472/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828972.691569:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828972.691572:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787828972.691573:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828972.691576:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4136
00000100:00080000:3.0:1787828972.691578:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1787828972.691582:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273145344:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787828972.691584:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828972.691593:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787828972.691601:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705680 x1874670273145600/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828972.691613:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828972.691615:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787828972.691617:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828972.691619:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4136
00000100:00080000:3.0:1787828972.691621:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828972.691624:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828972.691627:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787828972.691645:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707840 x1874670273145728/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828972.691651:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828972.691653:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787828972.691654:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828972.691657:0:27626:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4136
00000100:00080000:3.0:1787828972.691659:0:27626:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000800:00000100:2.0:1787828972.691665:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787828972.691665:0:27626:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828972.691672:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787828972.691680:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706940 x1874670273145856/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828972.691686:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828972.691689:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787828972.691690:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828972.691693:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4136
00000100:00080000:3.0:1787828972.691695:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828972.691698:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828972.691701:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828972.691710:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828972/real 1787828972]  req@ffff9ee0057061c0 x1874670273145344/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828997 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787828972.691711:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057052c0 x1874670273145984/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828972.691745:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828972.691749:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787828972.691750:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1787828972.691753:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057061c0 x1874670273145344/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787828997 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828972.691756:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4136
00000100:00080000:3.0:1787828972.691762:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828972.691768:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00080000:2.0:1787828972.691773:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000008:00100000:3.0:1787828972.691773:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:2.0:1787828972.691782:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787828972.691786:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707480 x1874670273146112/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787828972.691789:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273145344:192.168.203.121@tcp:250:kworker.0
00000100:00100000:2.0:1787828972.691803:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273145472:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787828972.691831:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828972.691840:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828972/real 1787828972]  req@ffff9ee005707c00 x1874670273145472/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828997 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828972.691848:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707c00 x1874670273145472/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828997 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828972.691853:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828972.691855:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828972.691858:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273145472:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787828972.691892:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273145600:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787828972.691904:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828972.691910:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828972/real 1787828972]  req@ffff9ee005705680 x1874670273145600/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828997 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828972.691923:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705680 x1874670273145600/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828997 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828972.691928:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828972.691930:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828972.691932:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273145600:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787828972.691935:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273145728:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787828972.691956:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828972.691961:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828972/real 1787828972]  req@ffff9ee005707840 x1874670273145728/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828997 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828972.691968:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707840 x1874670273145728/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828997 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828972.691973:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828972.691975:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828972.691977:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273145728:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787828972.691980:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273145856:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787828972.691989:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828972.691994:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828972/real 1787828972]  req@ffff9ee005706940 x1874670273145856/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828997 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828972.692001:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706940 x1874670273145856/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787828997 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828972.692018:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828972.692020:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828972.692022:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273145856:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787828972.692026:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273145984:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787828972.692035:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828972.692040:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828972/real 1787828972]  req@ffff9ee0057052c0 x1874670273145984/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828997 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828972.692046:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057052c0 x1874670273145984/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828997 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828972.692051:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828972.692053:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828972.692056:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273145984:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787828972.692059:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273146112:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787828972.692075:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828972.692081:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828972/real 1787828972]  req@ffff9ee005707480 x1874670273146112/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828997 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828972.692088:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707480 x1874670273146112/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787828997 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828972.692093:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828972.692095:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828972.692097:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273146112:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828973.523453:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787828973.715464:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828974.547483:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828974.739442:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828975.571505:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828975.763425:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828976.595558:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828976.787444:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828977.619515:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1787828977.811384:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1787828977.811393:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787828977.811395:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787828977.811402:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828977.811414:0:27626:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4141
00000100:00080000:3.0:1787828977.811429:0:27626:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828977.811439:0:27626:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787828977.811501:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704000 x1874670273146240/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828977.811532:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828977.811537:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787828977.811538:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828977.811543:0:27626:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4141
00000100:00080000:3.0:1787828977.811547:0:27626:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828977.811551:0:27626:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828977.811562:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787828977.811564:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273146240:192.168.203.121@tcp:250:kworker.0
00000100:00100000:3.0:1787828977.811575:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057070c0 x1874670273146368/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828977.811585:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828977.811587:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787828977.811589:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828977.811591:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4141
00000100:00080000:3.0:1787828977.811594:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828977.811596:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828977.811600:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787828977.811609:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057043c0 x1874670273146496/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828977.811615:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828977.811618:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787828977.811619:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828977.811622:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4141
00000100:00080000:3.0:1787828977.811625:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828977.811627:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828977.811631:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:2.0:1787828977.811637:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787828977.811641:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706d00 x1874670273146624/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828977.811649:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828977.811651:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787828977.811653:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828977.811656:0:27626:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4141
00000100:00080000:3.0:1787828977.811657:0:27626:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828977.811660:0:27626:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828977.811663:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787828977.811670:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705e00 x1874670273146752/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828977.811676:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828977.811678:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787828977.811679:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828977.811681:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4141
00000100:00080000:3.0:1787828977.811684:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828977.811687:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828977.811691:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828977.811695:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828977/real 1787828977]  req@ffff9ee005704000 x1874670273146240/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829002 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787828977.811701:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706580 x1874670273146880/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828977.811725:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828977.811728:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787828977.811729:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828977.811733:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4141
00000100:00080000:3.0:1787828977.811736:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1787828977.811741:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704000 x1874670273146240/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829002 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828977.811741:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828977.811748:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:2.0:1787828977.811761:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:3.0:1787828977.811762:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704b40 x1874670273147008/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828977.811768:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828977.811776:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273146240:192.168.203.121@tcp:250:kworker.0
00000100:00100000:2.0:1787828977.811800:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273146368:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787828977.811819:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828977.811829:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828977/real 1787828977]  req@ffff9ee0057070c0 x1874670273146368/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829002 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828977.811837:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057070c0 x1874670273146368/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829002 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828977.811843:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828977.811846:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828977.811848:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273146368:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787828977.811852:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273146496:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787828977.811864:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828977.811870:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828977/real 1787828977]  req@ffff9ee0057043c0 x1874670273146496/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829002 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828977.811878:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057043c0 x1874670273146496/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829002 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828977.811883:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828977.811884:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828977.811886:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273146496:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787828977.811890:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273146624:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787828977.811909:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828977.811919:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828977/real 1787828977]  req@ffff9ee005706d00 x1874670273146624/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829002 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828977.811931:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706d00 x1874670273146624/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829002 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828977.811940:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828977.811943:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828977.811947:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273146624:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787828977.811953:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273146752:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787828977.811973:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828977.811983:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828977/real 1787828977]  req@ffff9ee005705e00 x1874670273146752/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829002 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828977.811991:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705e00 x1874670273146752/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829002 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828977.811996:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828977.811999:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828977.812000:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273146752:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787828977.812004:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273146880:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787828977.812016:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828977.812022:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828977/real 1787828977]  req@ffff9ee005706580 x1874670273146880/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829002 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828977.812029:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706580 x1874670273146880/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829002 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828977.812034:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828977.812036:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828977.812038:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273146880:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787828977.812041:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273147008:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787828977.812051:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828977.812056:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828977/real 1787828977]  req@ffff9ee005704b40 x1874670273147008/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829002 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828977.812069:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704b40 x1874670273147008/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829002 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828977.812074:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828977.812076:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828977.812077:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273147008:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828978.643505:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828978.835378:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828979.667519:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828979.859502:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828980.691515:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828980.883377:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828981.715576:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828981.907415:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828982.739531:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828982.931395:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787828982.931395:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828982.931405:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787828982.931410:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828982.931432:0:27626:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4146
00000100:00080000:3.0:1787828982.931443:0:27626:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828982.931450:0:27626:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787828982.931488:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704780 x1874670273147136/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828982.931514:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828982.931519:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787828982.931521:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828982.931526:0:27626:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4146
00000100:00080000:3.0:1787828982.931530:0:27626:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828982.931536:0:27626:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787828982.931543:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273147136:192.168.203.121@tcp:250:kworker.0
00000008:00100000:3.0:1787828982.931546:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787828982.931563:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705a40 x1874670273147264/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828982.931582:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828982.931586:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787828982.931589:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828982.931593:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4146
00000100:00080000:3.0:1787828982.931597:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828982.931602:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828982.931608:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787828982.931623:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704b40 x1874670273147392/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787828982.931637:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273147264:192.168.203.121@tcp:38:kworker.0
00000100:00080000:3.0:1787828982.931641:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828982.931646:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787828982.931649:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828982.931654:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4146
00000100:00080000:3.0:1787828982.931661:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828982.931667:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787828982.931672:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273147392:192.168.203.121@tcp:8:kworker.0
00000008:00100000:3.0:1787828982.931674:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787828982.931691:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706580 x1874670273147520/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828982.931703:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828982.931707:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787828982.931710:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1787828982.931712:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273147520:192.168.203.121@tcp:8:kworker.0
00000100:00080000:3.0:1787828982.931718:0:27626:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4146
00000100:00080000:3.0:1787828982.931724:0:27626:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828982.931729:0:27626:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828982.931735:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787828982.931748:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705e00 x1874670273147648/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828982.931764:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828982.931768:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787828982.931770:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828982.931775:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4146
00000100:00080000:3.0:1787828982.931779:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1787828982.931781:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273147648:192.168.203.121@tcp:38:kworker.0
00000100:00080000:3.0:1787828982.931787:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828982.931795:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787828982.931808:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706d00 x1874670273147776/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828982.931824:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828982.931828:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787828982.931830:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828982.931834:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4146
00000100:00100000:2.0:1787828982.931837:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273147776:192.168.203.121@tcp:8:kworker.0
00000100:00080000:3.0:1787828982.931840:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828982.931847:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828982.931853:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787828982.931867:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057043c0 x1874670273147904/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787828982.931962:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273147904:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828983.763483:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828983.955388:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828984.787545:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828984.979411:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828985.811491:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828986.003374:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000400:00000100:1.0:1787828986.003543:0:2354:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.203.121:988
00000400:00000100:1.0:1787828986.003574:0:2354:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.203.121@tcp at host 192.168.203.121 was unreachable: the network or that node may be down, or Lustre may be misconfigured.
00000800:00000100:1.0:1787828986.003587:0:2354:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:1.0:1787828986.003627:0:2354:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:1.0:1787828986.003636:0:2354:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:1.0:1787828986.003643:0:2354:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:1.0:1787828986.003651:0:2354:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:1.0:1787828986.003658:0:2354:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:1.0:1787828986.003666:0:2354:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000100:00100000:2.0:1787828986.003968:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828982/real 1787828986]  req@ffff9ee0057043c0 x1874670273147904/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829007 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828986.003994:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057043c0 x1874670273147904/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829007 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828986.004008:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828986.004013:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828986.004017:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273147904:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787828986.004025:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828982/real 1787828986]  req@ffff9ee005706d00 x1874670273147776/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829007 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828986.004036:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706d00 x1874670273147776/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829007 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828986.004044:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828986.004048:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828986.004052:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273147776:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787828986.004058:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828982/real 1787828986]  req@ffff9ee005705e00 x1874670273147648/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829007 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828986.004070:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705e00 x1874670273147648/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829007 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828986.004077:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828986.004081:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828986.004084:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273147648:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787828986.004091:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828982/real 1787828986]  req@ffff9ee005706580 x1874670273147520/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829007 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828986.004102:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706580 x1874670273147520/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829007 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828986.004109:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828986.004112:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828986.004116:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273147520:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787828986.004122:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828982/real 1787828986]  req@ffff9ee005704b40 x1874670273147392/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829007 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828986.004148:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704b40 x1874670273147392/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829007 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828986.004157:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828986.004161:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828986.004164:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273147392:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787828986.004170:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828982/real 1787828986]  req@ffff9ee005705a40 x1874670273147264/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829007 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828986.004181:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705a40 x1874670273147264/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829007 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828986.004188:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828986.004192:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828986.004195:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273147264:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787828986.004201:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828982/real 1787828986]  req@ffff9ee005704780 x1874670273147136/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829007 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828986.004212:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704780 x1874670273147136/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829007 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828986.004220:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828986.004223:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828986.004227:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273147136:192.168.203.121@tcp:250:kworker.0
00010000:00010000:0.0:1787828986.835467:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828987.027407:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828987.859462:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1787828988.051426:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1787828988.051428:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787828988.051435:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787828988.051439:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828988.051447:0:27626:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4151
00000100:00080000:3.0:1787828988.051456:0:27626:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828988.051462:0:27626:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787828988.051498:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057070c0 x1874670273148032/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828988.051518:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828988.051520:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787828988.051522:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828988.051524:0:27626:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4151
00000100:00080000:3.0:1787828988.051526:0:27626:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828988.051529:0:27626:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828988.051537:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787828988.051545:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273148032:192.168.203.121@tcp:250:kworker.0
00000100:00100000:3.0:1787828988.051548:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704000 x1874670273148160/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828988.051559:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828988.051561:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787828988.051562:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828988.051565:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4151
00000100:00080000:3.0:1787828988.051568:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828988.051570:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828988.051574:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787828988.051585:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707480 x1874670273148288/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828988.051595:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828988.051599:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787828988.051601:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828988.051604:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4151
00000100:00080000:3.0:1787828988.051609:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000800:00000100:2.0:1787828988.051614:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787828988.051618:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828988.051626:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787828988.051639:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057052c0 x1874670273148416/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828988.051650:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828988.051653:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787828988.051655:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828988.051660:0:27626:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4151
00000100:00080000:3.0:1787828988.051664:0:27626:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1787828988.051667:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828988/real 1787828988]  req@ffff9ee0057070c0 x1874670273148032/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829013 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828988.051682:0:27626:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828988.051689:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787828988.051693:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057070c0 x1874670273148032/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829013 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787828988.051706:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706940 x1874670273148544/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828988.051713:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828988.051723:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:3.0:1787828988.051724:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828988.051729:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00100000:2.0:1787828988.051731:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273148032:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787828988.051732:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828988.051737:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4151
00000100:00080000:3.0:1787828988.051744:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828988.051750:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828988.051756:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828988.051767:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273148160:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787828988.051772:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707840 x1874670273148672/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828988.051785:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828988.051789:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787828988.051791:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828988.051795:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4151
00000100:00080000:3.0:1787828988.051800:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000800:00000100:2.0:1787828988.051802:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787828988.051808:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828988.051815:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828988.051826:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828988/real 1787828988]  req@ffff9ee005704000 x1874670273148160/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829013 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787828988.051830:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705680 x1874670273148800/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787828988.051861:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704000 x1874670273148160/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829013 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828988.051873:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828988.051890:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828988.051895:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273148160:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787828988.051901:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273148288:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787828988.051927:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828988.051940:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828988/real 1787828988]  req@ffff9ee005707480 x1874670273148288/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829013 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828988.051953:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707480 x1874670273148288/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829013 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828988.051960:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828988.051964:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828988.051967:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273148288:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787828988.051974:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273148416:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787828988.051998:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828988.052010:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828988/real 1787828988]  req@ffff9ee0057052c0 x1874670273148416/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829013 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828988.052021:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057052c0 x1874670273148416/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829013 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828988.052030:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828988.052034:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828988.052037:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273148416:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787828988.052043:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273148544:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787828988.052097:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828988.052111:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828988/real 1787828988]  req@ffff9ee005706940 x1874670273148544/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829013 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828988.052124:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706940 x1874670273148544/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829013 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828988.052133:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828988.052136:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828988.052139:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273148544:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787828988.052159:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273148672:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787828988.052180:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828988.052191:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828988/real 1787828988]  req@ffff9ee005707840 x1874670273148672/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829013 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828988.052203:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707840 x1874670273148672/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829013 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828988.052211:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828988.052214:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828988.052224:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273148672:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787828988.052231:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273148800:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787828988.052254:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828988.052266:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828988/real 1787828988]  req@ffff9ee005705680 x1874670273148800/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829013 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828988.052279:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705680 x1874670273148800/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829013 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828988.052287:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828988.052290:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828988.052293:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273148800:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828988.883499:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828989.075458:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828989.907454:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828990.099402:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828990.931483:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828991.123413:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828991.955452:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828992.147425:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828992.979543:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1787828993.171423:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828993.171435:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787828993.171440:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828993.171451:0:27626:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4156
00000100:00080000:3.0:1787828993.171464:0:27626:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1787828993.171473:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787828993.171473:0:27626:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787828993.171518:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707c00 x1874670273148928/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828993.171553:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828993.171557:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787828993.171559:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828993.171563:0:27626:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4156
00000100:00080000:3.0:1787828993.171566:0:27626:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828993.171570:0:27626:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828993.171581:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787828993.171603:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057061c0 x1874670273149056/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787828993.171613:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273148928:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787828993.171630:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828993.171637:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787828993.171641:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828993.171649:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4156
00000100:00080000:3.0:1787828993.171656:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828993.171661:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828993.171668:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787828993.171685:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705680 x1874670273149184/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828993.171696:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:2.0:1787828993.171705:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787828993.171705:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787828993.171711:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828993.171718:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4156
00000100:00080000:3.0:1787828993.171724:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828993.171728:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828993.171733:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787828993.171744:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707840 x1874670273149312/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828993.171754:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828993.171758:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787828993.171760:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1787828993.171766:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828993/real 1787828993]  req@ffff9ee005707c00 x1874670273148928/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829018 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828993.171768:0:27626:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4156
00000100:00080000:3.0:1787828993.171774:0:27626:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828993.171784:0:27626:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828993.171799:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787828993.171808:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707c00 x1874670273148928/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829018 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828993.171822:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:3.0:1787828993.171824:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706940 x1874670273149440/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828993.171833:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828993.171845:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273148928:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787828993.171858:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828993.171875:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00100000:2.0:1787828993.171878:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273149056:192.168.203.121@tcp:38:kworker.0
00000100:00080000:3.0:1787828993.171880:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828993.171893:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4156
00000100:00080000:3.0:1787828993.171899:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828993.171904:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828993.171911:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:2.0:1787828993.171918:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787828993.171930:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057052c0 x1874670273149568/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787828993.171939:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828993/real 1787828993]  req@ffff9ee0057061c0 x1874670273149056/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829018 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828993.171997:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1787828993.171998:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057061c0 x1874670273149056/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829018 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828993.172011:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787828993.172020:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787828993.172020:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787828993.172033:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00080000:3.0:1787828993.172039:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4156
00000100:00100000:2.0:1787828993.172043:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273149056:192.168.203.121@tcp:38:kworker.0
00000100:00080000:3.0:1787828993.172050:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1787828993.172054:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273149184:192.168.203.121@tcp:8:kworker.0
00000100:00080000:3.0:1787828993.172063:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828993.172073:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:2.0:1787828993.172082:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828993.172093:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828993/real 1787828993]  req@ffff9ee005705680 x1874670273149184/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829018 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787828993.172108:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707480 x1874670273149696/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787828993.172109:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705680 x1874670273149184/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829018 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828993.172156:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828993.172165:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828993.172172:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273149184:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787828993.172184:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273149312:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787828993.172216:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828993.172229:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828993/real 1787828993]  req@ffff9ee005707840 x1874670273149312/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829018 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828993.172241:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707840 x1874670273149312/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829018 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828993.172250:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828993.172270:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828993.172274:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273149312:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787828993.172282:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273149440:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787828993.172302:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828993.172313:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828993/real 1787828993]  req@ffff9ee005706940 x1874670273149440/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829018 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828993.172325:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706940 x1874670273149440/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829018 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828993.172405:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828993.172411:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828993.172417:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273149440:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787828993.172446:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273149568:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787828993.172471:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828993.172484:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828993/real 1787828993]  req@ffff9ee0057052c0 x1874670273149568/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829018 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828993.172502:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057052c0 x1874670273149568/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829018 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828993.172510:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828993.172513:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828993.172516:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273149568:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787828993.172521:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273149696:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787828993.172544:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828993.172560:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828993/real 1787828993]  req@ffff9ee005707480 x1874670273149696/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829018 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828993.172579:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707480 x1874670273149696/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829018 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828993.172592:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828993.172597:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828993.172602:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273149696:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828994.003501:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828994.195425:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787828995.027493:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828995.219404:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828996.051538:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828996.243423:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828997.075459:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828997.267426:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787828998.099445:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1787828998.291395:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1787828998.291401:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787828998.291403:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787828998.291407:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828998.291417:0:27626:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4162
00000100:00080000:3.0:1787828998.291429:0:27626:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828998.291437:0:27626:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787828998.291473:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704000 x1874670273149824/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828998.291499:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828998.291503:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787828998.291506:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828998.291511:0:27626:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4162
00000100:00080000:3.0:1787828998.291516:0:27626:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828998.291521:0:27626:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787828998.291527:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273149824:192.168.203.121@tcp:250:kworker.0
00000008:00100000:3.0:1787828998.291533:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787828998.291546:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057070c0 x1874670273149952/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828998.291556:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828998.291558:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787828998.291560:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828998.291562:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4162
00000100:00080000:3.0:1787828998.291573:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828998.291577:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828998.291580:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:2.0:1787828998.291585:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787828998.291592:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704780 x1874670273150080/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828998.291600:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828998.291603:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787828998.291604:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828998.291606:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4162
00000100:00080000:3.0:1787828998.291608:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828998.291611:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828998.291614:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787828998.291621:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705a40 x1874670273150208/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787828998.291630:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828998/real 1787828998]  req@ffff9ee005704000 x1874670273149824/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829023 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828998.291631:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828998.291641:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787828998.291652:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1787828998.291654:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704000 x1874670273149824/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829023 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828998.291663:0:27626:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4162
00000100:00080000:2.0:1787828998.291667:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787828998.291670:0:27626:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787828998.291672:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828998.291678:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273149824:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787828998.291681:0:27626:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828998.291689:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787828998.291698:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273149952:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787828998.291705:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704b40 x1874670273150336/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787828998.291716:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:2.0:1787828998.291721:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787828998.291722:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787828998.291725:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828998.291730:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4162
00000100:00080000:3.0:1787828998.291734:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1787828998.291737:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828998/real 1787828998]  req@ffff9ee0057070c0 x1874670273149952/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829023 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787828998.291741:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787828998.291748:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828998.291754:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057070c0 x1874670273149952/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829023 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787828998.291760:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706580 x1874670273150464/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787828998.291762:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828998.291765:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828998.291769:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273149952:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787828998.291780:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273150080:192.168.203.121@tcp:8:kworker.0
00000100:00080000:3.0:1787828998.291782:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787828998.291786:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787828998.291788:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787828998.291791:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4162
00000100:00080000:3.0:1787828998.291796:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787828998.291799:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000800:00000100:2.0:1787828998.291803:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000008:00100000:3.0:1787828998.291806:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787828998.291814:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828998/real 1787828998]  req@ffff9ee005704780 x1874670273150080/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829023 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787828998.291819:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705e00 x1874670273150592/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787828998.291850:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704780 x1874670273150080/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829023 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828998.291857:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828998.291860:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828998.291862:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273150080:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787828998.291866:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273150208:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787828998.291877:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828998.291883:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828998/real 1787828998]  req@ffff9ee005705a40 x1874670273150208/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829023 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828998.291890:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705a40 x1874670273150208/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829023 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828998.291895:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828998.291897:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828998.291898:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273150208:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787828998.291916:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273150336:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787828998.291927:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828998.291934:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828998/real 1787828998]  req@ffff9ee005704b40 x1874670273150336/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829023 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828998.291941:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704b40 x1874670273150336/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829023 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828998.291950:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828998.291952:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828998.291954:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273150336:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787828998.291958:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273150464:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787828998.291967:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828998.291972:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828998/real 1787828998]  req@ffff9ee005706580 x1874670273150464/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829023 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828998.291979:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706580 x1874670273150464/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829023 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828998.291984:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828998.291986:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828998.291987:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273150464:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787828998.291991:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273150592:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787828998.291999:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787828998.292005:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787828998/real 1787828998]  req@ffff9ee005705e00 x1874670273150592/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829023 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787828998.292011:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705e00 x1874670273150592/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829023 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787828998.292016:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787828998.292018:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787828998.292020:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273150592:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787828999.123482:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787828999.315433:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787829000.147491:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829000.339421:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829001.171458:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829001.363415:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829002.195479:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829002.387452:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829003.219472:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829003.411409:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:2.0:1787829003.411452:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829003.411456:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787829003.411459:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829003.411466:0:27626:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4167
00000100:00080000:2.0:1787829003.411477:0:27626:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829003.411485:0:27626:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787829003.411517:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057283c0 x1874670273150720/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829003.411537:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829003.411540:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787829003.411542:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829003.411546:0:27626:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4167
00000100:00080000:2.0:1787829003.411549:0:27626:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829003.411552:0:27626:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829003.411559:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787829003.411571:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728000 x1874670273150848/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787829003.411590:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273150720:192.168.203.121@tcp:250:kworker.0
00000100:00080000:2.0:1787829003.411594:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829003.411606:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787829003.411609:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829003.411616:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4167
00000100:00080000:2.0:1787829003.411620:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829003.411626:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829003.411633:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787829003.411650:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a580 x1874670273150976/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829003.411658:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829003.411661:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787829003.411664:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829003.411668:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4167
00000100:00080000:2.0:1787829003.411681:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829003.411688:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829003.411695:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:3.0:1787829003.411703:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829003.411712:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728b40 x1874670273151104/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829003.411728:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829003.411731:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787829003.411733:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829003.411737:0:27626:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4167
00000100:00080000:2.0:1787829003.411741:0:27626:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829003.411744:0:27626:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829003.411750:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787829003.411769:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728f00 x1874670273151232/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787829003.411771:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829003/real 1787829003]  req@ffff9ee0057283c0 x1874670273150720/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829028 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829003.411793:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829003.411797:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787829003.411798:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829003.411801:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4167
00000100:00080000:2.0:1787829003.411803:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829003.411805:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829003.411808:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787829003.411813:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b840 x1874670273151360/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829003.411818:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829003.411820:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787829003.411821:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829003.411823:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4167
00000100:00080000:2.0:1787829003.411825:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829003.411827:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829003.411829:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787829003.411834:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729a40 x1874670273151488/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787829003.412072:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057283c0 x1874670273150720/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829028 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829003.412086:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829003.412091:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829003.412096:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273150720:192.168.203.121@tcp:250:kworker.0
00000100:00100000:3.0:1787829003.412169:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273150848:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787829003.412196:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829003.412207:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829003/real 1787829003]  req@ffff9ee005728000 x1874670273150848/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829028 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829003.412217:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728000 x1874670273150848/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829028 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829003.412223:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829003.412226:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829003.412228:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273150848:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787829003.412233:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273150976:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829003.412249:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829003.412255:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829003/real 1787829003]  req@ffff9ee00572a580 x1874670273150976/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829028 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829003.412263:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a580 x1874670273150976/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829028 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829003.412284:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829003.412288:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829003.412292:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273150976:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829003.412299:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273151104:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829003.412359:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829003.412376:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829003/real 1787829003]  req@ffff9ee005728b40 x1874670273151104/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829028 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829003.412391:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728b40 x1874670273151104/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829028 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829003.412400:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829003.412404:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829003.412407:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273151104:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829003.412415:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273151232:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787829003.412437:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829003.412450:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829003/real 1787829003]  req@ffff9ee005728f00 x1874670273151232/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829028 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829003.412470:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728f00 x1874670273151232/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829028 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829003.412478:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829003.412482:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829003.412485:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273151232:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787829003.412491:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273151360:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829003.412509:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829003.412519:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829003/real 1787829003]  req@ffff9ee00572b840 x1874670273151360/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829028 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829003.412530:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b840 x1874670273151360/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829028 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829003.412537:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829003.412540:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829003.412543:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273151360:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829003.412548:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273151488:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829003.412565:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829003.412576:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829003/real 1787829003]  req@ffff9ee005729a40 x1874670273151488/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829028 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829003.412589:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729a40 x1874670273151488/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829028 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829003.412601:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829003.412604:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829003.412606:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273151488:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787829004.243490:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829004.435468:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787829005.267479:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829005.459386:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829006.291486:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829006.483414:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829007.315483:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829007.507370:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829008.339481:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829008.531396:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:1.0:1787829008.531405:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829008.531411:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1787829008.531414:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829008.531422:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4172
00000100:00080000:1.0:1787829008.531433:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829008.531441:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787829008.531478:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a03c0 x1874670273151616/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829008.531500:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829008.531504:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787829008.531506:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829008.531510:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4172
00000100:00080000:1.0:1787829008.531514:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829008.531519:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829008.531529:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787829008.531537:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273151616:192.168.203.121@tcp:250:kworker.0
00000100:00100000:1.0:1787829008.531542:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a2940 x1874670273151744/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829008.531552:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829008.531555:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787829008.531557:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829008.531560:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4172
00000100:00080000:1.0:1787829008.531563:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829008.531566:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829008.531571:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787829008.531579:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a21c0 x1874670273151872/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829008.531597:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:3.0:1787829008.531598:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:1.0:1787829008.531601:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787829008.531603:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829008.531606:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4172
00000100:00080000:1.0:1787829008.531609:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829008.531613:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829008.531617:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787829008.531626:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1680 x1874670273152000/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829008.531635:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829008.531639:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787829008.531641:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829008.531644:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4172
00000100:00080000:1.0:1787829008.531648:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1787829008.531650:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829008/real 1787829008]  req@ffff9ee0056a03c0 x1874670273151616/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829033 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829008.531652:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829008.531657:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787829008.531667:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0f00 x1874670273152128/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787829008.531669:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a03c0 x1874670273151616/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829033 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829008.531677:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829008.531680:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829008.531681:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787829008.531682:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829008.531684:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:1.0:1787829008.531686:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4172
00000100:00100000:3.0:1787829008.531688:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273151616:192.168.203.121@tcp:250:kworker.0
00000100:00080000:1.0:1787829008.531689:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829008.531693:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829008.531697:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787829008.531704:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a3c00 x1874670273152256/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787829008.531709:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273151744:192.168.203.121@tcp:38:kworker.0
00000100:00080000:1.0:1787829008.531714:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829008.531717:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787829008.531719:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829008.531722:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4172
00000100:00080000:1.0:1787829008.531725:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829008.531729:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829008.531733:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:3.0:1787829008.531739:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829008.531743:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1a40 x1874670273152384/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787829008.531752:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829008/real 1787829008]  req@ffff9ee0056a2940 x1874670273151744/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829033 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829008.531764:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a2940 x1874670273151744/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829033 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829008.531773:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829008.531777:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829008.531781:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273151744:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787829008.531788:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273151872:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829008.531807:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829008.531816:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829008/real 1787829008]  req@ffff9ee0056a21c0 x1874670273151872/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829033 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829008.531823:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a21c0 x1874670273151872/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829033 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829008.531829:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829008.531831:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829008.531833:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273151872:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829008.531837:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273152000:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829008.531847:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829008.531852:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829008/real 1787829008]  req@ffff9ee0056a1680 x1874670273152000/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829033 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829008.531859:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1680 x1874670273152000/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829033 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829008.531871:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829008.531874:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829008.531876:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273152000:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829008.531880:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273152128:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787829008.531891:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829008.531897:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829008/real 1787829008]  req@ffff9ee0056a0f00 x1874670273152128/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829033 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829008.531905:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0f00 x1874670273152128/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829033 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829008.531910:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829008.531912:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829008.531914:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273152128:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787829008.531927:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273152256:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829008.531937:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829008.531942:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829008/real 1787829008]  req@ffff9ee0056a3c00 x1874670273152256/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829033 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829008.531958:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a3c00 x1874670273152256/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829033 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829008.531966:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829008.531970:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829008.531974:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273152256:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829008.531980:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273152384:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829008.532001:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829008.532012:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829008/real 1787829008]  req@ffff9ee0056a1a40 x1874670273152384/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829033 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829008.532020:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1a40 x1874670273152384/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829033 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829008.532032:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829008.532035:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829008.532039:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273152384:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787829009.363428:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829009.555447:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787829010.387491:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829010.579412:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829011.411487:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829011.603423:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829012.435501:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829012.627439:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829013.459436:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1787829013.651461:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1787829013.651466:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:2.0:1787829013.651470:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787829013.651475:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829013.651484:0:27626:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4177
00000100:00080000:2.0:1787829013.651494:0:27626:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829013.651500:0:27626:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787829013.651534:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b0c0 x1874670273152512/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829013.651555:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829013.651558:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787829013.651559:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829013.651562:0:27626:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4177
00000100:00080000:2.0:1787829013.651564:0:27626:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829013.651566:0:27626:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829013.651574:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787829013.651583:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b480 x1874670273152640/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829013.651592:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829013.651594:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787829013.651598:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829013.651601:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4177
00000100:00080000:2.0:1787829013.651603:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829013.651605:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787829013.651605:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273152512:192.168.203.121@tcp:250:kworker.0
00000008:00100000:2.0:1787829013.651614:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787829013.651623:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572ad00 x1874670273152768/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829013.651629:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829013.651632:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787829013.651633:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829013.651636:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4177
00000100:00080000:2.0:1787829013.651638:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829013.651640:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829013.651643:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787829013.651650:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729a40 x1874670273152896/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829013.651657:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829013.651659:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787829013.651660:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829013.651663:0:27626:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4177
00000100:00080000:2.0:1787829013.651666:0:27626:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000800:00000100:3.0:1787829013.651666:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:2.0:1787829013.651673:0:27626:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829013.651677:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787829013.651686:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b840 x1874670273153024/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829013.651692:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829013.651695:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787829013.651696:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829013.651698:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4177
00000100:00080000:2.0:1787829013.651700:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829013.651702:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829013.651705:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829013.651710:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829013/real 1787829013]  req@ffff9ee00572b0c0 x1874670273152512/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829038 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829013.651715:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728f00 x1874670273153152/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829013.651734:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829013.651736:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787829013.651737:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829013.651742:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4177
00000100:00100000:3.0:1787829013.651744:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b0c0 x1874670273152512/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829038 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829013.651745:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829013.651750:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829013.651756:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787829013.651768:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728b40 x1874670273153280/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829013.651776:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829013.651782:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829013.651786:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273152512:192.168.203.121@tcp:250:kworker.0
00000100:00100000:3.0:1787829013.651807:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273152640:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787829013.651827:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829013.651837:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829013/real 1787829013]  req@ffff9ee00572b480 x1874670273152640/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829038 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829013.651846:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b480 x1874670273152640/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829038 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829013.651851:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829013.651854:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829013.651856:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273152640:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787829013.651860:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273152768:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829013.651879:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829013.651886:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829013/real 1787829013]  req@ffff9ee00572ad00 x1874670273152768/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829038 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829013.651894:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572ad00 x1874670273152768/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829038 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829013.651899:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829013.651901:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829013.651904:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273152768:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829013.651907:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273152896:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829013.651917:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829013.651925:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829013/real 1787829013]  req@ffff9ee005729a40 x1874670273152896/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829038 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829013.651937:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729a40 x1874670273152896/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829038 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829013.651945:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829013.651949:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829013.651952:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273152896:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829013.651959:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273153024:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787829013.651980:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829013.651992:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829013/real 1787829013]  req@ffff9ee00572b840 x1874670273153024/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829038 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829013.652016:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b840 x1874670273153024/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829038 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829013.652025:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829013.652029:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829013.652033:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273153024:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787829013.652039:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273153152:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829013.652058:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829013.652067:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829013/real 1787829013]  req@ffff9ee005728f00 x1874670273153152/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829038 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829013.652075:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728f00 x1874670273153152/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829038 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829013.652080:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829013.652082:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829013.652084:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273153152:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829013.652088:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273153280:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829013.652098:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829013.652104:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829013/real 1787829013]  req@ffff9ee005728b40 x1874670273153280/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829038 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829013.652110:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728b40 x1874670273153280/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829038 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829013.652120:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829013.652122:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829013.652124:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273153280:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787829014.483500:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829014.675425:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787829015.507564:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829015.699580:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829016.531506:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829016.723372:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829017.555524:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829017.747421:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829018.579550:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1787829018.771466:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829018.771480:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787829018.771488:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829018.771501:0:27626:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4182
00000100:00100000:1.0:1787829018.771503:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:2.0:1787829018.771515:0:27626:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829018.771525:0:27626:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787829018.771566:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a580 x1874670273153408/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829018.771597:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829018.771603:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787829018.771606:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829018.771612:0:27626:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4182
00000100:00080000:2.0:1787829018.771617:0:27626:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829018.771624:0:27626:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829018.771638:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787829018.771654:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273153408:192.168.203.121@tcp:250:kworker.0
00000100:00100000:2.0:1787829018.771665:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728000 x1874670273153536/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829018.771686:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829018.771692:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787829018.771696:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829018.771704:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4182
00000100:00080000:2.0:1787829018.771711:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829018.771718:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829018.771727:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:3.0:1787829018.771761:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829018.771762:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057283c0 x1874670273153664/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829018.771785:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829018.771789:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787829018.771792:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829018.771797:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4182
00000100:00080000:2.0:1787829018.771802:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829018.771807:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829018.771813:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787829018.771838:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a1c0 x1874670273153792/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787829018.771853:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829018/real 1787829018]  req@ffff9ee00572a580 x1874670273153408/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829043 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829018.771857:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829018.771872:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787829018.771879:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829018.771892:0:27626:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4182
00000100:00080000:2.0:1787829018.771901:0:27626:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1787829018.771902:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a580 x1874670273153408/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829043 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829018.771928:0:27626:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829018.771941:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00080000:3.0:1787829018.771943:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829018.771955:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829018.771963:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729e00 x1874670273153920/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787829018.771968:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273153408:192.168.203.121@tcp:250:kworker.0
00000100:00080000:2.0:1787829018.771990:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829018.771995:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787829018.771998:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829018.772004:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4182
00000100:00080000:2.0:1787829018.772008:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829018.772012:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829018.772018:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829018.772020:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273153536:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787829018.772032:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a940 x1874670273154048/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829018.772046:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829018.772049:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787829018.772051:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829018.772056:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4182
00000100:00080000:2.0:1787829018.772071:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000800:00000100:3.0:1787829018.772079:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:2.0:1787829018.772080:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829018.772092:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787829018.772106:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728780 x1874670273154176/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787829018.772119:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829018/real 1787829018]  req@ffff9ee005728000 x1874670273153536/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829043 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829018.772148:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728000 x1874670273153536/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829043 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829018.772186:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829018.772194:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829018.772200:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273153536:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787829018.772213:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273153664:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829018.772267:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829018.772295:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829018/real 1787829018]  req@ffff9ee0057283c0 x1874670273153664/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829043 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829018.772349:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057283c0 x1874670273153664/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829043 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829018.772365:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829018.772370:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829018.772376:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273153664:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829018.772400:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273153792:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829018.772436:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829018.772474:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829018/real 1787829018]  req@ffff9ee00572a1c0 x1874670273153792/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829043 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829018.772496:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a1c0 x1874670273153792/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829043 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829018.772508:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829018.772514:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829018.772520:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273153792:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829018.772531:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273153920:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787829018.772566:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829018.772586:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829018/real 1787829018]  req@ffff9ee005729e00 x1874670273153920/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829043 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829018.772606:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729e00 x1874670273153920/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829043 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829018.772620:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829018.772625:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829018.772630:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273153920:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787829018.772660:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273154048:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829018.772696:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829018.772715:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829018/real 1787829018]  req@ffff9ee00572a940 x1874670273154048/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829043 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829018.772733:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a940 x1874670273154048/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829043 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829018.772746:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829018.772752:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829018.772757:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273154048:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829018.772777:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273154176:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829018.772810:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829018.772829:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829018/real 1787829018]  req@ffff9ee005728780 x1874670273154176/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829043 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829018.772848:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728780 x1874670273154176/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829043 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829018.772872:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829018.772878:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829018.772883:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273154176:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787829019.603489:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829019.795389:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787829020.627563:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829020.819393:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829021.651528:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829021.843414:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829022.675533:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829022.867447:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829023.699574:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829023.891494:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:1.0:1787829023.891539:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829023.891553:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1787829023.891559:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829023.891573:0:27626:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4187
00000100:00080000:1.0:1787829023.891590:0:27626:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829023.891600:0:27626:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787829023.891659:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a12c0 x1874670273154304/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829023.891695:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829023.891700:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787829023.891703:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829023.891707:0:27626:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4187
00000100:00080000:1.0:1787829023.891711:0:27626:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829023.891715:0:27626:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829023.891730:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787829023.891748:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273154304:192.168.203.121@tcp:250:kworker.0
00000100:00100000:1.0:1787829023.891749:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1a40 x1874670273154432/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829023.891779:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829023.891784:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787829023.891787:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829023.891796:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4187
00000100:00080000:1.0:1787829023.891800:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829023.891807:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829023.891815:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787829023.891830:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a3c00 x1874670273154560/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1787829023.891842:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:1.0:1787829023.891853:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829023.891859:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787829023.891862:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829023.891868:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4187
00000100:00080000:1.0:1787829023.891879:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829023.891884:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829023.891890:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787829023.891901:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0f00 x1874670273154688/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787829023.891914:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829023/real 1787829023]  req@ffff9ee0056a12c0 x1874670273154304/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829048 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829023.891915:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829023.891926:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787829023.891929:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829023.891956:0:27626:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4187
00000100:00080000:1.0:1787829023.891965:0:27626:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829023.891972:0:27626:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829023.891978:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787829023.891983:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a12c0 x1874670273154304/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829048 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829023.891993:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1680 x1874670273154816/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829023.892017:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829023.892018:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829023.892027:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787829023.892034:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829023.892034:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829023.892065:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273154304:192.168.203.121@tcp:250:kworker.0
00000100:00080000:1.0:1787829023.892074:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4187
00000100:00080000:1.0:1787829023.892081:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829023.892087:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829023.892100:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829023.892102:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273154432:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787829023.892124:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a21c0 x1874670273154944/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1787829023.892186:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:1.0:1787829023.892207:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829023.892211:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787829023.892215:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1787829023.892221:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829023/real 1787829023]  req@ffff9ee0056a1a40 x1874670273154432/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829048 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829023.892229:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4187
00000100:00080000:1.0:1787829023.892241:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829023.892254:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787829023.892258:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1a40 x1874670273154432/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829048 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:1.0:1787829023.892273:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:3.0:1787829023.892273:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829023.892285:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829023.892291:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273154432:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787829023.892299:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273154560:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787829023.892313:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a2940 x1874670273155072/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1787829023.892397:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829023.892417:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829023/real 1787829023]  req@ffff9ee0056a3c00 x1874670273154560/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829048 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829023.892437:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a3c00 x1874670273154560/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829048 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829023.892449:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829023.892453:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829023.892457:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273154560:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829023.892466:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273154688:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829023.892508:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829023.892519:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829023/real 1787829023]  req@ffff9ee0056a0f00 x1874670273154688/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829048 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829023.892532:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0f00 x1874670273154688/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829048 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829023.892540:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829023.892544:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829023.892547:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273154688:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829023.892555:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273154816:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787829023.892576:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829023.892585:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829023/real 1787829023]  req@ffff9ee0056a1680 x1874670273154816/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829048 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829023.892593:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1680 x1874670273154816/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829048 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829023.892598:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829023.892601:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829023.892603:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273154816:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787829023.892618:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273154944:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829023.892631:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829023.892637:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829023/real 1787829023]  req@ffff9ee0056a21c0 x1874670273154944/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829048 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829023.892645:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a21c0 x1874670273154944/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829048 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829023.892650:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829023.892652:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829023.892653:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273154944:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829023.892657:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273155072:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829023.892667:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829023.892673:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829023/real 1787829023]  req@ffff9ee0056a2940 x1874670273155072/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829048 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829023.892681:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a2940 x1874670273155072/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829048 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829023.892695:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829023.892699:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829023.892703:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273155072:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787829024.723478:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829024.915474:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787829025.747494:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829025.939471:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829026.771428:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829026.963405:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829027.795467:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829027.987410:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829028.819511:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1787829029.011443:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1787829029.011444:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:1.0:1787829029.011454:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1787829029.011459:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829029.011470:0:27626:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4192
00000100:00080000:1.0:1787829029.011481:0:27626:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829029.011489:0:27626:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787829029.011526:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a03c0 x1874670273155200/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829029.011550:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829029.011554:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787829029.011555:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829029.011558:0:27626:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4192
00000100:00080000:1.0:1787829029.011561:0:27626:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829029.011564:0:27626:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829029.011572:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787829029.011583:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1e00 x1874670273155328/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787829029.011587:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273155200:192.168.203.121@tcp:250:kworker.0
00000100:00080000:1.0:1787829029.011597:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829029.011600:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787829029.011601:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829029.011604:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4192
00000100:00080000:1.0:1787829029.011606:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829029.011608:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829029.011612:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787829029.011620:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0b40 x1874670273155456/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829029.011626:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829029.011629:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787829029.011630:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829029.011632:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4192
00000100:00080000:1.0:1787829029.011635:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829029.011637:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829029.011641:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787829029.011647:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a2580 x1874670273155584/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829029.011653:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829029.011655:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787829029.011656:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829029.011659:0:27626:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4192
00000100:00080000:1.0:1787829029.011660:0:27626:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829029.011662:0:27626:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829029.011665:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787829029.011669:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0000 x1874670273155712/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829029.011674:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829029.011676:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787829029.011677:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829029.011679:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4192
00000100:00080000:1.0:1787829029.011680:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829029.011682:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829029.011685:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787829029.011689:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0780 x1874670273155840/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829029.011695:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829029.011698:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000800:00000100:3.0:1787829029.011699:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:1.0:1787829029.011701:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829029.011706:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4192
00000100:00080000:1.0:1787829029.011708:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829029.011711:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829029.011715:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787829029.011723:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a3480 x1874670273155968/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787829029.011745:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829029/real 1787829029]  req@ffff9ee0056a03c0 x1874670273155200/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829054 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829029.011759:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a03c0 x1874670273155200/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829054 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829029.011768:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829029.011771:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829029.011775:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273155200:192.168.203.121@tcp:250:kworker.0
00000100:00100000:3.0:1787829029.011794:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273155328:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787829029.011811:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829029.011819:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829029/real 1787829029]  req@ffff9ee0056a1e00 x1874670273155328/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829054 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829029.011828:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1e00 x1874670273155328/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829054 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829029.011835:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829029.011845:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829029.011849:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273155328:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787829029.011856:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273155456:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829029.011879:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829029.011891:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829029/real 1787829029]  req@ffff9ee0056a0b40 x1874670273155456/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829054 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829029.011900:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0b40 x1874670273155456/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829054 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829029.011906:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829029.011908:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829029.011910:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273155456:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829029.011914:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273155584:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829029.011928:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829029.011934:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829029/real 1787829029]  req@ffff9ee0056a2580 x1874670273155584/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829054 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829029.011942:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a2580 x1874670273155584/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829054 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829029.011947:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829029.011948:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829029.011950:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273155584:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829029.011954:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273155712:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787829029.011964:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829029.011969:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829029/real 1787829029]  req@ffff9ee0056a0000 x1874670273155712/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829054 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829029.011977:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0000 x1874670273155712/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829054 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829029.011982:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829029.011984:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829029.011985:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273155712:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787829029.011989:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273155840:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829029.011998:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829029.012004:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829029/real 1787829029]  req@ffff9ee0056a0780 x1874670273155840/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829054 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829029.012010:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0780 x1874670273155840/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829054 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829029.012015:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829029.012017:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829029.012019:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273155840:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829029.012023:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273155968:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829029.012032:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829029.012037:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829029/real 1787829029]  req@ffff9ee0056a3480 x1874670273155968/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829054 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829029.012043:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a3480 x1874670273155968/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829054 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829029.012052:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829029.012055:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829029.012056:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273155968:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787829029.843488:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829030.035399:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787829030.867438:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829031.059432:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829031.891553:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829032.083431:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829032.915448:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829033.107359:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829033.939444:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829034.131377:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:0.0:1787829034.131443:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829034.131453:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1787829034.131458:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829034.131470:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4197
00000100:00080000:0.0:1787829034.131482:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829034.131504:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787829034.131537:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8f00 x1874670273156096/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829034.131557:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829034.131560:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787829034.131561:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829034.131564:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4197
00000100:00080000:0.0:1787829034.131566:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829034.131569:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829034.131578:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787829034.131587:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ebc00 x1874670273156224/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787829034.131593:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273156096:192.168.203.121@tcp:250:kworker.0
00000100:00080000:0.0:1787829034.131604:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829034.131609:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787829034.131611:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829034.131616:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4197
00000100:00080000:0.0:1787829034.131620:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829034.131624:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829034.131630:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787829034.131644:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e83c0 x1874670273156352/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829034.131656:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829034.131659:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787829034.131660:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829034.131663:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4197
00000800:00000100:3.0:1787829034.131668:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:0.0:1787829034.131669:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829034.131675:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829034.131679:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787829034.131690:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8000 x1874670273156480/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829034.131696:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829034.131699:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787829034.131700:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829034.131703:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4197
00000100:00080000:0.0:1787829034.131706:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829034.131708:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829034.131711:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787829034.131716:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829034/real 1787829034]  req@ffff9ee0056e8f00 x1874670273156096/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829059 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829034.131721:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9e00 x1874670273156608/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829034.131747:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829034.131750:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787829034.131752:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1787829034.131755:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8f00 x1874670273156096/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829059 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829034.131760:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4197
00000100:00080000:0.0:1787829034.131769:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829034.131772:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829034.131776:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00080000:3.0:1787829034.131778:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829034.131784:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273156096:192.168.203.121@tcp:250:kworker.0
00000008:00100000:0.0:1787829034.131788:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787829034.131804:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb480 x1874670273156736/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787829034.131806:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273156224:192.168.203.121@tcp:38:kworker.0
00000100:00080000:0.0:1787829034.131823:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829034.131827:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787829034.131830:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:3.0:1787829034.131831:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:0.0:1787829034.131840:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4197
00000100:00080000:0.0:1787829034.131845:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1787829034.131849:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829034/real 1787829034]  req@ffff9ee0056ebc00 x1874670273156224/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829059 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829034.131852:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829034.131880:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829034.131890:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ebc00 x1874670273156224/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829059 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829034.131901:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb840 x1874670273156864/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829034.131904:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829034.131910:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829034.131916:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273156224:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787829034.131949:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273156352:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829034.131974:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829034.131984:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829034/real 1787829034]  req@ffff9ee0056e83c0 x1874670273156352/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829059 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829034.131994:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e83c0 x1874670273156352/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829059 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829034.132001:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829034.132003:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829034.132006:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273156352:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829034.132011:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273156480:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829034.132024:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829034.132031:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829034/real 1787829034]  req@ffff9ee0056e8000 x1874670273156480/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829059 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829034.132041:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8000 x1874670273156480/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829059 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829034.132047:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829034.132049:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829034.132052:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273156480:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829034.132077:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273156608:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787829034.132096:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829034.132122:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829034/real 1787829034]  req@ffff9ee0056e9e00 x1874670273156608/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829059 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829034.132130:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9e00 x1874670273156608/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829059 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829034.132136:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829034.132138:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829034.132140:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273156608:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787829034.132152:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273156736:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829034.132163:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829034.132169:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829034/real 1787829034]  req@ffff9ee0056eb480 x1874670273156736/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829059 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829034.132176:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb480 x1874670273156736/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829059 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829034.132181:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829034.132183:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829034.132185:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273156736:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829034.132189:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273156864:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829034.132198:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829034.132203:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829034/real 1787829034]  req@ffff9ee0056eb840 x1874670273156864/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829059 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829034.132210:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb840 x1874670273156864/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829059 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829034.132220:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829034.132222:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829034.132224:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273156864:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787829034.963485:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829035.155414:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787829035.987503:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829036.179429:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829037.011599:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829037.203433:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829038.035497:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829038.227418:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829039.059492:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829039.251432:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:0.0:1787829039.251742:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829039.251750:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1787829039.251755:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829039.251766:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4202
00000100:00080000:0.0:1787829039.251777:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829039.251786:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787829039.251833:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e92c0 x1874670273156992/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829039.251860:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829039.251865:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787829039.251867:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829039.251873:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4202
00000100:00080000:0.0:1787829039.251877:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829039.251883:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787829039.251889:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273156992:192.168.203.121@tcp:250:kworker.0
00000008:00100000:0.0:1787829039.251893:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787829039.251913:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8b40 x1874670273157120/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829039.251927:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829039.251932:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787829039.251934:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829039.251939:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4202
00000100:00080000:0.0:1787829039.251944:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000800:00000100:2.0:1787829039.251944:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:0.0:1787829039.251953:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829039.251961:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787829039.251976:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb0c0 x1874670273157248/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829039.251986:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829039.251990:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787829039.251992:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829039.251996:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4202
00000100:00080000:0.0:1787829039.252000:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829039.252005:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829039.252011:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787829039.252031:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829039/real 1787829039]  req@ffff9ee0056e92c0 x1874670273156992/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829064 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829039.252041:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9a40 x1874670273157376/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829039.252057:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1787829039.252057:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e92c0 x1874670273156992/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829064 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829039.252068:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787829039.252073:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829039.252073:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829039.252082:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:0.0:1787829039.252085:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4202
00000100:00100000:2.0:1787829039.252089:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273156992:192.168.203.121@tcp:250:kworker.0
00000100:00080000:0.0:1787829039.252093:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829039.252101:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787829039.252111:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273157120:192.168.203.121@tcp:38:kworker.0
00000008:00100000:0.0:1787829039.252113:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787829039.252134:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ea580 x1874670273157504/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1787829039.252140:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:0.0:1787829039.252156:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1787829039.252158:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829039/real 1787829039]  req@ffff9ee0056e8b40 x1874670273157120/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829064 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829039.252163:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787829039.252168:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829039.252178:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4202
00000100:00100000:2.0:1787829039.252179:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8b40 x1874670273157120/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829064 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829039.252187:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829039.252189:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829039.252197:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00080000:0.0:1787829039.252198:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787829039.252201:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273157120:192.168.203.121@tcp:38:kworker.0
00000008:00100000:0.0:1787829039.252208:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787829039.252209:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273157248:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829039.252230:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9680 x1874670273157632/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1787829039.252235:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829039.252247:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829039/real 1787829039]  req@ffff9ee0056eb0c0 x1874670273157248/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829064 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829039.252248:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829039.252260:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787829039.252265:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1787829039.252269:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb0c0 x1874670273157248/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829064 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829039.252274:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4202
00000100:00080000:2.0:1787829039.252283:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829039.252284:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829039.252289:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00080000:0.0:1787829039.252294:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787829039.252295:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273157248:192.168.203.121@tcp:8:kworker.0
00000008:00100000:0.0:1787829039.252306:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787829039.252307:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273157376:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829039.252352:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8780 x1874670273157760/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1787829039.252364:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829039.252386:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829039/real 1787829039]  req@ffff9ee0056e9a40 x1874670273157376/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829064 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829039.252405:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9a40 x1874670273157376/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829064 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829039.252416:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829039.252420:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829039.252425:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273157376:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787829039.252445:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273157504:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787829039.252466:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829039.252477:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829039/real 1787829039]  req@ffff9ee0056ea580 x1874670273157504/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829064 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829039.252485:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ea580 x1874670273157504/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829064 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829039.252491:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829039.252493:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829039.252495:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273157504:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787829039.252499:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273157632:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787829039.252511:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829039.252517:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829039/real 1787829039]  req@ffff9ee0056e9680 x1874670273157632/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829064 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829039.252524:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9680 x1874670273157632/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829064 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829039.252529:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829039.252530:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829039.252533:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273157632:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787829039.252536:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273157760:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787829039.252545:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829039.252551:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829039/real 1787829039]  req@ffff9ee0056e8780 x1874670273157760/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829064 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829039.252557:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8780 x1874670273157760/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829064 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829039.252562:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829039.252564:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829039.252566:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273157760:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787829040.083438:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829040.275417:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787829041.107450:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829041.299402:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829042.131471:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829042.323391:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829043.155492:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829043.347459:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829044.179450:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829044.371400:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:2.0:1787829044.371400:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829044.371409:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787829044.371413:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829044.371421:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4208
00000100:00080000:2.0:1787829044.371431:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829044.371437:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787829044.371468:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572bc00 x1874670273157888/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829044.371493:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829044.371496:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787829044.371497:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829044.371500:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4208
00000100:00080000:2.0:1787829044.371502:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829044.371504:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829044.371511:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787829044.371519:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057292c0 x1874670273158016/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829044.371526:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829044.371528:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787829044.371530:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829044.371532:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4208
00000100:00080000:2.0:1787829044.371534:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829044.371537:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829044.371540:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787829044.371547:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729680 x1874670273158144/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829044.371553:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829044.371555:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787829044.371557:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829044.371559:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4208
00000100:00080000:2.0:1787829044.371562:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829044.371565:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829044.371567:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787829044.371577:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728780 x1874670273158272/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787829044.371583:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273157888:192.168.203.121@tcp:250:kworker.0
00000100:00080000:2.0:1787829044.371587:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829044.371597:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787829044.371600:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829044.371606:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4208
00000100:00080000:2.0:1787829044.371610:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829044.371617:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829044.371622:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787829044.371640:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a940 x1874670273158400/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829044.371650:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829044.371654:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787829044.371657:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829044.371660:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4208
00000100:00080000:2.0:1787829044.371671:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829044.371675:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829044.371678:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787829044.371687:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729e00 x1874670273158528/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829044.371698:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829044.371700:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787829044.371701:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829044.371703:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4208
00000100:00080000:2.0:1787829044.371705:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829044.371707:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829044.371709:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787829044.371714:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a1c0 x1874670273158656/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1787829044.372855:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829044.372914:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829044/real 1787829044]  req@ffff9ee00572bc00 x1874670273157888/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829069 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829044.372932:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572bc00 x1874670273157888/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829069 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829044.372940:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829044.372943:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829044.372946:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273157888:192.168.203.121@tcp:250:kworker.0
00000100:00100000:3.0:1787829044.372954:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057292c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273158016:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787829044.373009:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829044.373024:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829044/real 1787829044]  req@ffff9ee0057292c0 x1874670273158016/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829069 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829044.373038:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057292c0 x1874670273158016/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829069 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829044.373044:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829044.373047:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829044.373049:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057292c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273158016:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787829044.373054:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273158144:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829044.373071:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829044.373078:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829044/real 1787829044]  req@ffff9ee005729680 x1874670273158144/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829069 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829044.373086:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729680 x1874670273158144/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829069 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829044.373091:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829044.373094:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829044.373096:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273158144:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829044.373116:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273158272:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829044.373127:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829044.373133:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829044/real 1787829044]  req@ffff9ee005728780 x1874670273158272/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829069 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829044.373149:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728780 x1874670273158272/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829069 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829044.373155:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829044.373157:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829044.373159:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273158272:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829044.373163:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273158400:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787829044.373174:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829044.373180:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829044/real 1787829044]  req@ffff9ee00572a940 x1874670273158400/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829069 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829044.373188:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a940 x1874670273158400/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829069 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829044.373193:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829044.373195:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829044.373197:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273158400:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787829044.373201:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273158528:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829044.373211:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829044.373216:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829044/real 1787829044]  req@ffff9ee005729e00 x1874670273158528/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829069 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829044.373224:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729e00 x1874670273158528/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829069 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829044.373228:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829044.373230:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829044.373232:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273158528:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829044.373235:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273158656:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829044.373244:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829044.373250:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829044/real 1787829044]  req@ffff9ee00572a1c0 x1874670273158656/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829069 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829044.373256:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a1c0 x1874670273158656/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829069 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829044.373266:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829044.373268:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829044.373270:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273158656:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787829045.203466:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829045.395409:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787829046.227474:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829046.419425:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829047.251482:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829047.443433:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829048.275512:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829048.467376:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829049.299477:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829049.491414:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:1.0:1787829049.491420:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829049.491426:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1787829049.491430:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829049.491438:0:27626:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4213
00000100:00080000:1.0:1787829049.491448:0:27626:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829049.491454:0:27626:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787829049.491483:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a30c0 x1874670273158784/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829049.491504:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829049.491507:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787829049.491508:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829049.491511:0:27626:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4213
00000100:00080000:1.0:1787829049.491513:0:27626:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829049.491515:0:27626:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829049.491523:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787829049.491533:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a3480 x1874670273158912/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829049.491541:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829049.491543:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787829049.491544:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829049.491546:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4213
00000100:00080000:1.0:1787829049.491549:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829049.491551:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829049.491556:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829049.491557:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273158784:192.168.203.121@tcp:250:kworker.0
00000100:00100000:1.0:1787829049.491565:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0780 x1874670273159040/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829049.491573:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829049.491576:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787829049.491577:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829049.491579:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4213
00000100:00080000:1.0:1787829049.491581:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829049.491584:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829049.491587:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787829049.491595:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0000 x1874670273159168/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829049.491601:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829049.491604:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787829049.491605:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829049.491608:0:27626:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4213
00000100:00080000:1.0:1787829049.491611:0:27626:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829049.491614:0:27626:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829049.491618:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787829049.491625:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a2580 x1874670273159296/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829049.491631:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829049.491634:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787829049.491635:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829049.491637:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4213
00000100:00080000:1.0:1787829049.491639:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829049.491643:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829049.491647:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829049.491656:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273158912:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787829049.491658:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0b40 x1874670273159424/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829049.491673:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829049.491676:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787829049.491677:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829049.491681:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4213
00000100:00080000:1.0:1787829049.491684:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829049.491686:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829049.491690:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787829049.491699:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1e00 x1874670273159552/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787829049.491705:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273159040:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829049.491734:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273159168:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829049.491754:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273159296:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787829049.491772:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273159424:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829049.491793:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273159552:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787829050.323491:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829050.515504:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787829051.347508:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829051.539476:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829052.371434:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829052.563547:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000400:00000100:3.0:1787829052.563653:0:2352:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.203.121:988
00000400:00000100:3.0:1787829052.563695:0:2352:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.203.121@tcp at host 192.168.203.121 was unreachable: the network or that node may be down, or Lustre may be misconfigured.
00000800:00000100:3.0:1787829052.563713:0:2352:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:3.0:1787829052.563757:0:2352:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:3.0:1787829052.563768:0:2352:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:3.0:1787829052.563776:0:2352:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:3.0:1787829052.563784:0:2352:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:3.0:1787829052.563792:0:2352:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:3.0:1787829052.563801:0:2352:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000100:00100000:2.0:1787829052.563819:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829049/real 1787829052]  req@ffff9ee0056a0780 x1874670273159040/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829074 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829052.563845:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0780 x1874670273159040/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829074 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829052.563857:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829052.563863:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829052.563868:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273159040:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787829052.563875:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829049/real 1787829052]  req@ffff9ee0056a0000 x1874670273159168/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829074 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829052.563890:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0000 x1874670273159168/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829074 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829052.563898:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829052.563902:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829052.563905:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273159168:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787829052.563911:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829049/real 1787829052]  req@ffff9ee0056a2580 x1874670273159296/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829074 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829052.563923:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a2580 x1874670273159296/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829074 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829052.563946:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829052.563950:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829052.563954:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273159296:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787829052.563961:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829049/real 1787829052]  req@ffff9ee0056a0b40 x1874670273159424/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829074 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829052.563974:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0b40 x1874670273159424/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829074 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829052.563982:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829052.563986:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829052.563990:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273159424:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787829052.563997:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829049/real 1787829052]  req@ffff9ee0056a30c0 x1874670273158784/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829074 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829052.564010:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a30c0 x1874670273158784/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829074 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829052.564018:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829052.564022:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829052.564025:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273158784:192.168.203.121@tcp:250:kworker.0
00000100:00100000:2.0:1787829052.564031:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829049/real 1787829052]  req@ffff9ee0056a3480 x1874670273158912/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829074 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829052.564042:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a3480 x1874670273158912/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829074 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829052.564050:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829052.564054:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829052.564057:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273158912:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787829052.564096:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829049/real 1787829052]  req@ffff9ee0056a1e00 x1874670273159552/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829074 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829052.564110:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1e00 x1874670273159552/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829074 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829052.564118:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829052.564123:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829052.564126:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273159552:192.168.203.121@tcp:8:kworker.0
00010000:00010000:0.0:1787829053.395477:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829053.587519:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829054.419468:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1787829054.611481:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829054.611490:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787829054.611494:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1787829054.611498:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787829054.611505:0:27626:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4218
00000100:00080000:3.0:1787829054.611516:0:27626:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829054.611527:0:27626:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787829054.611573:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706d00 x1874670273159680/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829054.611601:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829054.611604:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787829054.611606:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829054.611610:0:27626:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4218
00000100:00080000:3.0:1787829054.611613:0:27626:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829054.611617:0:27626:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829054.611627:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787829054.611642:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057043c0 x1874670273159808/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787829054.611647:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273159680:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787829054.611657:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829054.611661:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787829054.611663:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829054.611667:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4218
00000100:00080000:3.0:1787829054.611671:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829054.611674:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829054.611679:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829054.611691:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705e00 x1874670273159936/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829054.611701:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829054.611704:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787829054.611705:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:2.0:1787829054.611711:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787829054.611712:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4218
00000100:00080000:3.0:1787829054.611719:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829054.611723:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829054.611728:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829054.611740:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706580 x1874670273160064/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829054.611749:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829054.611752:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787829054.611754:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829054.611758:0:27626:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4218
00000100:00080000:3.0:1787829054.611762:0:27626:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1787829054.611772:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829054/real 1787829054]  req@ffff9ee005706d00 x1874670273159680/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829079 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829054.611775:0:27626:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829054.611784:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787829054.611801:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704b40 x1874670273160192/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787829054.611803:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706d00 x1874670273159680/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829079 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829054.611832:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829054.611836:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829054.611837:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787829054.611842:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829054.611846:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:3.0:1787829054.611851:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4218
00000100:00100000:2.0:1787829054.611857:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273159680:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787829054.611859:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829054.611868:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829054.611873:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829054.611885:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705a40 x1874670273160320/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787829054.611888:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273159808:192.168.203.121@tcp:38:kworker.0
00000100:00080000:3.0:1787829054.611906:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829054.611909:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787829054.611912:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829054.611929:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4218
00000100:00080000:3.0:1787829054.611934:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000800:00000100:2.0:1787829054.611940:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787829054.611941:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829054.611949:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787829054.611962:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829054/real 1787829054]  req@ffff9ee0057043c0 x1874670273159808/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829079 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829054.611964:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704780 x1874670273160448/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787829054.612022:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057043c0 x1874670273159808/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829079 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829054.612033:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829054.612037:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829054.612041:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273159808:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787829054.612049:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273159936:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787829054.612072:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829054.612100:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829054/real 1787829054]  req@ffff9ee005705e00 x1874670273159936/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829079 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829054.612113:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705e00 x1874670273159936/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829079 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829054.612121:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829054.612124:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829054.612127:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273159936:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787829054.612134:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273160064:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787829054.612155:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829054.612167:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829054/real 1787829054]  req@ffff9ee005706580 x1874670273160064/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829079 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829054.612179:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706580 x1874670273160064/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829079 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829054.612188:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829054.612191:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829054.612194:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273160064:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787829054.612201:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273160192:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787829054.612221:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829054.612232:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829054/real 1787829054]  req@ffff9ee005704b40 x1874670273160192/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829079 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829054.612246:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704b40 x1874670273160192/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829079 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829054.612254:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829054.612257:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829054.612261:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273160192:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787829054.612279:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273160320:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787829054.612312:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829054.612352:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829054/real 1787829054]  req@ffff9ee005705a40 x1874670273160320/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829079 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829054.612365:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705a40 x1874670273160320/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829079 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829054.612374:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829054.612377:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829054.612381:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273160320:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787829054.612388:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273160448:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787829054.612410:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829054.612422:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829054/real 1787829054]  req@ffff9ee005704780 x1874670273160448/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829079 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829054.612442:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704780 x1874670273160448/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829079 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829054.612458:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829054.612462:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829054.612466:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273160448:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787829055.443506:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829055.635513:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787829056.467494:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829056.659435:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829057.491487:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829057.683392:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829058.515480:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829058.707434:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829059.539465:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1787829059.731412:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1787829059.731414:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787829059.731422:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787829059.731426:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829059.731436:0:27626:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4223
00000100:00080000:3.0:1787829059.731447:0:27626:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829059.731456:0:27626:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787829059.731494:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057070c0 x1874670273160576/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829059.731523:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829059.731537:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787829059.731539:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829059.731543:0:27626:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4223
00000100:00080000:3.0:1787829059.731547:0:27626:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1787829059.731548:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273160576:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787829059.731554:0:27626:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829059.731563:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787829059.731574:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704000 x1874670273160704/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829059.731583:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829059.731586:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787829059.731587:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829059.731590:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4223
00000100:00080000:3.0:1787829059.731607:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000800:00000100:2.0:1787829059.731613:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787829059.731614:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829059.731623:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829059.731638:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707480 x1874670273160832/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829059.731648:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829059.731652:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787829059.731654:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829059.731658:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4223
00000100:00080000:3.0:1787829059.731662:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1787829059.731666:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829059/real 1787829059]  req@ffff9ee0057070c0 x1874670273160576/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829084 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829059.731667:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829059.731673:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829059.731684:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057052c0 x1874670273160960/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829059.731693:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1787829059.731696:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057070c0 x1874670273160576/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829084 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829059.731697:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787829059.731701:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829059.731709:0:27626:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4223
00000100:00080000:3.0:1787829059.731713:0:27626:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829059.731714:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829059.731718:0:27626:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00080000:2.0:1787829059.731722:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000008:00100000:3.0:1787829059.731724:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787829059.731727:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273160576:192.168.203.121@tcp:250:kworker.0
00000100:00100000:3.0:1787829059.731735:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706940 x1874670273161088/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829059.731742:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829059.731744:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787829059.731746:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1787829059.731750:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273160704:192.168.203.121@tcp:38:kworker.0
00000100:00080000:3.0:1787829059.731751:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4223
00000100:00080000:3.0:1787829059.731757:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829059.731760:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829059.731764:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829059.731774:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707840 x1874670273161216/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1787829059.731781:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787829059.731783:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829059.731786:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787829059.731788:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829059.731792:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4223
00000100:00100000:2.0:1787829059.731795:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829059/real 1787829059]  req@ffff9ee005704000 x1874670273160704/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829084 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829059.731797:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829059.731805:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829059.731811:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829059.731824:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705680 x1874670273161344/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787829059.731826:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704000 x1874670273160704/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829084 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829059.731848:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829059.731851:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829059.731854:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273160704:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787829059.731859:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273160832:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787829059.731873:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829059.731895:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829059/real 1787829059]  req@ffff9ee005707480 x1874670273160832/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829084 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829059.731904:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707480 x1874670273160832/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829084 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829059.731910:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829059.731912:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829059.731914:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273160832:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787829059.731918:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273160960:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787829059.731932:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829059.731938:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829059/real 1787829059]  req@ffff9ee0057052c0 x1874670273160960/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829084 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829059.731946:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057052c0 x1874670273160960/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829084 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829059.731955:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829059.731957:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829059.731960:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273160960:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787829059.731963:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273161088:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787829059.731973:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829059.731979:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829059/real 1787829059]  req@ffff9ee005706940 x1874670273161088/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829084 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829059.731985:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706940 x1874670273161088/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829084 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829059.731991:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829059.731993:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829059.731994:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273161088:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787829059.732005:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273161216:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787829059.732015:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829059.732021:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829059/real 1787829059]  req@ffff9ee005707840 x1874670273161216/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829084 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829059.732027:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707840 x1874670273161216/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829084 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829059.732032:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829059.732034:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829059.732036:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273161216:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787829059.732040:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273161344:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787829059.732049:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829059.732054:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829059/real 1787829059]  req@ffff9ee005705680 x1874670273161344/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829084 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829059.732061:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705680 x1874670273161344/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829084 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829059.732066:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829059.732068:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829059.732070:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273161344:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787829060.563499:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829060.755414:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787829061.587471:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829061.779381:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829062.611463:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829062.803444:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829063.635632:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829063.827376:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829064.659472:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829064.851420:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:1.0:1787829064.851424:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829064.851431:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1787829064.851435:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829064.851443:0:27626:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4228
00000100:00080000:1.0:1787829064.851451:0:27626:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829064.851458:0:27626:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787829064.851487:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a03c0 x1874670273161472/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829064.851512:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829064.851515:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787829064.851516:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829064.851519:0:27626:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4228
00000100:00080000:1.0:1787829064.851522:0:27626:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829064.851524:0:27626:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829064.851532:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787829064.851540:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a2940 x1874670273161600/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829064.851549:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1787829064.851551:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273161472:192.168.203.121@tcp:250:kworker.0
00000100:00080000:1.0:1787829064.851552:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787829064.851557:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829064.851565:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4228
00000100:00080000:1.0:1787829064.851568:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829064.851572:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829064.851578:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787829064.851591:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a21c0 x1874670273161728/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829064.851603:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829064.851606:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787829064.851608:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829064.851612:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4228
00000100:00080000:1.0:1787829064.851623:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829064.851628:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000800:00000100:2.0:1787829064.851634:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000008:00100000:1.0:1787829064.851635:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787829064.851648:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1680 x1874670273161856/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829064.851656:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829064.851658:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787829064.851660:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829064.851662:0:27626:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4228
00000100:00080000:1.0:1787829064.851665:0:27626:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829064.851668:0:27626:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829064.851671:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787829064.851677:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0f00 x1874670273161984/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829064.851684:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829064.851686:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787829064.851688:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1787829064.851692:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829064/real 1787829064]  req@ffff9ee0056a03c0 x1874670273161472/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829089 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829064.851693:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4228
00000100:00080000:1.0:1787829064.851698:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829064.851704:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829064.851711:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787829064.851720:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a3c00 x1874670273162112/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787829064.851727:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a03c0 x1874670273161472/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829089 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829064.851729:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829064.851736:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787829064.851738:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829064.851745:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4228
00000100:00080000:1.0:1787829064.851749:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829064.851753:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00080000:2.0:1787829064.851754:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000008:00100000:1.0:1787829064.851756:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:2.0:1787829064.851765:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829064.851768:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1a40 x1874670273162240/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787829064.851775:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273161472:192.168.203.121@tcp:250:kworker.0
00000100:00100000:2.0:1787829064.851804:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273161600:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787829064.851829:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829064.851856:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829064/real 1787829064]  req@ffff9ee0056a2940 x1874670273161600/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829089 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829064.851871:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a2940 x1874670273161600/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829089 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829064.851879:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829064.851883:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829064.851887:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273161600:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787829064.851894:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273161728:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787829064.851915:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829064.851927:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829064/real 1787829064]  req@ffff9ee0056a21c0 x1874670273161728/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829089 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829064.851940:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a21c0 x1874670273161728/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829089 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829064.851948:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829064.851952:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829064.851955:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273161728:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787829064.851961:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273161856:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787829064.851983:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829064.851993:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829064/real 1787829064]  req@ffff9ee0056a1680 x1874670273161856/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829089 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829064.852005:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1680 x1874670273161856/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829089 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829064.852013:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829064.852016:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829064.852020:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273161856:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787829064.852027:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273161984:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787829064.852046:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829064.852057:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829064/real 1787829064]  req@ffff9ee0056a0f00 x1874670273161984/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829089 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829064.852069:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0f00 x1874670273161984/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829089 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829064.852077:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829064.852081:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829064.852085:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273161984:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787829064.852091:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273162112:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787829064.852111:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829064.852123:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829064/real 1787829064]  req@ffff9ee0056a3c00 x1874670273162112/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829089 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829064.852142:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a3c00 x1874670273162112/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829089 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829064.852150:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829064.852153:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829064.852156:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273162112:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787829064.852163:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273162240:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787829064.852184:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829064.852195:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829064/real 1787829064]  req@ffff9ee0056a1a40 x1874670273162240/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829089 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829064.852207:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1a40 x1874670273162240/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829089 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829064.852215:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829064.852219:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829064.852222:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273162240:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787829065.683534:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829065.875463:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787829066.707532:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829066.899412:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829067.731491:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829067.923444:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829068.755492:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829068.947391:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829069.779478:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1787829069.971455:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829069.971463:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1787829069.971468:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1787829069.971468:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:1.0:1787829069.971481:0:27626:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4233
00000100:00080000:1.0:1787829069.971490:0:27626:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829069.971495:0:27626:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787829069.971539:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a12c0 x1874670273162368/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829069.971565:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829069.971569:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787829069.971571:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829069.971575:0:27626:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4233
00000100:00080000:1.0:1787829069.971580:0:27626:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829069.971586:0:27626:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829069.971606:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787829069.971619:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1a40 x1874670273162496/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787829069.971624:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273162368:192.168.203.121@tcp:250:kworker.0
00000100:00080000:1.0:1787829069.971632:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829069.971652:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787829069.971653:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829069.971667:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4233
00000100:00080000:1.0:1787829069.971669:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829069.971672:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829069.971677:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787829069.971687:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a3c00 x1874670273162624/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829069.971695:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829069.971698:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787829069.971699:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829069.971702:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4233
00000100:00080000:1.0:1787829069.971713:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829069.971717:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000800:00000100:2.0:1787829069.971721:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000008:00100000:1.0:1787829069.971737:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787829069.971748:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0f00 x1874670273162752/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829069.971754:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829069.971756:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787829069.971757:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829069.971760:0:27626:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4233
00000100:00080000:1.0:1787829069.971763:0:27626:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829069.971765:0:27626:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829069.971768:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787829069.971780:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829069/real 1787829069]  req@ffff9ee0056a12c0 x1874670273162368/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829094 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829069.971781:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1680 x1874670273162880/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829069.971845:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829069.971848:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787829069.971859:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829069.971863:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4233
00000100:00100000:2.0:1787829069.971867:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a12c0 x1874670273162368/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829094 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829069.971868:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829069.971875:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829069.971881:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:2.0:1787829069.971906:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:1.0:1787829069.971911:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a21c0 x1874670273163008/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829069.971916:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829069.971927:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273162368:192.168.203.121@tcp:250:kworker.0
00000100:00080000:1.0:1787829069.971928:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829069.971934:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787829069.971938:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829069.971942:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4233
00000100:00080000:1.0:1787829069.971944:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829069.971947:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829069.971950:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787829069.971957:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a2940 x1874670273163136/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787829069.971961:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273162496:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787829069.972002:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829069.972014:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829069/real 1787829069]  req@ffff9ee0056a1a40 x1874670273162496/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829094 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829069.972024:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1a40 x1874670273162496/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829094 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829069.972030:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829069.972033:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829069.972035:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273162496:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787829069.972040:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273162624:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787829069.972053:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829069.972059:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829069/real 1787829069]  req@ffff9ee0056a3c00 x1874670273162624/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829094 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829069.972067:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a3c00 x1874670273162624/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829094 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829069.972077:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829069.972079:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829069.972081:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273162624:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787829069.972100:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273162752:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787829069.972111:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829069.972117:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829069/real 1787829069]  req@ffff9ee0056a0f00 x1874670273162752/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829094 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829069.972124:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0f00 x1874670273162752/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829094 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829069.972129:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829069.972131:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829069.972133:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273162752:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787829069.972136:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273162880:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787829069.972146:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829069.972151:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829069/real 1787829069]  req@ffff9ee0056a1680 x1874670273162880/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829094 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829069.972158:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1680 x1874670273162880/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829094 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829069.972163:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829069.972165:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829069.972167:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273162880:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787829069.972171:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273163008:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787829069.972180:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829069.972193:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829069/real 1787829069]  req@ffff9ee0056a21c0 x1874670273163008/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829094 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829069.972208:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a21c0 x1874670273163008/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829094 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829069.972214:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829069.972215:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829069.972217:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273163008:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787829069.972231:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273163136:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787829069.972242:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829069.972259:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829069/real 1787829069]  req@ffff9ee0056a2940 x1874670273163136/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829094 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829069.972270:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a2940 x1874670273163136/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829094 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829069.972278:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829069.972281:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829069.972284:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273163136:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787829070.803499:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829070.995440:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787829071.827547:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829072.019427:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829072.851564:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829073.043424:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829073.875570:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829074.067428:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829074.899530:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829075.091476:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:1.0:1787829075.091482:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829075.091493:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1787829075.091500:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829075.091514:0:27626:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4238
00000100:00080000:1.0:1787829075.091529:0:27626:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829075.091540:0:27626:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787829075.091591:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a03c0 x1874670273163264/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829075.091637:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829075.091641:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787829075.091643:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829075.091649:0:27626:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4238
00000100:00080000:1.0:1787829075.091653:0:27626:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829075.091658:0:27626:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829075.091672:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787829075.091683:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273163264:192.168.203.121@tcp:250:kworker.0
00000100:00100000:1.0:1787829075.091689:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1e00 x1874670273163392/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829075.091710:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829075.091714:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787829075.091720:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829075.091727:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4238
00000100:00080000:1.0:1787829075.091732:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829075.091737:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829075.091745:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787829075.091758:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a3480 x1874670273163520/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829075.091767:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829075.091790:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787829075.091793:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829075.091798:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4238
00000100:00080000:1.0:1787829075.091819:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829075.091822:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829075.091827:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787829075.091836:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a30c0 x1874670273163648/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829075.091844:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829075.091847:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787829075.091849:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829075.091853:0:27626:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4238
00000100:00080000:1.0:1787829075.091856:0:27626:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829075.091859:0:27626:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829075.091862:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787829075.091869:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0b40 x1874670273163776/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829075.091876:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829075.091878:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787829075.091880:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829075.091883:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4238
00000100:00080000:1.0:1787829075.091885:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829075.091887:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829075.091889:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787829075.091897:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a2580 x1874670273163904/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829075.091902:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829075.091904:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787829075.091905:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829075.091907:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4238
00000100:00080000:1.0:1787829075.091910:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829075.091914:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829075.091919:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787829075.091930:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0000 x1874670273164032/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1787829075.093139:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829075.093205:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829075/real 1787829075]  req@ffff9ee0056a03c0 x1874670273163264/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829100 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829075.093230:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a03c0 x1874670273163264/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829100 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829075.093239:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829075.093242:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829075.093246:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273163264:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787829075.093270:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273163392:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787829075.093371:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829075.093386:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829075/real 1787829075]  req@ffff9ee0056a1e00 x1874670273163392/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829100 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829075.093415:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1e00 x1874670273163392/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829100 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829075.093424:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829075.093428:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829075.093432:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273163392:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787829075.093439:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273163520:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829075.093467:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829075.093476:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829075/real 1787829075]  req@ffff9ee0056a3480 x1874670273163520/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829100 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829075.093490:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a3480 x1874670273163520/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829100 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829075.093498:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829075.093502:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829075.093505:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273163520:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829075.093512:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273163648:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829075.093549:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829075.093562:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829075/real 1787829075]  req@ffff9ee0056a30c0 x1874670273163648/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829100 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829075.093574:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a30c0 x1874670273163648/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829100 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829075.093595:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829075.093614:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829075.093618:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273163648:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829075.093624:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273163776:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787829075.093646:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829075.093660:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829075/real 1787829075]  req@ffff9ee0056a0b40 x1874670273163776/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829100 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829075.093668:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0b40 x1874670273163776/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829100 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829075.093678:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829075.093680:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829075.093682:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273163776:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787829075.093686:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273163904:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829075.093699:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829075.093705:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829075/real 1787829075]  req@ffff9ee0056a2580 x1874670273163904/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829100 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829075.093712:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a2580 x1874670273163904/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829100 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829075.093727:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829075.093729:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829075.093731:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273163904:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829075.093734:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273164032:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829075.093744:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829075.093749:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829075/real 1787829075]  req@ffff9ee0056a0000 x1874670273164032/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829100 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829075.093756:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0000 x1874670273164032/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829100 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829075.093760:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829075.093762:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829075.093765:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273164032:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787829075.923489:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829076.115385:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787829076.947430:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829077.139396:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829077.971489:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829078.163407:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829078.995455:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829079.187396:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829080.019482:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829080.211447:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787829080.211492:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829080.211505:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787829080.211513:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829080.211525:0:27626:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4243
00000100:00080000:3.0:1787829080.211537:0:27626:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829080.211546:0:27626:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787829080.211596:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057061c0 x1874670273164160/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829080.211640:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829080.211647:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787829080.211651:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829080.211658:0:27626:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4243
00000100:00080000:3.0:1787829080.211669:0:27626:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829080.211679:0:27626:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829080.211694:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787829080.211701:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273164160:192.168.203.121@tcp:250:kworker.0
00000100:00100000:3.0:1787829080.211720:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707c00 x1874670273164288/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829080.211769:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829080.211774:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787829080.211777:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829080.211782:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4243
00000100:00080000:3.0:1787829080.211789:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829080.211795:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829080.211802:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:0.0:1787829080.211804:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829080.211829:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705680 x1874670273164416/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829080.211844:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829080.211848:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787829080.211851:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829080.211856:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4243
00000100:00080000:3.0:1787829080.211860:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1787829080.211864:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829080/real 1787829080]  req@ffff9ee0057061c0 x1874670273164160/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829105 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829080.211870:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829080.211883:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787829080.211907:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057061c0 x1874670273164160/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829105 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829080.211909:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707840 x1874670273164544/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829080.211963:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829080.211964:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829080.211977:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787829080.211978:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:3.0:1787829080.211983:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1787829080.211992:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273164160:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787829080.211995:0:27626:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4243
00000100:00080000:3.0:1787829080.212008:0:27626:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829080.212015:0:27626:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829080.212020:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787829080.212040:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273164288:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787829080.212041:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706940 x1874670273164672/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829080.212067:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829080.212072:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787829080.212075:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829080.212081:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4243
00000100:00080000:3.0:1787829080.212086:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000800:00000100:0.0:1787829080.212088:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787829080.212096:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829080.212105:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787829080.212117:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829080/real 1787829080]  req@ffff9ee005707c00 x1874670273164288/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829105 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829080.212125:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057052c0 x1874670273164800/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787829080.212145:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707c00 x1874670273164288/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829105 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829080.212194:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829080.212203:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00080000:3.0:1787829080.212205:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1787829080.212212:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273164288:192.168.203.121@tcp:38:kworker.0
00000100:00080000:3.0:1787829080.212223:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787829080.212231:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1787829080.212232:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273164416:192.168.203.121@tcp:8:kworker.0
00000100:00080000:3.0:1787829080.212254:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4243
00000100:00080000:3.0:1787829080.212265:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000800:00000100:0.0:1787829080.212270:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787829080.212278:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829080.212290:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787829080.212291:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829080/real 1787829080]  req@ffff9ee005705680 x1874670273164416/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829105 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829080.212312:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705680 x1874670273164416/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829105 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829080.212359:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829080.212365:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829080.212372:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707480 x1874670273164928/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787829080.212378:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273164416:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829080.212398:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273164544:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829080.212439:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829080.212456:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829080/real 1787829080]  req@ffff9ee005707840 x1874670273164544/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829105 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829080.212471:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707840 x1874670273164544/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829105 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829080.212480:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829080.212484:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829080.212487:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273164544:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829080.212505:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273164672:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787829080.212524:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829080.212547:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829080/real 1787829080]  req@ffff9ee005706940 x1874670273164672/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829105 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829080.212563:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706940 x1874670273164672/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829105 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829080.212573:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829080.212577:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829080.212580:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273164672:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787829080.212587:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273164800:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829080.212607:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829080.212618:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829080/real 1787829080]  req@ffff9ee0057052c0 x1874670273164800/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829105 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829080.212631:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057052c0 x1874670273164800/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829105 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829080.212640:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829080.212643:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829080.212646:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273164800:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829080.212652:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273164928:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829080.212669:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829080.212679:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829080/real 1787829080]  req@ffff9ee005707480 x1874670273164928/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829105 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829080.212691:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707480 x1874670273164928/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829105 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829080.212708:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829080.212712:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829080.212715:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273164928:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787829081.043439:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829081.235421:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787829082.067465:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829082.259403:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829083.091465:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829083.283384:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829084.115480:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829084.307400:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829085.139458:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829085.331398:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:2.0:1787829085.331419:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829085.331423:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787829085.331426:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829085.331433:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4249
00000100:00080000:2.0:1787829085.331441:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829085.331447:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787829085.331476:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057283c0 x1874670273165056/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829085.331498:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829085.331501:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787829085.331503:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829085.331505:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4249
00000100:00080000:2.0:1787829085.331508:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829085.331510:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829085.331518:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787829085.331527:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728000 x1874670273165184/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829085.331535:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829085.331538:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787829085.331540:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829085.331544:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4249
00000100:00100000:0.0:1787829085.331548:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273165056:192.168.203.121@tcp:250:kworker.0
00000100:00080000:2.0:1787829085.331548:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829085.331555:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829085.331560:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787829085.331566:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a580 x1874670273165312/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829085.331573:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829085.331575:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787829085.331577:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829085.331581:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4249
00000100:00080000:2.0:1787829085.331585:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829085.331589:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829085.331595:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787829085.331609:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728b40 x1874670273165440/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1787829085.331618:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:2.0:1787829085.331624:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829085.331630:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787829085.331632:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829085.331638:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4249
00000100:00080000:2.0:1787829085.331643:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1787829085.331654:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829085/real 1787829085]  req@ffff9ee0057283c0 x1874670273165056/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829110 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829085.331658:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787829085.331669:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057283c0 x1874670273165056/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829110 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:2.0:1787829085.331670:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00080000:0.0:1787829085.331683:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829085.331687:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829085.331692:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728f00 x1874670273165568/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787829085.331697:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273165056:192.168.203.121@tcp:250:kworker.0
00000100:00080000:2.0:1787829085.331724:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1787829085.331727:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273165184:192.168.203.121@tcp:38:kworker.0
00000100:00080000:2.0:1787829085.331730:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787829085.331736:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829085.331741:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4249
00000100:00080000:2.0:1787829085.331746:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829085.331751:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829085.331757:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:0.0:1787829085.331762:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829085.331776:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b840 x1874670273165696/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787829085.331777:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829085/real 1787829085]  req@ffff9ee005728000 x1874670273165184/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829110 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829085.331809:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728000 x1874670273165184/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829110 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829085.331809:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829085.331819:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787829085.331824:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829085.331832:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829085.331835:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829085.331840:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273165184:192.168.203.121@tcp:38:kworker.0
00000100:00080000:2.0:1787829085.331845:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4249
00000100:00080000:2.0:1787829085.331851:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829085.331856:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787829085.331863:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273165312:192.168.203.121@tcp:8:kworker.0
00000008:00100000:2.0:1787829085.331863:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787829085.331884:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729a40 x1874670273165824/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1787829085.331892:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829085.331912:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829085/real 1787829085]  req@ffff9ee00572a580 x1874670273165312/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829110 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829085.331929:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a580 x1874670273165312/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829110 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829085.331939:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829085.331943:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829085.331945:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273165312:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829085.331950:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273165440:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829085.331966:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829085.331974:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829085/real 1787829085]  req@ffff9ee005728b40 x1874670273165440/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829110 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829085.331982:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728b40 x1874670273165440/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829110 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829085.331987:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829085.331990:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829085.331992:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273165440:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829085.331996:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273165568:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787829085.332007:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829085.332012:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829085/real 1787829085]  req@ffff9ee005728f00 x1874670273165568/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829110 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829085.332019:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728f00 x1874670273165568/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829110 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829085.332024:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829085.332026:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829085.332028:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273165568:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787829085.332031:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273165696:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829085.332041:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829085.332047:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829085/real 1787829085]  req@ffff9ee00572b840 x1874670273165696/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829110 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829085.332054:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b840 x1874670273165696/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829110 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829085.332058:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829085.332060:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829085.332062:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273165696:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829085.332075:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273165824:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829085.332085:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829085.332091:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829085/real 1787829085]  req@ffff9ee005729a40 x1874670273165824/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829110 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829085.332098:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729a40 x1874670273165824/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829110 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829085.332103:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829085.332105:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829085.332107:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273165824:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787829086.163456:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829086.355383:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787829087.187437:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829087.379393:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829088.211446:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829088.403408:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829089.235521:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829089.427461:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829090.259475:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1787829090.451435:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1787829090.451436:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:0.0:1787829090.451446:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1787829090.451451:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829090.451461:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4254
00000100:00080000:0.0:1787829090.451474:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829090.451482:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787829090.451526:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ea940 x1874670273165952/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829090.451552:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829090.451556:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787829090.451557:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829090.451560:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4254
00000100:00080000:0.0:1787829090.451563:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829090.451567:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829090.451579:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787829090.451584:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273165952:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787829090.451591:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ead00 x1874670273166080/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829090.451601:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829090.451603:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787829090.451606:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829090.451609:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4254
00000100:00080000:0.0:1787829090.451611:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829090.451613:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829090.451616:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787829090.451627:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8780 x1874670273166208/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829090.451633:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829090.451636:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787829090.451638:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829090.451640:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4254
00000100:00080000:0.0:1787829090.451643:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829090.451645:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829090.451648:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787829090.451655:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9680 x1874670273166336/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829090.451661:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829090.451676:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000800:00000100:2.0:1787829090.451679:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:0.0:1787829090.451680:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829090.451687:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4254
00000100:00080000:0.0:1787829090.451692:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829090.451696:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829090.451700:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787829090.451711:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ea580 x1874670273166464/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829090.451718:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829090.451721:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787829090.451722:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829090.451726:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4254
00000100:00080000:0.0:1787829090.451729:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1787829090.451732:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829090/real 1787829090]  req@ffff9ee0056ea940 x1874670273165952/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829115 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829090.451736:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829090.451743:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787829090.451754:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9a40 x1874670273166592/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787829090.451757:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ea940 x1874670273165952/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829115 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829090.451781:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829090.451784:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829090.451785:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787829090.451789:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829090.451791:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:0.0:1787829090.451805:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4254
00000100:00080000:0.0:1787829090.451807:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829090.451815:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787829090.451816:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273165952:192.168.203.121@tcp:250:kworker.0
00000008:00100000:0.0:1787829090.451818:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787829090.451830:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb0c0 x1874670273166720/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787829090.451851:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273166080:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787829090.451891:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829090.451907:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829090/real 1787829090]  req@ffff9ee0056ead00 x1874670273166080/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829115 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829090.451918:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ead00 x1874670273166080/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829115 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829090.451935:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829090.451938:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829090.451940:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273166080:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787829090.451945:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273166208:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787829090.451962:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829090.451977:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829090/real 1787829090]  req@ffff9ee0056e8780 x1874670273166208/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829115 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829090.451986:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8780 x1874670273166208/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829115 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829090.451992:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829090.451994:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829090.451997:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273166208:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787829090.452000:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273166336:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787829090.452017:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829090.452023:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829090/real 1787829090]  req@ffff9ee0056e9680 x1874670273166336/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829115 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829090.452030:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9680 x1874670273166336/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829115 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829090.452036:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829090.452038:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829090.452040:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273166336:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787829090.452044:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273166464:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787829090.452054:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829090.452060:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829090/real 1787829090]  req@ffff9ee0056ea580 x1874670273166464/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829115 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829090.452067:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ea580 x1874670273166464/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829115 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829090.452072:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829090.452074:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829090.452076:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273166464:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787829090.452079:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273166592:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787829090.452090:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829090.452096:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829090/real 1787829090]  req@ffff9ee0056e9a40 x1874670273166592/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829115 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829090.452102:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9a40 x1874670273166592/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829115 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829090.452107:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829090.452109:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829090.452112:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273166592:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787829090.452116:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273166720:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787829090.452147:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829090.452154:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829090/real 1787829090]  req@ffff9ee0056eb0c0 x1874670273166720/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829115 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829090.452161:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb0c0 x1874670273166720/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829115 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829090.452167:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829090.452169:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829090.452171:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273166720:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787829091.283459:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829091.475487:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787829092.307534:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829092.499409:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829093.331517:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829093.523485:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829094.355548:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829094.547430:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829095.379515:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1787829095.571448:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1787829095.571451:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:0.0:1787829095.571459:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1787829095.571464:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829095.571474:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4259
00000100:00080000:0.0:1787829095.571488:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829095.571498:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787829095.571545:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8b40 x1874670273166848/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829095.571579:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829095.571584:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787829095.571587:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829095.571591:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4259
00000100:00080000:0.0:1787829095.571594:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829095.571598:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829095.571609:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787829095.571623:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e92c0 x1874670273166976/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787829095.571623:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273166848:192.168.203.121@tcp:250:kworker.0
00000100:00080000:0.0:1787829095.571650:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829095.571652:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787829095.571655:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829095.571658:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4259
00000100:00080000:0.0:1787829095.571662:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829095.571665:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829095.571671:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787829095.571682:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb840 x1874670273167104/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829095.571689:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829095.571692:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787829095.571693:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829095.571696:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4259
00000100:00080000:0.0:1787829095.571699:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829095.571701:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829095.571704:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:2.0:1787829095.571710:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829095.571715:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb480 x1874670273167232/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829095.571723:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829095.571726:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787829095.571728:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829095.571731:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4259
00000100:00080000:0.0:1787829095.571734:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829095.571737:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829095.571740:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787829095.571749:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9e00 x1874670273167360/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829095.571757:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1787829095.571759:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829095/real 1787829095]  req@ffff9ee0056e8b40 x1874670273166848/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829120 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829095.571763:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787829095.571767:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829095.571779:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4259
00000100:00080000:0.0:1787829095.571784:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1787829095.571784:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8b40 x1874670273166848/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829120 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829095.571795:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00080000:2.0:1787829095.571799:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000008:00100000:0.0:1787829095.571804:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:2.0:1787829095.571805:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829095.571813:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273166848:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787829095.571826:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8000 x1874670273167488/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787829095.571839:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273166976:192.168.203.121@tcp:38:kworker.0
00000100:00080000:0.0:1787829095.571847:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829095.571852:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787829095.571854:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829095.571859:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4259
00000800:00000100:2.0:1787829095.571864:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:0.0:1787829095.571867:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829095.571873:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829095.571878:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787829095.571878:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829095/real 1787829095]  req@ffff9ee0056e92c0 x1874670273166976/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829120 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829095.571895:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e83c0 x1874670273167616/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787829095.571901:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e92c0 x1874670273166976/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829120 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829095.571914:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829095.571920:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829095.571925:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273166976:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787829095.571933:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273167104:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787829095.571959:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829095.571973:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829095/real 1787829095]  req@ffff9ee0056eb840 x1874670273167104/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829120 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829095.571986:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb840 x1874670273167104/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829120 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829095.571996:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829095.572000:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829095.572004:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273167104:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787829095.572011:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273167232:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787829095.572032:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829095.572042:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829095/real 1787829095]  req@ffff9ee0056eb480 x1874670273167232/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829120 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829095.572051:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb480 x1874670273167232/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829120 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829095.572057:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829095.572059:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829095.572061:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273167232:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787829095.572065:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273167360:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787829095.572078:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829095.572084:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829095/real 1787829095]  req@ffff9ee0056e9e00 x1874670273167360/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829120 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829095.572092:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9e00 x1874670273167360/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829120 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829095.572097:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829095.572099:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829095.572100:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273167360:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787829095.572113:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273167488:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787829095.572124:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829095.572130:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829095/real 1787829095]  req@ffff9ee0056e8000 x1874670273167488/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829120 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829095.572143:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8000 x1874670273167488/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829120 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829095.572149:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829095.572150:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829095.572152:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273167488:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787829095.572155:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273167616:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787829095.572165:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829095.572171:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829095/real 1787829095]  req@ffff9ee0056e83c0 x1874670273167616/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829120 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829095.572178:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e83c0 x1874670273167616/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829120 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829095.572183:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829095.572185:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829095.572187:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273167616:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787829096.403503:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829096.595460:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787829097.427503:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829097.619415:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829098.451504:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829098.643407:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829099.475488:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829099.667433:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829100.499503:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829100.691381:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787829100.691409:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829100.691415:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787829100.691418:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829100.691425:0:27626:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4264
00000100:00080000:3.0:1787829100.691434:0:27626:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829100.691440:0:27626:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787829100.691469:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704000 x1874670273167744/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829100.691489:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829100.691492:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787829100.691493:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829100.691496:0:27626:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4264
00000100:00080000:3.0:1787829100.691499:0:27626:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829100.691502:0:27626:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829100.691509:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787829100.691519:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273167744:192.168.203.121@tcp:250:kworker.0
00000100:00100000:3.0:1787829100.691520:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057070c0 x1874670273167872/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829100.691536:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829100.691539:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787829100.691540:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829100.691543:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4264
00000100:00080000:3.0:1787829100.691546:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829100.691548:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829100.691553:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829100.691562:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704780 x1874670273168000/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829100.691569:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829100.691572:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787829100.691574:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829100.691578:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4264
00000800:00000100:2.0:1787829100.691583:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787829100.691583:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829100.691602:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829100.691609:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829100.691624:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705a40 x1874670273168128/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829100.691635:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1787829100.691637:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829100/real 1787829100]  req@ffff9ee005704000 x1874670273167744/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829125 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829100.691643:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787829100.691649:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829100.691657:0:27626:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4264
00000100:00100000:2.0:1787829100.691660:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704000 x1874670273167744/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829125 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829100.691662:0:27626:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829100.691671:0:27626:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00080000:2.0:1787829100.691675:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000008:00100000:3.0:1787829100.691677:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00080000:2.0:1787829100.691680:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829100.691685:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273167744:192.168.203.121@tcp:250:kworker.0
00000100:00100000:3.0:1787829100.691692:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704b40 x1874670273168256/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829100.691702:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1787829100.691705:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273167872:192.168.203.121@tcp:38:kworker.0
00000100:00080000:3.0:1787829100.691706:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787829100.691711:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829100.691715:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4264
00000100:00080000:3.0:1787829100.691717:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829100.691720:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829100.691724:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:2.0:1787829100.691730:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829100.691735:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706580 x1874670273168384/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829100.691742:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1787829100.691745:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829100/real 1787829100]  req@ffff9ee0057070c0 x1874670273167872/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829125 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829100.691746:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787829100.691749:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829100.691757:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4264
00000100:00080000:3.0:1787829100.691763:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1787829100.691766:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057070c0 x1874670273167872/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829125 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829100.691769:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829100.691775:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:2.0:1787829100.691778:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829100.691782:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829100.691786:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705e00 x1874670273168512/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787829100.691788:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273167872:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787829100.691796:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273168000:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787829100.691813:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829100.691822:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829100/real 1787829100]  req@ffff9ee005704780 x1874670273168000/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829125 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829100.691835:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704780 x1874670273168000/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829125 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829100.691840:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829100.691842:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829100.691844:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273168000:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787829100.691848:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273168128:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787829100.691858:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829100.691863:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829100/real 1787829100]  req@ffff9ee005705a40 x1874670273168128/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829125 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829100.691871:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705a40 x1874670273168128/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829125 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829100.691876:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829100.691877:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829100.691879:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273168128:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787829100.691888:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273168256:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787829100.691898:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829100.691903:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829100/real 1787829100]  req@ffff9ee005704b40 x1874670273168256/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829125 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829100.691910:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704b40 x1874670273168256/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829125 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829100.691919:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829100.691921:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829100.691923:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273168256:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787829100.691926:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273168384:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787829100.691936:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829100.691941:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829100/real 1787829100]  req@ffff9ee005706580 x1874670273168384/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829125 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829100.691956:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706580 x1874670273168384/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829125 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829100.691962:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829100.691964:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829100.691965:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273168384:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787829100.691969:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273168512:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787829100.691979:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829100.691985:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829100/real 1787829100]  req@ffff9ee005705e00 x1874670273168512/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829125 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829100.692000:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705e00 x1874670273168512/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829125 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829100.692008:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829100.692011:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829100.692015:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273168512:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787829101.523499:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829101.715406:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787829102.547558:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829102.739373:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829103.571544:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829103.763442:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829104.595495:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829104.787389:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829105.619516:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829105.811421:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:1.0:1787829105.811426:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829105.811437:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1787829105.811443:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829105.811454:0:27626:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4269
00000100:00080000:1.0:1787829105.811466:0:27626:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829105.811473:0:27626:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787829105.811511:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0780 x1874670273168640/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829105.811541:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829105.811545:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787829105.811548:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829105.811553:0:27626:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4269
00000100:00080000:1.0:1787829105.811572:0:27626:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829105.811578:0:27626:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787829105.811588:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273168640:192.168.203.121@tcp:250:kworker.0
00000008:00100000:1.0:1787829105.811590:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787829105.811617:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0000 x1874670273168768/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829105.811630:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829105.811634:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787829105.811638:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829105.811643:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4269
00000100:00080000:1.0:1787829105.811647:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829105.811652:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829105.811658:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787829105.811671:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a2580 x1874670273168896/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1787829105.811684:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:1.0:1787829105.811694:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829105.811698:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787829105.811702:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829105.811710:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4269
00000100:00080000:1.0:1787829105.811716:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829105.811722:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829105.811728:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787829105.811742:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0b40 x1874670273169024/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787829105.811747:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829105/real 1787829105]  req@ffff9ee0056a0780 x1874670273168640/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829130 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829105.811798:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829105.811803:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787829105.811806:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829105.811814:0:27626:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4269
00000100:00100000:2.0:1787829105.811814:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0780 x1874670273168640/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829130 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829105.811820:0:27626:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829105.811831:0:27626:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00080000:2.0:1787829105.811838:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000008:00100000:1.0:1787829105.811839:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00080000:2.0:1787829105.811847:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829105.811851:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273168640:192.168.203.121@tcp:250:kworker.0
00000100:00100000:1.0:1787829105.811858:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a30c0 x1874670273169152/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829105.811870:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829105.811875:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787829105.811877:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829105.811881:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4269
00000100:00080000:1.0:1787829105.811885:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1787829105.811891:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273168768:192.168.203.121@tcp:38:kworker.0
00000100:00080000:1.0:1787829105.811892:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829105.811906:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787829105.811921:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a3480 x1874670273169280/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829105.811935:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829105.811939:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000800:00000100:2.0:1787829105.811942:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:1.0:1787829105.811944:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829105.811954:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4269
00000100:00080000:1.0:1787829105.811960:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1787829105.811965:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829105/real 1787829105]  req@ffff9ee0056a0000 x1874670273168768/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829130 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829105.811970:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829105.811980:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787829105.811994:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0000 x1874670273168768/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829130 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829105.811999:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1e00 x1874670273169408/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829105.812018:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829105.812025:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829105.812030:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273168768:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787829105.812039:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273168896:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787829105.812064:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829105.812073:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829105/real 1787829105]  req@ffff9ee0056a2580 x1874670273168896/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829130 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829105.812082:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a2580 x1874670273168896/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829130 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829105.812088:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829105.812091:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829105.812093:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273168896:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787829105.812097:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273169024:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787829105.812111:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829105.812122:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829105/real 1787829105]  req@ffff9ee0056a0b40 x1874670273169024/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829130 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829105.812134:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0b40 x1874670273169024/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829130 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829105.812143:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829105.812147:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829105.812151:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273169024:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787829105.812158:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273169152:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787829105.812176:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829105.812184:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829105/real 1787829105]  req@ffff9ee0056a30c0 x1874670273169152/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829130 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829105.812201:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a30c0 x1874670273169152/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829130 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829105.812210:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829105.812213:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829105.812215:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273169152:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787829105.812234:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273169280:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787829105.812248:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829105.812255:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829105/real 1787829105]  req@ffff9ee0056a3480 x1874670273169280/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829130 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829105.812263:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a3480 x1874670273169280/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829130 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829105.812271:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829105.812275:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829105.812278:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273169280:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787829105.812285:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273169408:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787829105.812302:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829105.812311:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829105/real 1787829105]  req@ffff9ee0056a1e00 x1874670273169408/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829130 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829105.812346:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1e00 x1874670273169408/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829130 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829105.812352:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829105.812354:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829105.812356:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273169408:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787829106.643468:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829106.835411:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787829107.667518:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829107.859409:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829108.691448:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829108.883413:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829109.715486:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829109.907382:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829110.739471:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1787829110.931477:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829110.931490:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1787829110.931495:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829110.931505:0:27626:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4274
00000100:00100000:2.0:1787829110.931513:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:1.0:1787829110.931519:0:27626:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829110.931541:0:27626:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787829110.931583:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a03c0 x1874670273169536/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829110.931608:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829110.931611:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787829110.931613:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829110.931616:0:27626:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4274
00000100:00080000:1.0:1787829110.931620:0:27626:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829110.931624:0:27626:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829110.931635:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787829110.931642:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273169536:192.168.203.121@tcp:250:kworker.0
00000100:00100000:1.0:1787829110.931648:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a2940 x1874670273169664/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829110.931658:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829110.931661:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787829110.931663:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829110.931668:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4274
00000100:00080000:1.0:1787829110.931671:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829110.931674:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829110.931678:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787829110.931687:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a21c0 x1874670273169792/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829110.931694:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829110.931698:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787829110.931700:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829110.931703:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4274
00000100:00080000:1.0:1787829110.931707:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000800:00000100:2.0:1787829110.931715:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:1.0:1787829110.931717:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829110.931723:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787829110.931735:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1680 x1874670273169920/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829110.931744:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829110.931747:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787829110.931748:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829110.931751:0:27626:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4274
00000100:00080000:1.0:1787829110.931753:0:27626:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829110.931757:0:27626:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829110.931762:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787829110.931772:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829110/real 1787829110]  req@ffff9ee0056a03c0 x1874670273169536/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829135 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829110.931776:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0f00 x1874670273170048/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829110.931846:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1787829110.931850:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a03c0 x1874670273169536/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829135 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829110.931862:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787829110.931868:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829110.931878:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4274
00000100:00080000:2.0:1787829110.931881:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829110.931884:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829110.931888:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:1.0:1787829110.931893:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787829110.931894:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273169536:192.168.203.121@tcp:250:kworker.0
00000008:00100000:1.0:1787829110.931907:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787829110.931924:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a3c00 x1874670273170176/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787829110.931928:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273169664:192.168.203.121@tcp:38:kworker.0
00000100:00080000:1.0:1787829110.931949:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829110.931953:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787829110.931955:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829110.931960:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4274
00000100:00080000:1.0:1787829110.931964:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000800:00000100:2.0:1787829110.931971:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:1.0:1787829110.931972:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829110.931978:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787829110.931988:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829110/real 1787829110]  req@ffff9ee0056a2940 x1874670273169664/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829135 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829110.931992:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1a40 x1874670273170304/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787829110.932053:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a2940 x1874670273169664/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829135 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829110.932065:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829110.932069:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829110.932073:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273169664:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787829110.932082:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273169792:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787829110.932121:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829110.932139:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829110/real 1787829110]  req@ffff9ee0056a21c0 x1874670273169792/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829135 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829110.932152:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a21c0 x1874670273169792/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829135 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829110.932159:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829110.932162:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829110.932166:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273169792:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787829110.932171:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273169920:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787829110.932189:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829110.932212:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829110/real 1787829110]  req@ffff9ee0056a1680 x1874670273169920/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829135 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829110.932231:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1680 x1874670273169920/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829135 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829110.932253:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829110.932257:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829110.932265:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273169920:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787829110.932272:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273170048:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787829110.932297:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829110.932311:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829110/real 1787829110]  req@ffff9ee0056a0f00 x1874670273170048/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829135 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829110.932391:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0f00 x1874670273170048/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829135 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829110.932418:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829110.932423:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829110.932426:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273170048:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787829110.932457:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273170176:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787829110.932496:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829110.932510:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829110/real 1787829110]  req@ffff9ee0056a3c00 x1874670273170176/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829135 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829110.932518:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a3c00 x1874670273170176/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829135 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829110.932539:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829110.932542:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829110.932545:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273170176:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787829110.932552:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273170304:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787829110.932575:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829110.932586:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829110/real 1787829110]  req@ffff9ee0056a1a40 x1874670273170304/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829135 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829110.932603:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1a40 x1874670273170304/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829135 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829110.932609:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829110.932613:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829110.932616:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273170304:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787829111.763496:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829111.955427:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787829112.787485:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829112.979425:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829113.811499:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829114.003388:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829114.835554:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829115.027408:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829115.859454:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829116.051411:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787829116.051450:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829116.051456:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787829116.051459:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829116.051467:0:27626:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4279
00000100:00080000:3.0:1787829116.051476:0:27626:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829116.051482:0:27626:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787829116.051530:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057043c0 x1874670273170432/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829116.051559:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829116.051561:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787829116.051562:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829116.051565:0:27626:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4279
00000100:00080000:3.0:1787829116.051568:0:27626:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829116.051571:0:27626:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829116.051579:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787829116.051596:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706d00 x1874670273170560/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829116.051605:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829116.051609:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00100000:2.0:1787829116.051611:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273170432:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787829116.051611:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829116.051617:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4279
00000100:00080000:3.0:1787829116.051623:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829116.051625:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829116.051629:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829116.051638:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705e00 x1874670273170688/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829116.051644:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829116.051646:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787829116.051648:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829116.051650:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4279
00000100:00080000:3.0:1787829116.051653:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829116.051655:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829116.051658:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829116.051665:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706580 x1874670273170816/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829116.051671:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829116.051674:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787829116.051676:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829116.051678:0:27626:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4279
00000100:00080000:3.0:1787829116.051681:0:27626:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829116.051683:0:27626:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829116.051686:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787829116.051692:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704b40 x1874670273170944/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829116.051699:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829116.051701:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787829116.051702:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829116.051705:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4279
00000100:00080000:3.0:1787829116.051708:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829116.051711:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829116.051714:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829116.051722:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705a40 x1874670273171072/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829116.051732:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829116.051734:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787829116.051735:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1787829116.051740:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273170560:192.168.203.121@tcp:38:kworker.0
00000100:00080000:3.0:1787829116.051740:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4279
00000100:00080000:3.0:1787829116.051743:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829116.051748:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829116.051753:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829116.051766:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704780 x1874670273171200/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787829116.051780:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273170688:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787829116.051799:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273170816:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787829116.051814:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273170944:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787829116.051827:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273171072:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787829116.051841:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273171200:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787829116.883492:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829117.075391:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787829117.907486:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829118.099412:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829118.931534:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829119.123373:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000400:00000100:1.0:1787829119.123668:0:2355:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.203.121:988
00000400:00000100:1.0:1787829119.123724:0:2355:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.203.121@tcp at host 192.168.203.121 was unreachable: the network or that node may be down, or Lustre may be misconfigured.
00000800:00000100:1.0:1787829119.123746:0:2355:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:1.0:1787829119.123799:0:2355:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:1.0:1787829119.123812:0:2355:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:1.0:1787829119.123827:0:2355:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:1.0:1787829119.123844:0:2355:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000100:00100000:2.0:1787829119.123863:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829116/real 1787829119]  req@ffff9ee005706d00 x1874670273170560/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829141 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000800:00000100:1.0:1787829119.123873:0:2355:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:1.0:1787829119.123891:0:2355:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000100:00100000:2.0:1787829119.123928:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706d00 x1874670273170560/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829141 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829119.123941:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829119.123947:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829119.123951:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273170560:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787829119.123958:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829116/real 1787829119]  req@ffff9ee005705e00 x1874670273170688/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829141 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829119.123970:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705e00 x1874670273170688/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829141 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829119.123977:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829119.123981:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829119.123984:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273170688:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787829119.123990:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829116/real 1787829119]  req@ffff9ee005706580 x1874670273170816/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829141 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829119.124001:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706580 x1874670273170816/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829141 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829119.124008:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829119.124011:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829119.124014:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273170816:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787829119.124021:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829116/real 1787829119]  req@ffff9ee005704b40 x1874670273170944/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829141 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829119.124032:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704b40 x1874670273170944/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829141 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829119.124041:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829119.124044:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829119.124047:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273170944:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787829119.124053:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829116/real 1787829119]  req@ffff9ee005705a40 x1874670273171072/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829141 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829119.124065:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705a40 x1874670273171072/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829141 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829119.124072:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829119.124076:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829119.124079:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273171072:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787829119.124085:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829116/real 1787829119]  req@ffff9ee0057043c0 x1874670273170432/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829141 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829119.124097:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057043c0 x1874670273170432/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829141 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829119.124104:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829119.124107:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829119.124110:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273170432:192.168.203.121@tcp:250:kworker.0
00000100:00100000:2.0:1787829119.124144:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829116/real 1787829119]  req@ffff9ee005704780 x1874670273171200/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829141 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829119.124155:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704780 x1874670273171200/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829141 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829119.124162:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829119.124165:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829119.124168:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273171200:192.168.203.121@tcp:8:kworker.0
00010000:00010000:0.0:1787829119.955475:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829120.147397:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829120.979496:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829121.171397:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:0.0:1787829121.171403:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829121.171408:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1787829121.171412:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829121.171420:0:27626:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4284
00000100:00080000:0.0:1787829121.171429:0:27626:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829121.171434:0:27626:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787829121.171474:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ebc00 x1874670273171328/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829121.171493:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829121.171496:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787829121.171497:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829121.171500:0:27626:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4284
00000100:00080000:0.0:1787829121.171502:0:27626:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829121.171506:0:27626:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829121.171514:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787829121.171525:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273171328:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787829121.171529:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8f00 x1874670273171456/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829121.171544:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829121.171548:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787829121.171556:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829121.171561:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4284
00000100:00080000:0.0:1787829121.171566:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829121.171570:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829121.171576:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:2.0:1787829121.171589:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829121.171593:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e83c0 x1874670273171584/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829121.171604:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829121.171608:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787829121.171611:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829121.171615:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4284
00000100:00080000:0.0:1787829121.171619:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829121.171623:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829121.171629:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787829121.171633:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829121/real 1787829121]  req@ffff9ee0056ebc00 x1874670273171328/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829146 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829121.171644:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8000 x1874670273171712/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829121.171656:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1787829121.171658:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ebc00 x1874670273171328/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829146 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829121.171662:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787829121.171667:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829121.171676:0:27626:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4284
00000100:00080000:2.0:1787829121.171679:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829121.171681:0:27626:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829121.171690:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:0.0:1787829121.171691:0:27626:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829121.171698:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787829121.171704:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273171328:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787829121.171722:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9e00 x1874670273171840/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787829121.171733:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273171456:192.168.203.121@tcp:38:kworker.0
00000100:00080000:0.0:1787829121.171736:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829121.171743:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787829121.171745:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829121.171751:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4284
00000100:00080000:0.0:1787829121.171757:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829121.171762:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829121.171768:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:2.0:1787829121.171770:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829121.171786:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb480 x1874670273171968/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787829121.171792:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829121/real 1787829121]  req@ffff9ee0056e8f00 x1874670273171456/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829146 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829121.171804:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829121.171810:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787829121.171812:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1787829121.171815:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8f00 x1874670273171456/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829146 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829121.171820:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4284
00000100:00080000:0.0:1787829121.171827:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829121.171835:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00080000:2.0:1787829121.171836:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000008:00100000:0.0:1787829121.171844:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:2.0:1787829121.171845:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829121.171853:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273171456:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787829121.171862:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb840 x1874670273172096/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787829121.171864:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273171584:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787829121.171897:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829121.171912:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829121/real 1787829121]  req@ffff9ee0056e83c0 x1874670273171584/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829146 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829121.171924:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e83c0 x1874670273171584/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829146 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829121.171931:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829121.171934:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829121.171937:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273171584:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787829121.171943:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273171712:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787829121.171961:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829121.171971:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829121/real 1787829121]  req@ffff9ee0056e8000 x1874670273171712/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829146 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829121.171982:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8000 x1874670273171712/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829146 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829121.171989:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829121.171993:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829121.171995:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273171712:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787829121.172011:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273171840:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787829121.172033:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829121.172044:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829121/real 1787829121]  req@ffff9ee0056e9e00 x1874670273171840/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829146 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829121.172066:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9e00 x1874670273171840/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829146 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829121.172075:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829121.172078:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829121.172082:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273171840:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787829121.172088:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273171968:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787829121.172110:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829121.172124:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829121/real 1787829121]  req@ffff9ee0056eb480 x1874670273171968/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829146 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829121.172144:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb480 x1874670273171968/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829146 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829121.172153:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829121.172156:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829121.172159:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273171968:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787829121.172169:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273172096:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787829121.172193:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829121.172206:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829121/real 1787829121]  req@ffff9ee0056eb840 x1874670273172096/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829146 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829121.172219:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb840 x1874670273172096/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829146 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829121.172227:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829121.172231:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829121.172235:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273172096:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787829122.003504:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829122.195404:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787829123.027547:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829123.219400:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829124.051498:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829124.243384:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829125.075539:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829125.267471:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829126.099485:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829126.291391:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:0.0:1787829126.291411:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829126.291431:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1787829126.291437:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829126.291450:0:27626:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4290
00000100:00080000:0.0:1787829126.291465:0:27626:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829126.291474:0:27626:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787829126.291525:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e92c0 x1874670273172224/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829126.291562:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829126.291566:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787829126.291568:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829126.291573:0:27626:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4290
00000100:00080000:0.0:1787829126.291577:0:27626:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829126.291582:0:27626:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829126.291594:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787829126.291603:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273172224:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787829126.291611:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8b40 x1874670273172352/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829126.291625:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829126.291629:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787829126.291631:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829126.291636:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4290
00000100:00080000:0.0:1787829126.291641:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829126.291646:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829126.291653:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787829126.291666:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb0c0 x1874670273172480/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829126.291676:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829126.291680:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787829126.291685:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:2.0:1787829126.291686:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:0.0:1787829126.291693:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4290
00000100:00080000:0.0:1787829126.291699:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829126.291703:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829126.291709:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787829126.291723:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9a40 x1874670273172608/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829126.291733:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829126.291737:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787829126.291739:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829126.291746:0:27626:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4290
00000100:00100000:2.0:1787829126.291746:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829126/real 1787829126]  req@ffff9ee0056e92c0 x1874670273172224/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829151 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829126.291753:0:27626:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829126.291760:0:27626:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829126.291767:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787829126.291781:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ea580 x1874670273172736/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787829126.291791:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e92c0 x1874670273172224/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829151 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829126.291796:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829126.291805:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787829126.291808:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829126.291816:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4290
00000100:00080000:2.0:1787829126.291816:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829126.291825:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829126.291828:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:0.0:1787829126.291833:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787829126.291839:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273172224:192.168.203.121@tcp:250:kworker.0
00000008:00100000:0.0:1787829126.291842:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787829126.291858:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9680 x1874670273172864/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829126.291868:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829126.291873:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:2.0:1787829126.291875:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273172352:192.168.203.121@tcp:38:kworker.0
00000100:00080000:0.0:1787829126.291876:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829126.291885:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4290
00000100:00080000:0.0:1787829126.291890:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829126.291894:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829126.291900:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:2.0:1787829126.291914:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829126.291922:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8780 x1874670273172992/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787829126.291934:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829126/real 1787829126]  req@ffff9ee0056e8b40 x1874670273172352/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829151 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829126.291953:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8b40 x1874670273172352/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829151 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829126.291963:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829126.291967:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829126.291971:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273172352:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787829126.291979:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273172480:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787829126.292000:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829126.292011:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829126/real 1787829126]  req@ffff9ee0056eb0c0 x1874670273172480/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829151 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829126.292025:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb0c0 x1874670273172480/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829151 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829126.292031:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829126.292033:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829126.292035:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273172480:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787829126.292039:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273172608:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787829126.292054:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829126.292060:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829126/real 1787829126]  req@ffff9ee0056e9a40 x1874670273172608/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829151 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829126.292067:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9a40 x1874670273172608/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829151 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829126.292072:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829126.292074:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829126.292076:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273172608:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787829126.292079:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273172736:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787829126.292089:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829126.292095:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829126/real 1787829126]  req@ffff9ee0056ea580 x1874670273172736/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829151 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829126.292102:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ea580 x1874670273172736/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829151 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829126.292112:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829126.292114:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829126.292117:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273172736:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787829126.292120:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273172864:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787829126.292130:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829126.292135:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829126/real 1787829126]  req@ffff9ee0056e9680 x1874670273172864/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829151 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829126.292142:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9680 x1874670273172864/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829151 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829126.292148:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829126.292149:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829126.292151:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273172864:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787829126.292165:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273172992:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787829126.292174:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829126.292180:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829126/real 1787829126]  req@ffff9ee0056e8780 x1874670273172992/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829151 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829126.292186:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8780 x1874670273172992/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829151 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829126.292191:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829126.292193:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829126.292195:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273172992:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787829127.123493:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829127.315451:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787829128.147510:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829128.339441:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829129.171497:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829129.363408:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829130.195484:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829130.387423:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829131.219524:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829131.411433:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:2.0:1787829131.411442:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829131.411447:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787829131.411451:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829131.411459:0:27626:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4295
00000100:00080000:2.0:1787829131.411468:0:27626:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829131.411474:0:27626:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787829131.411505:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572ad00 x1874670273173120/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829131.411528:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829131.411531:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787829131.411532:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829131.411535:0:27626:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4295
00000100:00080000:2.0:1787829131.411537:0:27626:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829131.411540:0:27626:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829131.411549:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787829131.411558:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b480 x1874670273173248/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787829131.411563:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273173120:192.168.203.121@tcp:250:kworker.0
00000100:00080000:2.0:1787829131.411571:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829131.411575:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787829131.411576:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829131.411580:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4295
00000100:00080000:2.0:1787829131.411582:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829131.411584:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829131.411588:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787829131.411596:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b0c0 x1874670273173376/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829131.411602:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829131.411605:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787829131.411606:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829131.411609:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4295
00000100:00080000:2.0:1787829131.411611:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829131.411614:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829131.411616:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787829131.411624:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729a40 x1874670273173504/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829131.411629:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829131.411633:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000800:00000100:0.0:1787829131.411634:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:2.0:1787829131.411635:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829131.411641:0:27626:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4295
00000100:00080000:2.0:1787829131.411644:0:27626:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829131.411646:0:27626:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829131.411648:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787829131.411656:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b840 x1874670273173632/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829131.411663:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829131.411670:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787829131.411672:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1787829131.411677:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829131/real 1787829131]  req@ffff9ee00572ad00 x1874670273173120/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829156 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829131.411679:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4295
00000100:00080000:2.0:1787829131.411685:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829131.411693:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829131.411698:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787829131.411699:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572ad00 x1874670273173120/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829156 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829131.411708:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728f00 x1874670273173760/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829131.411710:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829131.411720:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:2.0:1787829131.411723:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1787829131.411727:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273173120:192.168.203.121@tcp:250:kworker.0
00000100:00080000:2.0:1787829131.411728:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787829131.411733:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829131.411737:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4295
00000100:00080000:2.0:1787829131.411740:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829131.411742:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829131.411745:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787829131.411751:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728b40 x1874670273173888/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787829131.411758:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273173248:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787829131.411778:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829131.411788:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829131/real 1787829131]  req@ffff9ee00572b480 x1874670273173248/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829156 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829131.411796:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b480 x1874670273173248/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829156 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829131.411802:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829131.411804:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829131.411806:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273173248:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787829131.411810:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273173376:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829131.411822:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829131.411828:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829131/real 1787829131]  req@ffff9ee00572b0c0 x1874670273173376/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829156 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829131.411844:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b0c0 x1874670273173376/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829156 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829131.411852:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829131.411855:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829131.411858:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273173376:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829131.411865:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273173504:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829131.411896:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829131.411906:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829131/real 1787829131]  req@ffff9ee005729a40 x1874670273173504/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829156 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829131.411914:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729a40 x1874670273173504/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829156 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829131.411920:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829131.411922:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829131.411924:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273173504:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829131.411928:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273173632:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787829131.411943:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829131.411951:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829131/real 1787829131]  req@ffff9ee00572b840 x1874670273173632/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829156 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829131.411963:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b840 x1874670273173632/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829156 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829131.411977:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829131.411981:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829131.411984:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273173632:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787829131.411991:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273173760:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829131.412010:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829131.412018:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829131/real 1787829131]  req@ffff9ee005728f00 x1874670273173760/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829156 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829131.412026:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728f00 x1874670273173760/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829156 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829131.412034:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829131.412037:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829131.412040:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273173760:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829131.412060:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273173888:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829131.412081:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829131.412090:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829131/real 1787829131]  req@ffff9ee005728b40 x1874670273173888/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829156 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829131.412111:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728b40 x1874670273173888/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829156 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829131.412119:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829131.412123:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829131.412126:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273173888:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787829132.243543:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829132.435445:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787829133.267480:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829133.459410:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829134.291496:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829134.483461:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829135.315516:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829135.507451:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829136.339475:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1787829136.531449:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1787829136.531449:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:0.0:1787829136.531458:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1787829136.531462:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829136.531470:0:27626:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4300
00000100:00080000:0.0:1787829136.531479:0:27626:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829136.531486:0:27626:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787829136.531525:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ead00 x1874670273174016/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829136.531547:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829136.531551:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787829136.531553:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829136.531558:0:27626:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4300
00000100:00080000:0.0:1787829136.531563:0:27626:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829136.531568:0:27626:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787829136.531576:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273174016:192.168.203.121@tcp:250:kworker.0
00000008:00100000:0.0:1787829136.531578:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787829136.531596:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ea940 x1874670273174144/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829136.531608:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829136.531611:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787829136.531613:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829136.531616:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4300
00000100:00080000:0.0:1787829136.531620:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829136.531622:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829136.531627:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787829136.531638:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8780 x1874670273174272/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1787829136.531645:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:0.0:1787829136.531650:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829136.531653:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787829136.531655:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829136.531658:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4300
00000100:00080000:0.0:1787829136.531661:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829136.531663:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829136.531667:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787829136.531673:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9680 x1874670273174400/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829136.531681:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829136.531684:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787829136.531686:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1787829136.531690:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829136/real 1787829136]  req@ffff9ee0056ead00 x1874670273174016/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829161 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829136.531691:0:27626:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4300
00000100:00080000:0.0:1787829136.531695:0:27626:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829136.531701:0:27626:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829136.531707:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787829136.531719:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ea580 x1874670273174528/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787829136.531721:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ead00 x1874670273174016/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829161 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829136.531745:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829136.531747:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829136.531751:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829136.531754:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273174016:192.168.203.121@tcp:250:kworker.0
00000100:00080000:0.0:1787829136.531766:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787829136.531770:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1787829136.531774:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273174144:192.168.203.121@tcp:38:kworker.0
00000100:00080000:0.0:1787829136.531779:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4300
00000100:00080000:0.0:1787829136.531792:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829136.531796:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829136.531801:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:2.0:1787829136.531813:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829136.531816:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9a40 x1874670273174656/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829136.531827:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1787829136.531829:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829136/real 1787829136]  req@ffff9ee0056ea940 x1874670273174144/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829161 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829136.531831:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787829136.531835:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829136.531845:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4300
00000100:00080000:0.0:1787829136.531851:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1787829136.531851:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ea940 x1874670273174144/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829161 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829136.531860:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00080000:2.0:1787829136.531863:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000008:00100000:0.0:1787829136.531868:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:2.0:1787829136.531868:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829136.531873:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273174144:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787829136.531880:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273174272:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829136.531886:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb0c0 x1874670273174784/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1787829136.531898:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829136.531910:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829136/real 1787829136]  req@ffff9ee0056e8780 x1874670273174272/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829161 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829136.531920:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8780 x1874670273174272/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829161 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829136.531935:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829136.531939:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829136.531942:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273174272:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787829136.531950:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273174400:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787829136.531971:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829136.531980:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829136/real 1787829136]  req@ffff9ee0056e9680 x1874670273174400/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829161 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829136.531989:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9680 x1874670273174400/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829161 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829136.531995:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829136.531997:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829136.531999:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273174400:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787829136.532003:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273174528:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787829136.532015:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829136.532021:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829136/real 1787829136]  req@ffff9ee0056ea580 x1874670273174528/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829161 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829136.532029:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ea580 x1874670273174528/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829161 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829136.532034:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829136.532036:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829136.532038:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273174528:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787829136.532050:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273174656:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787829136.532061:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829136.532066:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829136/real 1787829136]  req@ffff9ee0056e9a40 x1874670273174656/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829161 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829136.532073:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9a40 x1874670273174656/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829161 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829136.532078:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829136.532080:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829136.532082:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273174656:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787829136.532085:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273174784:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787829136.532095:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829136.532101:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829136/real 1787829136]  req@ffff9ee0056eb0c0 x1874670273174784/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829161 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829136.532108:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb0c0 x1874670273174784/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829161 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829136.532113:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829136.532114:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829136.532116:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273174784:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787829137.363514:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829137.555443:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787829138.387533:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829138.579431:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829139.411493:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829139.603475:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829140.435522:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829140.627457:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829141.459533:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829141.651433:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:0.0:1787829141.651437:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829141.651445:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1787829141.651451:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829141.651462:0:27626:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4305
00000100:00080000:0.0:1787829141.651476:0:27626:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829141.651487:0:27626:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787829141.651537:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8b40 x1874670273174912/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829141.651571:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829141.651574:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787829141.651576:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829141.651579:0:27626:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4305
00000100:00080000:0.0:1787829141.651583:0:27626:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829141.651586:0:27626:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829141.651597:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787829141.651608:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e92c0 x1874670273175040/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787829141.651612:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273174912:192.168.203.121@tcp:250:kworker.0
00000100:00080000:0.0:1787829141.651635:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829141.651639:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787829141.651641:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829141.651647:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4305
00000100:00080000:0.0:1787829141.651651:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829141.651656:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829141.651670:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787829141.651681:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb840 x1874670273175168/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829141.651703:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829141.651706:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787829141.651707:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829141.651710:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4305
00000100:00080000:0.0:1787829141.651714:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000800:00000100:2.0:1787829141.651718:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:0.0:1787829141.651722:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829141.651726:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787829141.651735:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb480 x1874670273175296/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829141.651741:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829141.651744:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787829141.651762:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829141.651766:0:27626:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4305
00000100:00080000:0.0:1787829141.651769:0:27626:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829141.651772:0:27626:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829141.651776:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787829141.651780:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829141/real 1787829141]  req@ffff9ee0056e8b40 x1874670273174912/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829166 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829141.651788:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9e00 x1874670273175424/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829141.651799:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829141.651803:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00100000:2.0:1787829141.651804:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8b40 x1874670273174912/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829166 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829141.651805:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829141.651813:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4305
00000100:00080000:0.0:1787829141.651819:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829141.651823:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00080000:2.0:1787829141.651824:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000008:00100000:0.0:1787829141.651826:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:2.0:1787829141.651830:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829141.651835:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273174912:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787829141.651839:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8000 x1874670273175552/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829141.651847:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829141.651849:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787829141.651851:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829141.651855:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4305
00000100:00080000:0.0:1787829141.651859:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1787829141.651860:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273175040:192.168.203.121@tcp:38:kworker.0
00000100:00080000:0.0:1787829141.651869:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829141.651876:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:2.0:1787829141.651886:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829141.651893:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e83c0 x1874670273175680/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787829141.651899:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829141/real 1787829141]  req@ffff9ee0056e92c0 x1874670273175040/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829166 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829141.651918:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e92c0 x1874670273175040/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829166 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829141.651927:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829141.651930:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829141.651933:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273175040:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787829141.651938:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273175168:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787829141.651956:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829141.651973:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829141/real 1787829141]  req@ffff9ee0056eb840 x1874670273175168/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829166 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829141.651983:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb840 x1874670273175168/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829166 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829141.651990:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829141.651993:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829141.651997:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273175168:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787829141.652004:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273175296:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787829141.652017:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829141.652031:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829141/real 1787829141]  req@ffff9ee0056eb480 x1874670273175296/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829166 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829141.652039:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb480 x1874670273175296/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829166 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829141.652045:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829141.652047:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829141.652049:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273175296:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787829141.652053:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273175424:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787829141.652064:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829141.652070:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829141/real 1787829141]  req@ffff9ee0056e9e00 x1874670273175424/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829166 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829141.652082:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9e00 x1874670273175424/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829166 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829141.652087:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829141.652089:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829141.652091:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273175424:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787829141.652094:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273175552:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787829141.652112:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829141.652123:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829141/real 1787829141]  req@ffff9ee0056e8000 x1874670273175552/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829166 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829141.652136:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8000 x1874670273175552/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829166 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829141.652145:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829141.652148:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829141.652152:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273175552:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787829141.652172:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273175680:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787829141.652194:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829141.652207:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829141/real 1787829141]  req@ffff9ee0056e83c0 x1874670273175680/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829166 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829141.652219:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e83c0 x1874670273175680/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829166 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829141.652230:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829141.652232:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829141.652234:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273175680:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787829142.483544:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829142.675409:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787829143.507486:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829143.699383:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829144.531516:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829144.723380:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829145.555482:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829145.747391:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829146.579510:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829146.771428:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:2.0:1787829146.771487:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829146.771493:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787829146.771497:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829146.771508:0:27626:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4310
00000100:00080000:2.0:1787829146.771521:0:27626:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829146.771542:0:27626:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787829146.771592:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a580 x1874670273175808/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829146.771623:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829146.771627:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787829146.771631:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829146.771637:0:27626:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4310
00000100:00080000:2.0:1787829146.771643:0:27626:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829146.771648:0:27626:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829146.771662:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787829146.771689:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728000 x1874670273175936/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829146.771701:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829146.771705:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787829146.771707:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829146.771712:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4310
00000100:00080000:2.0:1787829146.771716:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829146.771722:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829146.771729:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787829146.771749:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057283c0 x1874670273176064/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829146.771762:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829146.771767:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787829146.771769:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829146.771774:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4310
00000100:00080000:2.0:1787829146.771779:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829146.771785:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829146.771790:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787829146.771807:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a1c0 x1874670273176192/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829146.771829:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1787829146.771831:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273175808:192.168.203.121@tcp:250:kworker.0
00000100:00080000:2.0:1787829146.771832:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787829146.771836:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829146.771842:0:27626:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4310
00000100:00080000:2.0:1787829146.771845:0:27626:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829146.771848:0:27626:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829146.771852:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787829146.771864:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729e00 x1874670273176320/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829146.771871:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829146.771874:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787829146.771875:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829146.771877:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4310
00000100:00080000:2.0:1787829146.771880:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829146.771882:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829146.771885:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787829146.771893:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a940 x1874670273176448/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829146.771902:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829146.771907:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000800:00000100:0.0:1787829146.771909:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:2.0:1787829146.771909:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829146.771916:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4310
00000100:00080000:2.0:1787829146.771919:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829146.771923:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829146.771927:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787829146.771937:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728780 x1874670273176576/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787829146.771967:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829146/real 1787829146]  req@ffff9ee00572a580 x1874670273175808/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829171 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829146.771984:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a580 x1874670273175808/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829171 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829146.771993:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829146.771997:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829146.772000:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273175808:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787829146.772006:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273175936:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787829146.772026:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829146.772035:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829146/real 1787829146]  req@ffff9ee005728000 x1874670273175936/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829171 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829146.772045:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728000 x1874670273175936/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829171 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829146.772051:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829146.772053:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829146.772056:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273175936:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787829146.772060:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273176064:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829146.772082:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829146.772097:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829146/real 1787829146]  req@ffff9ee0057283c0 x1874670273176064/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829171 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829146.772112:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057283c0 x1874670273176064/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829171 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829146.772121:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829146.772124:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829146.772127:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273176064:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829146.772156:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273176192:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829146.772176:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829146.772196:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829146/real 1787829146]  req@ffff9ee00572a1c0 x1874670273176192/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829171 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829146.772210:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a1c0 x1874670273176192/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829171 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829146.772216:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829146.772219:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829146.772221:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273176192:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829146.772225:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273176320:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787829146.772236:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829146.772243:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829146/real 1787829146]  req@ffff9ee005729e00 x1874670273176320/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829171 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829146.772250:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729e00 x1874670273176320/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829171 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829146.772255:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829146.772257:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829146.772259:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273176320:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787829146.772262:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273176448:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829146.772285:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829146.772293:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829146/real 1787829146]  req@ffff9ee00572a940 x1874670273176448/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829171 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829146.772325:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a940 x1874670273176448/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829171 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829146.772378:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829146.772384:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829146.772388:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273176448:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829146.772396:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273176576:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829146.772419:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829146.772433:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829146/real 1787829146]  req@ffff9ee005728780 x1874670273176576/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829171 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829146.772453:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728780 x1874670273176576/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829171 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829146.772460:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829146.772464:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829146.772466:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273176576:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787829147.603490:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829147.795461:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787829148.627481:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829148.819441:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829149.651531:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829149.843420:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829150.675472:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829150.867433:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829151.699558:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1787829151.891408:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829151.891422:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00100000:2.0:1787829151.891423:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:1.0:1787829151.891427:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829151.891441:0:27626:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4315
00000100:00080000:1.0:1787829151.891455:0:27626:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829151.891464:0:27626:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787829151.891508:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a12c0 x1874670273176704/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829151.891537:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829151.891541:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787829151.891544:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829151.891548:0:27626:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4315
00000100:00080000:1.0:1787829151.891552:0:27626:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829151.891556:0:27626:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829151.891568:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787829151.891582:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1a40 x1874670273176832/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829151.891593:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829151.891596:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787829151.891600:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829151.891606:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4315
00000100:00080000:1.0:1787829151.891610:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829151.891614:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829151.891620:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787829151.891625:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273176704:192.168.203.121@tcp:250:kworker.0
00000100:00100000:1.0:1787829151.891636:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a3c00 x1874670273176960/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829151.891651:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829151.891655:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787829151.891657:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829151.891662:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4315
00000100:00080000:1.0:1787829151.891666:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829151.891671:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829151.891677:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787829151.891689:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0f00 x1874670273177088/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1787829151.891698:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:1.0:1787829151.891704:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829151.891709:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787829151.891712:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829151.891720:0:27626:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4315
00000100:00080000:1.0:1787829151.891725:0:27626:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829151.891731:0:27626:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829151.891739:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787829151.891743:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829151/real 1787829151]  req@ffff9ee0056a12c0 x1874670273176704/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829176 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829151.891758:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1680 x1874670273177216/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787829151.891762:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a12c0 x1874670273176704/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829176 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829151.891823:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829151.891824:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829151.891832:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787829151.891836:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:1.0:1787829151.891838:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1787829151.891848:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273176704:192.168.203.121@tcp:250:kworker.0
00000100:00080000:1.0:1787829151.891849:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4315
00000100:00100000:0.0:1787829151.891865:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273176832:192.168.203.121@tcp:38:kworker.0
00000100:00080000:1.0:1787829151.891869:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829151.891878:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829151.891885:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787829151.891901:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a21c0 x1874670273177344/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1787829151.891902:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829151.891918:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829151/real 1787829151]  req@ffff9ee0056a1a40 x1874670273176832/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829176 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829151.891919:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829151.891933:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787829151.891941:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1787829151.891947:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1a40 x1874670273176832/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829176 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829151.891949:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4315
00000100:00080000:1.0:1787829151.891959:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829151.891964:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829151.891970:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00080000:0.0:1787829151.891973:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000008:00100000:1.0:1787829151.891981:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787829151.891982:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273176832:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787829151.892003:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a2940 x1874670273177472/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787829151.892025:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273176960:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829151.892052:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829151.892061:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829151/real 1787829151]  req@ffff9ee0056a3c00 x1874670273176960/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829176 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829151.892070:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a3c00 x1874670273176960/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829176 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829151.892076:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829151.892078:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829151.892081:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273176960:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829151.892086:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273177088:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829151.892097:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829151.892103:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829151/real 1787829151]  req@ffff9ee0056a0f00 x1874670273177088/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829176 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829151.892111:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0f00 x1874670273177088/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829176 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829151.892116:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829151.892118:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829151.892120:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273177088:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829151.892124:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273177216:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787829151.892146:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829151.892152:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829151/real 1787829151]  req@ffff9ee0056a1680 x1874670273177216/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829176 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829151.892160:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1680 x1874670273177216/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829176 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829151.892165:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829151.892167:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829151.892169:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273177216:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787829151.892173:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273177344:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829151.892183:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829151.892189:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829151/real 1787829151]  req@ffff9ee0056a21c0 x1874670273177344/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829176 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829151.892196:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a21c0 x1874670273177344/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829176 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829151.892201:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829151.892203:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829151.892205:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273177344:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829151.892209:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273177472:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829151.892219:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829151.892224:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829151/real 1787829151]  req@ffff9ee0056a2940 x1874670273177472/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829176 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829151.892231:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a2940 x1874670273177472/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829176 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829151.892251:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829151.892254:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829151.892256:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273177472:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787829152.723507:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829152.915394:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787829153.747527:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829153.939453:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829154.771483:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829154.963447:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829155.795535:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829155.987446:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829156.819510:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1787829157.011453:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1787829157.011454:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:1.0:1787829157.011497:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1787829157.011502:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829157.011515:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4320
00000100:00080000:1.0:1787829157.011527:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829157.011534:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787829157.011578:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a03c0 x1874670273177600/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829157.011601:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829157.011604:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787829157.011606:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829157.011609:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4320
00000100:00080000:1.0:1787829157.011612:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829157.011615:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829157.011623:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787829157.011631:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1e00 x1874670273177728/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829157.011640:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829157.011643:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787829157.011645:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829157.011648:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4320
00000100:00080000:1.0:1787829157.011650:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829157.011653:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829157.011657:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787829157.011665:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a3480 x1874670273177856/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787829157.011672:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273177600:192.168.203.121@tcp:250:kworker.0
00000100:00080000:1.0:1787829157.011679:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829157.011682:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787829157.011684:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829157.011687:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4320
00000100:00080000:1.0:1787829157.011690:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829157.011692:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829157.011697:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787829157.011705:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a30c0 x1874670273177984/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829157.011712:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829157.011715:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787829157.011717:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829157.011720:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4320
00000100:00080000:1.0:1787829157.011738:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829157.011744:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000800:00000100:0.0:1787829157.011750:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000008:00100000:1.0:1787829157.011770:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787829157.011788:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0b40 x1874670273178112/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829157.011800:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829157.011805:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00100000:0.0:1787829157.011806:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829157/real 1787829157]  req@ffff9ee0056a03c0 x1874670273177600/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829182 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829157.011807:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829157.011816:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4320
00000100:00080000:1.0:1787829157.011823:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829157.011828:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787829157.011832:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a03c0 x1874670273177600/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829182 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:1.0:1787829157.011833:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:0.0:1787829157.011846:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:1.0:1787829157.011848:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a2580 x1874670273178240/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829157.011854:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829157.011861:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273177600:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787829157.011872:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273177728:192.168.203.121@tcp:38:kworker.0
00000100:00080000:1.0:1787829157.011872:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829157.011899:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787829157.011903:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829157.011909:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4320
00000100:00080000:1.0:1787829157.011916:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000800:00000100:0.0:1787829157.011920:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829157.011932:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829157/real 1787829157]  req@ffff9ee0056a1e00 x1874670273177728/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829182 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829157.011937:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829157.011950:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787829157.011953:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1e00 x1874670273177728/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829182 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829157.011963:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829157.011966:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829157.011974:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273177728:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787829157.011975:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0000 x1874670273178368/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787829157.012002:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273177856:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829157.012022:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829157.012030:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829157/real 1787829157]  req@ffff9ee0056a3480 x1874670273177856/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829182 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829157.012039:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a3480 x1874670273177856/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829182 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829157.012045:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829157.012048:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829157.012068:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273177856:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829157.012074:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273177984:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829157.012090:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829157.012098:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829157/real 1787829157]  req@ffff9ee0056a30c0 x1874670273177984/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829182 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829157.012109:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a30c0 x1874670273177984/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829182 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829157.012116:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829157.012118:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829157.012121:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273177984:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829157.012126:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273178112:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787829157.012139:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829157.012147:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829157/real 1787829157]  req@ffff9ee0056a0b40 x1874670273178112/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829182 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829157.012157:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0b40 x1874670273178112/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829182 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829157.012164:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829157.012167:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829157.012170:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273178112:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787829157.012175:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273178240:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829157.012188:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829157.012235:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829157/real 1787829157]  req@ffff9ee0056a2580 x1874670273178240/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829182 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829157.012247:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a2580 x1874670273178240/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829182 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829157.012254:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829157.012272:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829157.012274:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273178240:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829157.012278:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273178368:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829157.012292:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829157.012298:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829157/real 1787829157]  req@ffff9ee0056a0000 x1874670273178368/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829182 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829157.012305:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0000 x1874670273178368/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829182 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829157.012310:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829157.012312:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829157.012314:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273178368:192.168.203.121@tcp:8:kworker.0
00010000:00010000:3.0:1787829157.843521:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829158.035470:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787829158.867480:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829159.059410:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829159.891471:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829160.083408:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829160.915505:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829161.107482:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829161.939514:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829162.131478:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787829162.131496:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829162.131505:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787829162.131509:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829162.131519:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4325
00000100:00080000:3.0:1787829162.131531:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829162.131540:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787829162.131580:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057070c0 x1874670273178496/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829162.131607:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829162.131612:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787829162.131614:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829162.131617:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4325
00000100:00080000:3.0:1787829162.131621:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829162.131624:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829162.131633:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787829162.131645:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704000 x1874670273178624/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829162.131657:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829162.131664:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00100000:0.0:1787829162.131665:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273178496:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787829162.131667:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829162.131677:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4325
00000100:00080000:3.0:1787829162.131681:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829162.131684:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829162.131689:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829162.131706:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707480 x1874670273178752/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829162.131720:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829162.131725:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787829162.131728:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829162.131734:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4325
00000100:00080000:3.0:1787829162.131740:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000800:00000100:0.0:1787829162.131741:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787829162.131753:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829162.131763:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829162.131783:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057052c0 x1874670273178880/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787829162.131794:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829162/real 1787829162]  req@ffff9ee0057070c0 x1874670273178496/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829187 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829162.131805:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829162.131814:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787829162.131818:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1787829162.131820:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057070c0 x1874670273178496/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829187 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829162.131830:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4325
00000100:00080000:0.0:1787829162.131838:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829162.131841:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829162.131865:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:3.0:1787829162.131870:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829162.131880:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787829162.131882:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273178496:192.168.203.121@tcp:250:kworker.0
00000100:00100000:3.0:1787829162.131901:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706940 x1874670273179008/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829162.131921:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1787829162.131926:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273178624:192.168.203.121@tcp:38:kworker.0
00000100:00080000:3.0:1787829162.131929:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787829162.131936:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829162.131947:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4325
00000100:00080000:3.0:1787829162.131970:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829162.131979:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829162.131991:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:0.0:1787829162.132001:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829162.132018:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707840 x1874670273179136/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829162.132035:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1787829162.132037:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829162/real 1787829162]  req@ffff9ee005704000 x1874670273178624/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829187 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829162.132042:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787829162.132048:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829162.132060:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4325
00000100:00080000:3.0:1787829162.132072:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829162.132082:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829162.132091:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787829162.132101:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704000 x1874670273178624/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829187 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829162.132109:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705680 x1874670273179264/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829162.132141:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829162.132150:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829162.132157:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273178624:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787829162.132197:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273178752:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829162.132246:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829162.132259:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829162/real 1787829162]  req@ffff9ee005707480 x1874670273178752/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829187 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829162.132271:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707480 x1874670273178752/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829187 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829162.132298:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829162.132302:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829162.132307:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273178752:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829162.132316:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273178880:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829162.132338:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829162.132388:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829162/real 1787829162]  req@ffff9ee0057052c0 x1874670273178880/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829187 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829162.132420:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057052c0 x1874670273178880/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829187 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829162.132428:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829162.132432:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829162.132435:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273178880:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829162.132452:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273179008:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787829162.132473:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829162.132483:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829162/real 1787829162]  req@ffff9ee005706940 x1874670273179008/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829187 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829162.132494:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706940 x1874670273179008/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829187 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829162.132501:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829162.132505:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829162.132508:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273179008:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787829162.132514:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273179136:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829162.132527:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829162.132535:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829162/real 1787829162]  req@ffff9ee005707840 x1874670273179136/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829187 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829162.132546:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707840 x1874670273179136/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829187 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829162.132553:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829162.132556:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829162.132558:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273179136:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829162.132563:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273179264:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829162.132577:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829162.132585:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829162/real 1787829162]  req@ffff9ee005705680 x1874670273179264/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829187 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829162.132594:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705680 x1874670273179264/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829187 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829162.132601:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829162.132604:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829162.132607:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273179264:192.168.203.121@tcp:8:kworker.0
00010000:00010000:3.0:1787829162.963490:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829163.155439:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787829163.987498:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829164.179435:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829165.011474:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829165.203395:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829166.035514:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829166.227465:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829167.059698:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1787829167.251443:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1787829167.251453:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787829167.251465:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787829167.251474:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829167.251492:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4330
00000100:00080000:3.0:1787829167.251511:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829167.251523:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787829167.251582:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707c00 x1874670273179392/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829167.251629:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829167.251636:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787829167.251639:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829167.251645:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4330
00000100:00080000:3.0:1787829167.251651:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829167.251658:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829167.251673:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787829167.251697:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057061c0 x1874670273179520/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829167.251715:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829167.251721:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787829167.251729:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1787829167.251730:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273179392:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787829167.251740:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4330
00000100:00080000:3.0:1787829167.251748:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829167.251759:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829167.251768:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829167.251790:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705680 x1874670273179648/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829167.251806:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829167.251811:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787829167.251814:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829167.251820:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4330
00000100:00080000:3.0:1787829167.251827:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829167.251833:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829167.251841:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:0.0:1787829167.251843:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829167.251868:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707840 x1874670273179776/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829167.251884:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829167.251890:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787829167.251893:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1787829167.251905:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829167/real 1787829167]  req@ffff9ee005707c00 x1874670273179392/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829192 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829167.251906:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4330
00000100:00080000:3.0:1787829167.251918:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829167.251932:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787829167.251941:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707c00 x1874670273179392/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829192 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:3.0:1787829167.251943:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00080000:0.0:1787829167.251965:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829167.251973:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829167.251975:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706940 x1874670273179904/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787829167.251980:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273179392:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787829167.252003:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829167.252009:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787829167.252013:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829167.252023:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4330
00000100:00080000:3.0:1787829167.252029:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1787829167.252030:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273179520:192.168.203.121@tcp:38:kworker.0
00000100:00080000:3.0:1787829167.252040:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829167.252054:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829167.252076:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057052c0 x1874670273180032/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1787829167.252078:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829167.252098:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829167/real 1787829167]  req@ffff9ee0057061c0 x1874670273179520/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829192 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829167.252101:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829167.252117:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787829167.252125:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1787829167.252152:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057061c0 x1874670273179520/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829192 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829167.252160:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4330
00000100:00080000:3.0:1787829167.252175:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829167.252180:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829167.252188:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00080000:0.0:1787829167.252193:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829167.252202:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273179520:192.168.203.121@tcp:38:kworker.0
00000008:00100000:3.0:1787829167.252204:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787829167.252212:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273179648:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829167.252237:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707480 x1874670273180160/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1787829167.252252:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829167.252275:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829167/real 1787829167]  req@ffff9ee005705680 x1874670273179648/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829192 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829167.252291:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705680 x1874670273179648/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829192 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829167.252300:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829167.252304:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829167.252307:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273179648:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829167.252314:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273179776:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829167.252395:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829167.252415:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829167/real 1787829167]  req@ffff9ee005707840 x1874670273179776/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829192 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829167.252434:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707840 x1874670273179776/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829192 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829167.252443:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829167.252447:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829167.252451:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273179776:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829167.252457:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273179904:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787829167.252481:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829167.252491:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829167/real 1787829167]  req@ffff9ee005706940 x1874670273179904/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829192 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829167.252503:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706940 x1874670273179904/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829192 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829167.252511:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829167.252513:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829167.252516:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273179904:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787829167.252536:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273180032:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829167.252553:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829167.252563:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829167/real 1787829167]  req@ffff9ee0057052c0 x1874670273180032/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829192 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829167.252575:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057052c0 x1874670273180032/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829192 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829167.252582:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829167.252585:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829167.252588:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273180032:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829167.252594:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273180160:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829167.252610:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829167.252619:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829167/real 1787829167]  req@ffff9ee005707480 x1874670273180160/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829192 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829167.252630:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707480 x1874670273180160/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829192 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829167.252637:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829167.252640:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829167.252643:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273180160:192.168.203.121@tcp:8:kworker.0
00010000:00010000:3.0:1787829168.083551:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829168.275465:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787829169.107440:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829169.299433:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829170.131525:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829170.323429:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829171.155513:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829171.347402:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829172.179476:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1787829172.371372:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829172.371380:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787829172.371384:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1787829172.371386:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787829172.371394:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4336
00000100:00080000:3.0:1787829172.371403:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829172.371410:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787829172.371440:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704000 x1874670273180288/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829172.371462:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829172.371465:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787829172.371466:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829172.371469:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4336
00000100:00080000:3.0:1787829172.371471:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829172.371473:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829172.371481:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787829172.371489:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057070c0 x1874670273180416/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829172.371498:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1787829172.371501:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273180288:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787829172.371501:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787829172.371504:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829172.371510:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4336
00000100:00080000:3.0:1787829172.371513:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829172.371516:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829172.371519:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829172.371528:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704780 x1874670273180544/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829172.371534:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829172.371536:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787829172.371538:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829172.371540:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4336
00000100:00080000:3.0:1787829172.371543:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829172.371545:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829172.371547:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829172.371553:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057043c0 x1874670273180672/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829172.371559:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829172.371561:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787829172.371564:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:0.0:1787829172.371565:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787829172.371571:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4336
00000100:00080000:3.0:1787829172.371574:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829172.371588:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829172.371591:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787829172.371599:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705a40 x1874670273180800/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829172.371610:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1787829172.371614:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829172/real 1787829172]  req@ffff9ee005704000 x1874670273180288/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829197 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829172.371615:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787829172.371618:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829172.371626:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4336
00000100:00080000:3.0:1787829172.371631:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829172.371635:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829172.371639:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787829172.371643:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704000 x1874670273180288/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829197 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829172.371658:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704b40 x1874670273180928/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829172.371673:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829172.371674:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829172.371677:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787829172.371681:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829172.371685:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:3.0:1787829172.371686:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4336
00000100:00080000:3.0:1787829172.371690:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829172.371696:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787829172.371697:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273180288:192.168.203.121@tcp:250:kworker.0
00000008:00100000:3.0:1787829172.371699:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829172.371720:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706580 x1874670273181056/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787829172.371740:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273180416:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787829172.371764:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829172.371785:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829172/real 1787829172]  req@ffff9ee0057070c0 x1874670273180416/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829197 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829172.371793:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057070c0 x1874670273180416/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829197 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829172.371799:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829172.371802:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829172.371804:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273180416:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787829172.371808:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273180544:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829172.371820:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829172.371826:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829172/real 1787829172]  req@ffff9ee005704780 x1874670273180544/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829197 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829172.371833:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704780 x1874670273180544/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829197 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829172.371838:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829172.371839:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829172.371841:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273180544:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829172.371845:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273180672:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829172.371854:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829172.371859:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829172/real 1787829172]  req@ffff9ee0057043c0 x1874670273180672/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829197 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829172.371866:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057043c0 x1874670273180672/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829197 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829172.371871:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829172.371872:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829172.371874:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273180672:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829172.371877:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273180800:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787829172.371886:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829172.371892:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829172/real 1787829172]  req@ffff9ee005705a40 x1874670273180800/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829197 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829172.371898:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705a40 x1874670273180800/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829197 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829172.371903:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829172.371904:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829172.371906:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273180800:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787829172.371909:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273180928:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829172.371918:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829172.371924:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829172/real 1787829172]  req@ffff9ee005704b40 x1874670273180928/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829197 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829172.371931:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704b40 x1874670273180928/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829197 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829172.371947:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829172.371949:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829172.371950:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273180928:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829172.371953:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273181056:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829172.371962:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829172.371967:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829172/real 1787829172]  req@ffff9ee005706580 x1874670273181056/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829197 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829172.371974:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706580 x1874670273181056/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829197 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829172.371979:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829172.371980:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829172.371982:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273181056:192.168.203.121@tcp:8:kworker.0
00010000:00010000:3.0:1787829173.203517:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829173.395468:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787829174.227473:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829174.419434:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829175.251468:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829175.443401:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829176.275542:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829176.467445:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829177.299532:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1787829177.491430:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1787829177.491433:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787829177.491444:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787829177.491450:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829177.491464:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4341
00000100:00080000:3.0:1787829177.491479:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829177.491487:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787829177.491538:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705e00 x1874670273181184/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829177.491578:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829177.491582:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787829177.491584:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829177.491589:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4341
00000100:00080000:3.0:1787829177.491594:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829177.491599:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829177.491612:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787829177.491628:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706d00 x1874670273181312/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829177.491636:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829177.491639:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787829177.491641:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829177.491643:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4341
00000100:00080000:3.0:1787829177.491646:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829177.491649:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829177.491653:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829177.491666:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706580 x1874670273181440/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787829177.491669:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273181184:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787829177.491704:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829177.491709:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787829177.491712:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829177.491718:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4341
00000100:00080000:3.0:1787829177.491724:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829177.491730:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829177.491744:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:0.0:1787829177.491751:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829177.491759:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704b40 x1874670273181568/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829177.491770:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829177.491772:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787829177.491774:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829177.491782:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4341
00000100:00080000:3.0:1787829177.491786:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829177.491790:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829177.491795:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787829177.491797:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829177/real 1787829177]  req@ffff9ee005705e00 x1874670273181184/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829202 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829177.491807:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705a40 x1874670273181696/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829177.491829:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829177.491833:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787829177.491835:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829177.491839:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4341
00000100:00080000:3.0:1787829177.491844:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1787829177.491846:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705e00 x1874670273181184/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829202 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829177.491861:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00080000:0.0:1787829177.491866:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000008:00100000:3.0:1787829177.491870:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:0.0:1787829177.491873:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829177.491883:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273181184:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787829177.491897:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273181312:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787829177.491898:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057043c0 x1874670273181824/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829177.491912:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829177.491916:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787829177.491919:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829177.491925:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4341
00000100:00080000:3.0:1787829177.491929:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000800:00000100:0.0:1787829177.491930:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787829177.491940:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829177.491948:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787829177.491952:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829177/real 1787829177]  req@ffff9ee005706d00 x1874670273181312/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829202 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829177.491963:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704780 x1874670273181952/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787829177.491967:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706d00 x1874670273181312/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829202 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829177.492010:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829177.492015:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829177.492019:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273181312:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787829177.492045:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273181440:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829177.492076:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829177.492086:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829177/real 1787829177]  req@ffff9ee005706580 x1874670273181440/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829202 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829177.492095:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706580 x1874670273181440/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829202 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829177.492100:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829177.492103:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829177.492105:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273181440:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829177.492109:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273181568:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829177.492126:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829177.492137:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829177/real 1787829177]  req@ffff9ee005704b40 x1874670273181568/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829202 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829177.492149:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704b40 x1874670273181568/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829202 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829177.492157:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829177.492160:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829177.492163:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273181568:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829177.492168:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273181696:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787829177.492184:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829177.492192:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829177/real 1787829177]  req@ffff9ee005705a40 x1874670273181696/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829202 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829177.492199:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705a40 x1874670273181696/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829202 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829177.492204:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829177.492206:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829177.492208:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273181696:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787829177.492212:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273181824:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829177.492222:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829177.492227:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829177/real 1787829177]  req@ffff9ee0057043c0 x1874670273181824/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829202 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829177.492235:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057043c0 x1874670273181824/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829202 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829177.492240:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829177.492242:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829177.492244:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273181824:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829177.492247:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273181952:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829177.492257:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829177.492263:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829177/real 1787829177]  req@ffff9ee005704780 x1874670273181952/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829202 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829177.492270:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704780 x1874670273181952/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829202 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829177.492284:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829177.492287:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829177.492289:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273181952:192.168.203.121@tcp:8:kworker.0
00010000:00010000:3.0:1787829178.323476:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829178.515446:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787829179.347538:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829179.539402:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829180.371471:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829180.563412:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829181.395492:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829181.587422:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829182.419479:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1787829182.611424:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1787829182.611433:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787829182.611435:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787829182.611442:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829182.611453:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4346
00000100:00080000:3.0:1787829182.611464:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829182.611471:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787829182.611507:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057070c0 x1874670273182080/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829182.611540:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829182.611543:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787829182.611546:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829182.611551:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4346
00000100:00080000:3.0:1787829182.611556:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829182.611561:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829182.611574:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787829182.611593:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704000 x1874670273182208/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829182.611611:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1787829182.611617:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273182080:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787829182.611634:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787829182.611640:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829182.611648:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4346
00000100:00080000:3.0:1787829182.611653:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829182.611658:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829182.611665:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829182.611682:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707480 x1874670273182336/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829182.611694:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829182.611697:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787829182.611699:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829182.611702:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4346
00000100:00080000:3.0:1787829182.611708:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829182.611729:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829182.611735:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829182.611749:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057052c0 x1874670273182464/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787829182.611762:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273182208:192.168.203.121@tcp:38:kworker.0
00000100:00080000:3.0:1787829182.611762:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829182.611773:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787829182.611777:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829182.611798:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4346
00000100:00080000:3.0:1787829182.611802:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829182.611806:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829182.611811:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787829182.611822:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706940 x1874670273182592/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787829182.611826:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273182336:192.168.203.121@tcp:8:kworker.0
00000100:00080000:3.0:1787829182.611842:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829182.611846:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00100000:0.0:1787829182.611858:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273182464:192.168.203.121@tcp:8:kworker.0
00000100:00080000:3.0:1787829182.611859:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829182.611868:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4346
00000100:00080000:3.0:1787829182.611872:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829182.611875:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829182.611897:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829182.611912:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707840 x1874670273182720/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787829182.611916:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273182592:192.168.203.121@tcp:38:kworker.0
00000100:00080000:3.0:1787829182.611944:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829182.611948:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787829182.611950:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829182.611956:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4346
00000100:00100000:0.0:1787829182.611960:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273182720:192.168.203.121@tcp:8:kworker.0
00000100:00080000:3.0:1787829182.611964:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829182.611971:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829182.611977:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829182.611991:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705680 x1874670273182848/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787829182.612059:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273182848:192.168.203.121@tcp:8:kworker.0
00010000:00010000:3.0:1787829183.443522:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829183.635407:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787829184.467530:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829184.659398:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829185.491449:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829185.683396:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000400:00000100:2.0:1787829185.683588:0:2353:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.203.121:988
00000400:00000100:2.0:1787829185.683627:0:2353:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.203.121@tcp at host 192.168.203.121 was unreachable: the network or that node may be down, or Lustre may be misconfigured.
00000800:00000100:2.0:1787829185.683645:0:2353:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:2.0:1787829185.683683:0:2353:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:2.0:1787829185.683694:0:2353:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:2.0:1787829185.683705:0:2353:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:2.0:1787829185.683713:0:2353:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:2.0:1787829185.683720:0:2353:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000100:00100000:0.0:1787829185.683729:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829182/real 1787829185]  req@ffff9ee0057052c0 x1874670273182464/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829207 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000800:00000100:2.0:1787829185.683731:0:2353:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000100:00100000:0.0:1787829185.683758:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057052c0 x1874670273182464/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829207 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829185.683770:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829185.683775:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829185.683780:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273182464:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829185.683789:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829182/real 1787829185]  req@ffff9ee005706940 x1874670273182592/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829207 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829185.683802:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706940 x1874670273182592/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829207 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829185.683810:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829185.683814:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829185.683817:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273182592:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787829185.683824:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829182/real 1787829185]  req@ffff9ee005704000 x1874670273182208/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829207 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829185.683835:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704000 x1874670273182208/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829207 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829185.683843:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829185.683846:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829185.683849:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273182208:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787829185.683856:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829182/real 1787829185]  req@ffff9ee005707480 x1874670273182336/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829207 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829185.683866:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707480 x1874670273182336/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829207 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829185.683873:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829185.683877:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829185.683880:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273182336:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829185.683886:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829182/real 1787829185]  req@ffff9ee0057070c0 x1874670273182080/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829207 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829185.683898:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057070c0 x1874670273182080/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829207 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829185.683906:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829185.683910:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829185.683913:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273182080:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787829185.683939:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829182/real 1787829185]  req@ffff9ee005705680 x1874670273182848/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829207 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829185.683951:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705680 x1874670273182848/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829207 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829185.683958:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829185.683961:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829185.683964:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273182848:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829185.683970:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829182/real 1787829185]  req@ffff9ee005707840 x1874670273182720/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829207 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829185.683982:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707840 x1874670273182720/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829207 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829185.683989:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829185.683992:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829185.683995:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273182720:192.168.203.121@tcp:8:kworker.0
00010000:00010000:0.0:1787829186.515576:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829186.707437:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829187.539508:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1787829187.731428:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829187.731441:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787829187.731447:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1787829187.731455:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787829187.731476:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4351
00000100:00080000:3.0:1787829187.731505:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829187.731515:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787829187.731581:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057061c0 x1874670273182976/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829187.731625:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829187.731646:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787829187.731649:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829187.731653:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4351
00000100:00080000:3.0:1787829187.731658:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829187.731664:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829187.731678:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787829187.731693:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707c00 x1874670273183104/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829187.731708:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829187.731712:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787829187.731715:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829187.731724:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4351
00000100:00100000:0.0:1787829187.731726:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273182976:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787829187.731730:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829187.731748:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829187.731756:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829187.731788:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707840 x1874670273183232/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829187.731801:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829187.731805:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787829187.731807:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:0.0:1787829187.731827:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787829187.731835:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4351
00000100:00080000:3.0:1787829187.731842:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829187.731848:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829187.731855:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829187.731870:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705680 x1874670273183360/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829187.731885:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829187.731889:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787829187.731893:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1787829187.731897:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829187/real 1787829187]  req@ffff9ee0057061c0 x1874670273182976/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829212 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829187.731900:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4351
00000100:00080000:3.0:1787829187.731922:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829187.731933:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829187.731941:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787829187.731956:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057070c0 x1874670273183488/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787829187.731968:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057061c0 x1874670273182976/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829212 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829187.731970:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829187.731984:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787829187.732001:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829187.732016:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4351
00000100:00080000:3.0:1787829187.732027:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829187.732046:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829187.732054:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00080000:0.0:1787829187.732063:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000008:00100000:3.0:1787829187.732069:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787829187.732078:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273182976:192.168.203.121@tcp:250:kworker.0
00000100:00100000:3.0:1787829187.732093:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707480 x1874670273183616/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829187.732109:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829187.732113:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787829187.732125:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1787829187.732126:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273183104:192.168.203.121@tcp:38:kworker.0
00000100:00080000:3.0:1787829187.732142:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4351
00000100:00080000:3.0:1787829187.732149:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829187.732156:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829187.732163:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829187.732181:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704000 x1874670273183744/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1787829187.732188:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829187.732232:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829187/real 1787829187]  req@ffff9ee005707c00 x1874670273183104/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829212 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829187.732254:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707c00 x1874670273183104/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829212 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829187.732266:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829187.732271:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829187.732275:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273183104:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787829187.732285:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273183232:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829187.732376:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829187.732398:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829187/real 1787829187]  req@ffff9ee005707840 x1874670273183232/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829212 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829187.732414:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707840 x1874670273183232/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829212 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829187.732424:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829187.732428:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829187.732433:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273183232:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829187.732441:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273183360:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829187.732468:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829187.732485:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829187/real 1787829187]  req@ffff9ee005705680 x1874670273183360/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829212 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829187.732501:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705680 x1874670273183360/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829212 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829187.732510:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829187.732514:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829187.732518:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273183360:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829187.732526:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273183488:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787829187.732552:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829187.732568:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829187/real 1787829187]  req@ffff9ee0057070c0 x1874670273183488/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829212 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829187.732583:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057070c0 x1874670273183488/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829212 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829187.732594:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829187.732599:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829187.732604:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273183488:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787829187.732612:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273183616:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829187.732637:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829187.732651:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829187/real 1787829187]  req@ffff9ee005707480 x1874670273183616/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829212 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829187.732665:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707480 x1874670273183616/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829212 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829187.732683:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829187.732687:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829187.732692:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273183616:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829187.732725:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273183744:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829187.732753:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829187.732769:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829187/real 1787829187]  req@ffff9ee005704000 x1874670273183744/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829212 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829187.732783:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704000 x1874670273183744/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829212 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829187.732792:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829187.732796:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829187.732800:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273183744:192.168.203.121@tcp:8:kworker.0
00010000:00010000:3.0:1787829188.563492:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829188.755449:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787829189.587461:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829189.779403:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829190.611578:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829190.803440:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829191.635556:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829191.827409:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829192.659543:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1787829192.851539:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829192.851549:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1787829192.851553:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1787829192.851561:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:1.0:1787829192.851564:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4356
00000100:00080000:1.0:1787829192.851577:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829192.851584:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787829192.851623:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0780 x1874670273183872/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829192.851646:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829192.851650:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787829192.851652:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829192.851655:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4356
00000100:00080000:1.0:1787829192.851658:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829192.851662:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829192.851672:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787829192.851683:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0000 x1874670273184000/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787829192.851689:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273183872:192.168.203.121@tcp:250:kworker.0
00000100:00080000:1.0:1787829192.851705:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829192.851712:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787829192.851714:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829192.851718:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4356
00000100:00080000:1.0:1787829192.851720:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829192.851723:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829192.851728:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787829192.851740:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a2580 x1874670273184128/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829192.851748:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829192.851751:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787829192.851753:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829192.851756:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4356
00000100:00080000:1.0:1787829192.851761:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829192.851763:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829192.851767:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:0.0:1787829192.851772:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829192.851797:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0b40 x1874670273184256/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829192.851810:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829192.851813:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787829192.851815:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829192.851819:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4356
00000100:00080000:1.0:1787829192.851823:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1787829192.851825:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829192/real 1787829192]  req@ffff9ee0056a0780 x1874670273183872/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829217 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829192.851830:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829192.851839:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787829192.851852:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0780 x1874670273183872/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829217 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829192.851856:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a30c0 x1874670273184384/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829192.851904:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829192.851906:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829192.851908:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787829192.851914:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829192.851917:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:1.0:1787829192.851922:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4356
00000100:00080000:1.0:1787829192.851926:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1787829192.851927:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273183872:192.168.203.121@tcp:250:kworker.0
00000100:00080000:1.0:1787829192.851933:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829192.851939:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787829192.851949:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a3480 x1874670273184512/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787829192.851975:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273184000:192.168.203.121@tcp:38:kworker.0
00000100:00080000:1.0:1787829192.851984:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829192.851991:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787829192.851994:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:0.0:1787829192.852012:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:1.0:1787829192.852017:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4356
00000100:00080000:1.0:1787829192.852025:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1787829192.852029:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829192/real 1787829192]  req@ffff9ee0056a0000 x1874670273184000/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829217 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829192.852036:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829192.852048:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787829192.852051:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0000 x1874670273184000/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829217 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829192.852062:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:1.0:1787829192.852066:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1e00 x1874670273184640/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829192.852071:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829192.852080:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273184000:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787829192.852092:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273184128:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829192.852112:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829192.852120:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829192/real 1787829192]  req@ffff9ee0056a2580 x1874670273184128/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829217 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829192.852130:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a2580 x1874670273184128/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829217 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829192.852136:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829192.852139:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829192.852141:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273184128:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829192.852146:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273184256:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829192.852158:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829192.852175:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829192/real 1787829192]  req@ffff9ee0056a0b40 x1874670273184256/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829217 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829192.852185:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0b40 x1874670273184256/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829217 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829192.852192:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829192.852195:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829192.852197:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273184256:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829192.852202:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273184384:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787829192.852215:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829192.852230:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829192/real 1787829192]  req@ffff9ee0056a30c0 x1874670273184384/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829217 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829192.852245:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a30c0 x1874670273184384/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829217 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829192.852268:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829192.852272:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829192.852276:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273184384:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787829192.852300:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273184512:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829192.852349:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829192.852360:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829192/real 1787829192]  req@ffff9ee0056a3480 x1874670273184512/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829217 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829192.852376:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a3480 x1874670273184512/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829217 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829192.852382:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829192.852385:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829192.852387:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273184512:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829192.852392:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273184640:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829192.852405:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829192.852412:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829192/real 1787829192]  req@ffff9ee0056a1e00 x1874670273184640/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829217 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829192.852421:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1e00 x1874670273184640/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829217 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829192.852427:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829192.852429:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829192.852431:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273184640:192.168.203.121@tcp:8:kworker.0
00010000:00010000:3.0:1787829193.683504:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829193.875412:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787829194.707474:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829194.899441:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829195.731580:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829195.923441:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829196.755641:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829196.947444:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829197.779426:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1787829197.971454:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829197.971467:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1787829197.971474:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1787829197.971475:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:1.0:1787829197.971514:0:27626:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4361
00000100:00080000:1.0:1787829197.971525:0:27626:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829197.971533:0:27626:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787829197.971569:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a03c0 x1874670273184768/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829197.971601:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829197.971615:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787829197.971617:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829197.971620:0:27626:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4361
00000100:00080000:1.0:1787829197.971623:0:27626:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829197.971627:0:27626:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829197.971637:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787829197.971669:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a2940 x1874670273184896/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829197.971693:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829197.971701:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787829197.971705:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829197.971716:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4361
00000100:00100000:0.0:1787829197.971735:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273184768:192.168.203.121@tcp:250:kworker.0
00000100:00080000:1.0:1787829197.971742:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829197.971760:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829197.971770:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787829197.971792:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a21c0 x1874670273185024/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829197.971809:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829197.971813:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787829197.971816:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829197.971820:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4361
00000100:00080000:1.0:1787829197.971826:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829197.971830:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829197.971837:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:0.0:1787829197.971841:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829197.971858:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1680 x1874670273185152/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829197.971873:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829197.971877:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787829197.971880:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829197.971884:0:27626:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4361
00000100:00080000:1.0:1787829197.971889:0:27626:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829197.971895:0:27626:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829197.971902:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787829197.971959:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829197/real 1787829197]  req@ffff9ee0056a03c0 x1874670273184768/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829222 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829197.971960:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0f00 x1874670273185280/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829197.971989:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829197.971994:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787829197.971996:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829197.972018:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4361
00000100:00100000:0.0:1787829197.972025:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a03c0 x1874670273184768/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829222 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829197.972027:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829197.972039:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829197.972049:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:0.0:1787829197.972065:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:1.0:1787829197.972089:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a3c00 x1874670273185408/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829197.972096:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:1.0:1787829197.972105:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1787829197.972111:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273184768:192.168.203.121@tcp:250:kworker.0
00000100:00080000:1.0:1787829197.972114:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787829197.972120:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829197.972128:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4361
00000100:00100000:0.0:1787829197.972132:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273184896:192.168.203.121@tcp:38:kworker.0
00000100:00080000:1.0:1787829197.972136:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829197.972191:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829197.972200:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:0.0:1787829197.972219:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829197.972221:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1a40 x1874670273185536/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787829197.972246:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829197/real 1787829197]  req@ffff9ee0056a2940 x1874670273184896/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829222 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829197.972262:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a2940 x1874670273184896/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829222 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829197.972271:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829197.972274:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829197.972278:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273184896:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787829197.972306:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273185024:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829197.972374:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829197.972387:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829197/real 1787829197]  req@ffff9ee0056a21c0 x1874670273185024/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829222 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829197.972400:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a21c0 x1874670273185024/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829222 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829197.972409:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829197.972412:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829197.972427:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273185024:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829197.972435:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273185152:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829197.972452:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829197.972463:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829197/real 1787829197]  req@ffff9ee0056a1680 x1874670273185152/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829222 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829197.972474:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1680 x1874670273185152/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829222 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829197.972482:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829197.972486:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829197.972505:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273185152:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829197.972510:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273185280:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787829197.972525:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829197.972532:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829197/real 1787829197]  req@ffff9ee0056a0f00 x1874670273185280/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829222 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829197.972542:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0f00 x1874670273185280/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829222 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829197.972548:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829197.972551:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829197.972553:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273185280:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787829197.972559:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273185408:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829197.972571:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829197.972578:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829197/real 1787829197]  req@ffff9ee0056a3c00 x1874670273185408/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829222 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829197.972588:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a3c00 x1874670273185408/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829222 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829197.972595:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829197.972597:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829197.972599:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273185408:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829197.972604:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273185536:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829197.972616:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829197.972623:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829197/real 1787829197]  req@ffff9ee0056a1a40 x1874670273185536/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829222 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829197.972631:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1a40 x1874670273185536/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829222 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829197.972641:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829197.972646:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829197.972650:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273185536:192.168.203.121@tcp:8:kworker.0
00010000:00010000:3.0:1787829198.803466:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829198.995413:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787829199.827481:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829200.019376:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829200.851610:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829201.043447:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829201.875519:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829202.067431:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829202.899447:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829203.091450:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:1.0:1787829203.091486:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829203.091511:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1787829203.091516:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829203.091523:0:27626:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4366
00000100:00080000:1.0:1787829203.091533:0:27626:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829203.091541:0:27626:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787829203.091577:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a12c0 x1874670273185664/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829203.091601:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829203.091604:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787829203.091605:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829203.091608:0:27626:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4366
00000100:00080000:1.0:1787829203.091611:0:27626:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829203.091613:0:27626:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829203.091621:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787829203.091633:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1a40 x1874670273185792/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829203.091641:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1787829203.091660:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273185664:192.168.203.121@tcp:250:kworker.0
00000100:00080000:1.0:1787829203.091661:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787829203.091664:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829203.091672:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4366
00000100:00080000:1.0:1787829203.091676:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829203.091679:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829203.091683:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787829203.091694:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a3c00 x1874670273185920/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829203.091709:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829203.091712:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787829203.091714:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829203.091716:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4366
00000100:00080000:1.0:1787829203.091743:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829203.091746:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000800:00000100:0.0:1787829203.091751:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000008:00100000:1.0:1787829203.091752:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787829203.091763:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0f00 x1874670273186048/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829203.091769:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829203.091771:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787829203.091773:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829203.091775:0:27626:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4366
00000100:00080000:1.0:1787829203.091778:0:27626:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829203.091781:0:27626:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829203.091785:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787829203.091788:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829203/real 1787829203]  req@ffff9ee0056a12c0 x1874670273185664/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829228 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829203.091795:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1680 x1874670273186176/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829203.091821:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1787829203.091823:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a12c0 x1874670273185664/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829228 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829203.091826:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787829203.091830:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829203.091840:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4366
00000100:00080000:0.0:1787829203.091846:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829203.091847:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829203.091855:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00080000:0.0:1787829203.091856:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000008:00100000:1.0:1787829203.091862:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787829203.091864:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273185664:192.168.203.121@tcp:250:kworker.0
00000100:00100000:1.0:1787829203.091879:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a21c0 x1874670273186304/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829203.091910:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1787829203.091911:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273185792:192.168.203.121@tcp:38:kworker.0
00000100:00080000:1.0:1787829203.091935:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787829203.091937:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829203.091941:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4366
00000100:00080000:1.0:1787829203.091944:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829203.091947:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829203.091951:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:0.0:1787829203.091961:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829203.091963:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a2940 x1874670273186432/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787829203.091980:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829203/real 1787829203]  req@ffff9ee0056a1a40 x1874670273185792/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829228 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829203.091995:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1a40 x1874670273185792/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829228 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829203.092003:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829203.092005:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829203.092007:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273185792:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787829203.092012:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273185920:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829203.092029:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829203.092037:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829203/real 1787829203]  req@ffff9ee0056a3c00 x1874670273185920/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829228 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829203.092044:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a3c00 x1874670273185920/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829228 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829203.092049:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829203.092052:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829203.092054:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273185920:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829203.092058:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273186048:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829203.092067:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829203.092073:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829203/real 1787829203]  req@ffff9ee0056a0f00 x1874670273186048/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829228 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829203.092080:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0f00 x1874670273186048/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829228 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829203.092085:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829203.092086:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829203.092088:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273186048:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829203.092091:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273186176:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787829203.092100:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829203.092106:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829203/real 1787829203]  req@ffff9ee0056a1680 x1874670273186176/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829228 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829203.092112:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1680 x1874670273186176/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829228 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829203.092117:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829203.092119:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829203.092121:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273186176:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787829203.092142:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273186304:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829203.092153:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829203.092159:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829203/real 1787829203]  req@ffff9ee0056a21c0 x1874670273186304/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829228 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829203.092167:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a21c0 x1874670273186304/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829228 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829203.092182:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829203.092184:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829203.092186:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273186304:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829203.092189:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273186432:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829203.092198:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829203.092204:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829203/real 1787829203]  req@ffff9ee0056a2940 x1874670273186432/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829228 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829203.092216:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a2940 x1874670273186432/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829228 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829203.092224:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829203.092228:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829203.092231:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273186432:192.168.203.121@tcp:8:kworker.0
00010000:00010000:3.0:1787829203.923455:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829204.115411:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787829204.947561:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829205.139404:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829205.971529:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829206.163463:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829206.995509:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829207.187424:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829208.019523:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1787829208.211448:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829208.211463:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1787829208.211469:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1787829208.211492:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:1.0:1787829208.211494:0:27626:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4371
00000100:00080000:1.0:1787829208.211512:0:27626:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829208.211522:0:27626:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787829208.211573:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a03c0 x1874670273186560/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829208.211619:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829208.211628:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787829208.211631:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829208.211634:0:27626:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4371
00000100:00080000:1.0:1787829208.211638:0:27626:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829208.211642:0:27626:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829208.211658:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787829208.211672:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1e00 x1874670273186688/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787829208.211674:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273186560:192.168.203.121@tcp:250:kworker.0
00000100:00080000:1.0:1787829208.211692:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829208.211696:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787829208.211699:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829208.211703:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4371
00000100:00080000:1.0:1787829208.211707:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829208.211712:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829208.211719:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787829208.211734:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a3480 x1874670273186816/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829208.211746:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829208.211749:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787829208.211751:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829208.211755:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4371
00000100:00080000:1.0:1787829208.211760:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000800:00000100:0.0:1787829208.211762:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:1.0:1787829208.211767:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829208.211774:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787829208.211788:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a30c0 x1874670273186944/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829208.211799:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829208.211803:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787829208.211805:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829208.211811:0:27626:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4371
00000100:00100000:0.0:1787829208.211816:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829208/real 1787829208]  req@ffff9ee0056a03c0 x1874670273186560/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829233 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829208.211818:0:27626:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829208.211826:0:27626:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829208.211834:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787829208.211841:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a03c0 x1874670273186560/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829233 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829208.211862:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0b40 x1874670273187072/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829208.211884:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829208.211884:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829208.211891:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787829208.211894:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:1.0:1787829208.211894:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1787829208.211901:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273186560:192.168.203.121@tcp:250:kworker.0
00000100:00080000:1.0:1787829208.211902:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4371
00000100:00080000:1.0:1787829208.211909:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829208.211913:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829208.211918:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787829208.211931:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a2580 x1874670273187200/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787829208.211934:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273186688:192.168.203.121@tcp:38:kworker.0
00000100:00080000:1.0:1787829208.211957:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:0.0:1787829208.211963:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:1.0:1787829208.211965:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787829208.211969:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829208.211975:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4371
00000100:00080000:1.0:1787829208.211980:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1787829208.211984:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829208/real 1787829208]  req@ffff9ee0056a1e00 x1874670273186688/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829233 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829208.211987:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829208.211995:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787829208.212003:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1e00 x1874670273186688/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829233 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829208.212011:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0000 x1874670273187328/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829208.212022:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829208.212033:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829208.212037:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273186688:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787829208.212045:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273186816:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829208.212070:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829208.212082:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829208/real 1787829208]  req@ffff9ee0056a3480 x1874670273186816/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829233 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829208.212094:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a3480 x1874670273186816/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829233 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829208.212102:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829208.212106:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829208.212117:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273186816:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829208.212124:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273186944:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829208.212142:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829208.212161:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829208/real 1787829208]  req@ffff9ee0056a30c0 x1874670273186944/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829233 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829208.212172:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a30c0 x1874670273186944/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829233 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829208.212181:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829208.212185:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829208.212187:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273186944:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829208.212193:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273187072:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787829208.212221:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829208.212233:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829208/real 1787829208]  req@ffff9ee0056a0b40 x1874670273187072/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829233 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829208.212242:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0b40 x1874670273187072/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829233 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829208.212248:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829208.212250:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829208.212252:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273187072:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787829208.212268:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273187200:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829208.212282:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829208.212292:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829208/real 1787829208]  req@ffff9ee0056a2580 x1874670273187200/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829233 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829208.212305:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a2580 x1874670273187200/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829233 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829208.212340:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829208.212344:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829208.212347:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273187200:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829208.212352:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273187328:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829208.212375:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829208.212383:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829208/real 1787829208]  req@ffff9ee0056a0000 x1874670273187328/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829233 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829208.212391:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0000 x1874670273187328/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829233 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829208.212397:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829208.212399:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829208.212401:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273187328:192.168.203.121@tcp:8:kworker.0
00010000:00010000:3.0:1787829209.043530:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829209.235431:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787829210.067509:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829210.259420:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829211.091484:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829211.283451:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829212.115528:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829212.307439:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829213.139540:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829213.331486:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787829213.331539:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829213.331551:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787829213.331558:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829213.331577:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4377
00000100:00080000:3.0:1787829213.331593:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829213.331611:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787829213.331681:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706940 x1874670273187456/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829213.331716:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829213.331721:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787829213.331723:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829213.331728:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4377
00000100:00080000:3.0:1787829213.331733:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829213.331737:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829213.331759:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787829213.331773:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057052c0 x1874670273187584/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829213.331786:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829213.331790:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787829213.331792:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829213.331796:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4377
00000100:00080000:3.0:1787829213.331800:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829213.331804:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829213.331834:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829213.331852:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704780 x1874670273187712/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787829213.331871:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273187456:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787829213.331882:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829213.331888:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787829213.331890:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829213.331896:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4377
00000100:00080000:3.0:1787829213.331900:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829213.331905:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829213.331920:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829213.331937:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057043c0 x1874670273187840/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829213.331957:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829213.331962:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787829213.331964:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829213.331969:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4377
00000100:00080000:3.0:1787829213.331973:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000800:00000100:0.0:1787829213.331982:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787829213.331982:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829213.331999:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787829213.332017:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705a40 x1874670273187968/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829213.332029:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829213.332034:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787829213.332036:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1787829213.332050:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829213/real 1787829213]  req@ffff9ee005706940 x1874670273187456/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829238 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829213.332051:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4377
00000100:00080000:3.0:1787829213.332060:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829213.332075:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829213.332080:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787829213.332093:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706940 x1874670273187456/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829238 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829213.332099:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704b40 x1874670273188096/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829213.332134:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829213.332135:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829213.332145:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787829213.332147:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:3.0:1787829213.332149:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1787829213.332157:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273187456:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787829213.332160:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4377
00000100:00080000:3.0:1787829213.332170:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1787829213.332176:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273187584:192.168.203.121@tcp:38:kworker.0
00000100:00080000:3.0:1787829213.332178:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829213.332190:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829213.332214:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706580 x1874670273188224/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1787829213.332227:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829213.332249:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829213/real 1787829213]  req@ffff9ee0057052c0 x1874670273187584/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829238 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829213.332264:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057052c0 x1874670273187584/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829238 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829213.332280:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829213.332284:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829213.332288:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273187584:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787829213.332376:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273187712:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829213.332401:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829213.332414:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829213/real 1787829213]  req@ffff9ee005704780 x1874670273187712/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829238 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829213.332427:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704780 x1874670273187712/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829238 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829213.332436:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829213.332439:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829213.332443:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273187712:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829213.332449:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273187840:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829213.332466:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829213.332475:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829213/real 1787829213]  req@ffff9ee0057043c0 x1874670273187840/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829238 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829213.332487:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057043c0 x1874670273187840/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829238 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829213.332495:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829213.332498:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829213.332501:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273187840:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829213.332507:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273187968:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787829213.332522:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829213.332531:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829213/real 1787829213]  req@ffff9ee005705a40 x1874670273187968/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829238 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829213.332542:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705a40 x1874670273187968/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829238 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829213.332550:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829213.332553:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829213.332556:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273187968:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787829213.332561:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273188096:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829213.332578:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829213.332588:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829213/real 1787829213]  req@ffff9ee005704b40 x1874670273188096/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829238 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829213.332600:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704b40 x1874670273188096/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829238 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829213.332608:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829213.332611:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829213.332614:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273188096:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829213.332619:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273188224:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829213.332635:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829213.332643:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829213/real 1787829213]  req@ffff9ee005706580 x1874670273188224/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829238 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829213.332654:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706580 x1874670273188224/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829238 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829213.332662:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829213.332666:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829213.332669:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273188224:192.168.203.121@tcp:8:kworker.0
00010000:00010000:3.0:1787829214.163546:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829214.355484:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787829215.187483:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829215.379446:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829216.211498:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829216.403423:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829217.235487:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829217.427385:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829218.259531:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829218.451387:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787829218.451391:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829218.451398:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787829218.451409:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829218.451421:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4382
00000100:00080000:3.0:1787829218.451433:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829218.451441:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787829218.451475:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706d00 x1874670273188352/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829218.451503:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829218.451509:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787829218.451511:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829218.451515:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4382
00000100:00080000:3.0:1787829218.451519:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829218.451523:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829218.451531:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787829218.451538:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273188352:192.168.203.121@tcp:250:kworker.0
00000100:00100000:3.0:1787829218.451545:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705e00 x1874670273188480/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829218.451560:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829218.451563:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787829218.451564:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829218.451568:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4382
00000100:00080000:3.0:1787829218.451571:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829218.451574:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829218.451578:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829218.451586:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706580 x1874670273188608/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829218.451592:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829218.451595:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787829218.451596:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829218.451598:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4382
00000100:00080000:3.0:1787829218.451600:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829218.451602:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829218.451605:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829218.451611:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704b40 x1874670273188736/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829218.451616:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829218.451618:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787829218.451619:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829218.451621:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4382
00000100:00080000:3.0:1787829218.451624:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000800:00000100:1.0:1787829218.451629:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787829218.451631:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829218.451635:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787829218.451641:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705a40 x1874670273188864/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829218.451648:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829218.451650:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787829218.451652:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829218.451655:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4382
00000100:00100000:1.0:1787829218.451676:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829218/real 1787829218]  req@ffff9ee005706d00 x1874670273188352/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829243 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829218.451700:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706d00 x1874670273188352/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829243 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829218.451701:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829218.451708:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00080000:1.0:1787829218.451714:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000008:00100000:3.0:1787829218.451717:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:1.0:1787829218.451720:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829218.451725:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273188352:192.168.203.121@tcp:250:kworker.0
00000100:00100000:3.0:1787829218.451736:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057043c0 x1874670273188992/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787829218.451746:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273188480:192.168.203.121@tcp:38:kworker.0
00000100:00080000:3.0:1787829218.451749:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829218.451753:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787829218.451754:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:1.0:1787829218.451769:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829218.451795:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829218/real 1787829218]  req@ffff9ee005705e00 x1874670273188480/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829243 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829218.451805:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705e00 x1874670273188480/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829243 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829218.451812:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829218.451814:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829218.451817:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273188480:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787829218.451822:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273188608:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787829218.451836:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829218.451852:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829218/real 1787829218]  req@ffff9ee005706580 x1874670273188608/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829243 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829218.451864:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706580 x1874670273188608/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829243 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829218.451871:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829218.451873:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829218.451875:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273188608:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787829218.451880:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273188736:192.168.203.121@tcp:8:kworker.0
00000100:00080000:3.0:1787829218.451882:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4382
00000100:00080000:3.0:1787829218.451890:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000800:00000100:1.0:1787829218.451896:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787829218.451897:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829218.451904:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787829218.451917:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829218/real 1787829218]  req@ffff9ee005704b40 x1874670273188736/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829243 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829218.451917:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704780 x1874670273189120/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787829218.451950:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704b40 x1874670273188736/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829243 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829218.451962:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829218.451966:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829218.451969:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273188736:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787829218.451976:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273188864:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787829218.451990:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829218.451998:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829218/real 1787829218]  req@ffff9ee005705a40 x1874670273188864/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829243 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829218.452007:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705a40 x1874670273188864/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829243 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829218.452030:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829218.452033:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829218.452036:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273188864:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787829218.452050:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273188992:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787829218.452061:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829218.452067:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829218/real 1787829218]  req@ffff9ee0057043c0 x1874670273188992/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829243 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829218.452074:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057043c0 x1874670273188992/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829243 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829218.452079:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829218.452081:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829218.452083:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273188992:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787829218.452087:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273189120:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787829218.452096:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829218.452101:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829218/real 1787829218]  req@ffff9ee005704780 x1874670273189120/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829243 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829218.452108:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704780 x1874670273189120/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829243 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829218.452113:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829218.452122:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829218.452125:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273189120:192.168.203.121@tcp:8:kworker.0
00010000:00010000:3.0:1787829219.283465:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829219.475445:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787829220.307568:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829220.499429:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829221.331536:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829221.523390:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829222.355560:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829222.547437:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829223.379477:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829223.571385:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787829223.571423:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829223.571432:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787829223.571437:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829223.571448:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4387
00000100:00080000:3.0:1787829223.571462:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829223.571471:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787829223.571520:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057052c0 x1874670273189248/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829223.571550:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829223.571554:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787829223.571556:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829223.571559:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4387
00000100:00080000:3.0:1787829223.571562:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829223.571565:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829223.571576:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787829223.571586:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706940 x1874670273189376/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829223.571594:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829223.571597:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787829223.571598:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829223.571601:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4387
00000100:00080000:3.0:1787829223.571605:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829223.571610:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787829223.571612:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273189248:192.168.203.121@tcp:250:kworker.0
00000008:00100000:3.0:1787829223.571615:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829223.571625:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704000 x1874670273189504/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829223.571632:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829223.571635:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787829223.571636:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829223.571639:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4387
00000100:00080000:3.0:1787829223.571641:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829223.571643:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829223.571646:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829223.571653:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707480 x1874670273189632/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829223.571660:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829223.571663:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787829223.571664:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829223.571667:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4387
00000100:00080000:3.0:1787829223.571670:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829223.571672:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829223.571675:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787829223.571681:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057070c0 x1874670273189760/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829223.571692:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829223.571694:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787829223.571696:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829223.571702:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4387
00000800:00000100:1.0:1787829223.571705:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787829223.571705:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829223.571710:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829223.571714:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829223.571720:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705680 x1874670273189888/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829223.571727:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829223.571729:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787829223.571730:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829223.571733:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4387
00000100:00080000:3.0:1787829223.571735:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829223.571748:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829223.571753:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829223.571762:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707840 x1874670273190016/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787829223.571792:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829223/real 1787829223]  req@ffff9ee0057052c0 x1874670273189248/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829248 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829223.571816:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057052c0 x1874670273189248/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829248 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829223.571829:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829223.571834:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829223.571838:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273189248:192.168.203.121@tcp:250:kworker.0
00000100:00100000:1.0:1787829223.571845:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273189376:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787829223.571867:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829223.571878:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829223/real 1787829223]  req@ffff9ee005706940 x1874670273189376/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829248 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829223.571886:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706940 x1874670273189376/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829248 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829223.571892:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829223.571895:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829223.571897:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273189376:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787829223.571931:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273189504:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787829223.571945:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829223.571952:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829223/real 1787829223]  req@ffff9ee005704000 x1874670273189504/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829248 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829223.571960:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704000 x1874670273189504/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829248 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829223.571966:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829223.571968:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829223.571970:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273189504:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787829223.571973:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273189632:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787829223.571983:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829223.571989:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829223/real 1787829223]  req@ffff9ee005707480 x1874670273189632/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829248 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829223.571996:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707480 x1874670273189632/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829248 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829223.572002:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829223.572006:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829223.572009:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273189632:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787829223.572015:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273189760:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787829223.572034:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829223.572046:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829223/real 1787829223]  req@ffff9ee0057070c0 x1874670273189760/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829248 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829223.572059:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057070c0 x1874670273189760/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829248 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829223.572066:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829223.572069:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829223.572071:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273189760:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787829223.572075:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273189888:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787829223.572091:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829223.572098:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829223/real 1787829223]  req@ffff9ee005705680 x1874670273189888/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829248 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829223.572106:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705680 x1874670273189888/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829248 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829223.572111:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829223.572113:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829223.572116:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273189888:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787829223.572120:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273190016:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787829223.572131:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829223.572139:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829223/real 1787829223]  req@ffff9ee005707840 x1874670273190016/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829248 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829223.572151:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707840 x1874670273190016/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829248 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829223.572160:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829223.572163:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829223.572167:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273190016:192.168.203.121@tcp:8:kworker.0
00010000:00010000:3.0:1787829224.403447:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829224.595400:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787829225.427461:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829225.619396:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829226.451531:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829226.643429:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829227.475484:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829227.667422:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829228.499514:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829228.691405:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:0.0:1787829228.691414:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829228.691424:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1787829228.691430:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829228.691451:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4392
00000100:00080000:0.0:1787829228.691466:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829228.691476:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787829228.691530:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8f00 x1874670273190144/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829228.691554:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829228.691556:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787829228.691557:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829228.691560:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4392
00000100:00080000:0.0:1787829228.691563:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829228.691567:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829228.691576:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787829228.691586:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ebc00 x1874670273190272/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829228.691594:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829228.691598:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787829228.691599:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829228.691601:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4392
00000100:00080000:0.0:1787829228.691603:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829228.691608:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787829228.691611:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273190144:192.168.203.121@tcp:250:kworker.0
00000008:00100000:0.0:1787829228.691613:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787829228.691626:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e83c0 x1874670273190400/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829228.691639:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829228.691642:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787829228.691643:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829228.691645:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4392
00000100:00080000:0.0:1787829228.691647:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829228.691649:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829228.691652:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787829228.691660:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8000 x1874670273190528/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829228.691667:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829228.691670:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787829228.691671:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829228.691673:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4392
00000100:00080000:0.0:1787829228.691683:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829228.691686:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829228.691689:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000800:00000100:1.0:1787829228.691697:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829228.691699:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9e00 x1874670273190656/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829228.691723:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829228.691727:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787829228.691730:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829228.691735:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4392
00000100:00080000:0.0:1787829228.691740:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829228.691746:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829228.691752:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787829228.691766:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829228/real 1787829228]  req@ffff9ee0056e8f00 x1874670273190144/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829253 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829228.691767:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb480 x1874670273190784/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829228.691791:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829228.691795:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787829228.691796:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829228.691800:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4392
00000100:00080000:0.0:1787829228.691803:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829228.691808:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787829228.691809:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8f00 x1874670273190144/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829253 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:0.0:1787829228.691812:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787829228.691824:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb840 x1874670273190912/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829228.691828:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829228.691836:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829228.691842:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273190144:192.168.203.121@tcp:250:kworker.0
00000100:00100000:1.0:1787829228.691853:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273190272:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787829228.691877:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829228.691891:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829228/real 1787829228]  req@ffff9ee0056ebc00 x1874670273190272/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829253 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829228.691904:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ebc00 x1874670273190272/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829253 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829228.691914:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829228.691917:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829228.691921:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273190272:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787829228.691948:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273190400:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787829228.691966:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829228.691977:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829228/real 1787829228]  req@ffff9ee0056e83c0 x1874670273190400/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829253 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829228.691990:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e83c0 x1874670273190400/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829253 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829228.691999:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829228.692003:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829228.692007:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273190400:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787829228.692012:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273190528:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787829228.692027:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829228.692036:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829228/real 1787829228]  req@ffff9ee0056e8000 x1874670273190528/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829253 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829228.692048:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8000 x1874670273190528/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829253 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829228.692057:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829228.692061:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829228.692064:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273190528:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787829228.692071:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273190656:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787829228.692087:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829228.692096:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829228/real 1787829228]  req@ffff9ee0056e9e00 x1874670273190656/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829253 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829228.692109:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9e00 x1874670273190656/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829253 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829228.692117:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829228.692121:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829228.692124:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273190656:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787829228.692131:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273190784:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787829228.692146:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829228.692156:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829228/real 1787829228]  req@ffff9ee0056eb480 x1874670273190784/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829253 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829228.692168:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb480 x1874670273190784/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829253 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829228.692177:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829228.692180:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829228.692184:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273190784:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787829228.692190:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273190912:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787829228.692206:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829228.692215:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829228/real 1787829228]  req@ffff9ee0056eb840 x1874670273190912/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829253 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829228.692228:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb840 x1874670273190912/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829253 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829228.692237:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829228.692240:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829228.692243:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273190912:192.168.203.121@tcp:8:kworker.0
00010000:00010000:3.0:1787829229.523521:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829229.715382:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787829230.547512:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829230.739416:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829231.571535:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829231.763437:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829232.595475:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829232.787429:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829233.619501:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1787829233.811411:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1787829233.811416:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:0.0:1787829233.811420:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1787829233.811425:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829233.811434:0:27626:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4397
00000100:00080000:0.0:1787829233.811443:0:27626:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829233.811449:0:27626:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787829233.811480:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e92c0 x1874670273191040/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829233.811509:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829233.811512:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787829233.811513:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829233.811516:0:27626:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4397
00000100:00080000:0.0:1787829233.811518:0:27626:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829233.811520:0:27626:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829233.811527:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787829233.811535:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8b40 x1874670273191168/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829233.811543:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829233.811545:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787829233.811547:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829233.811549:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4397
00000100:00080000:0.0:1787829233.811551:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829233.811554:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829233.811557:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787829233.811566:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb0c0 x1874670273191296/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787829233.811568:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273191040:192.168.203.121@tcp:250:kworker.0
00000100:00080000:0.0:1787829233.811581:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829233.811584:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787829233.811585:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829233.811587:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4397
00000100:00080000:0.0:1787829233.811589:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829233.811592:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829233.811595:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787829233.811603:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9a40 x1874670273191424/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829233.811609:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829233.811612:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787829233.811613:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829233.811616:0:27626:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4397
00000100:00080000:0.0:1787829233.811626:0:27626:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829233.811629:0:27626:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000800:00000100:1.0:1787829233.811635:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000008:00100000:0.0:1787829233.811636:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787829233.811647:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ea580 x1874670273191552/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829233.811654:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829233.811657:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787829233.811658:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829233.811661:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4397
00000100:00080000:0.0:1787829233.811663:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829233.811676:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829233.811681:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787829233.811683:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829233/real 1787829233]  req@ffff9ee0056e92c0 x1874670273191040/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829258 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829233.811694:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9680 x1874670273191680/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787829233.811701:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e92c0 x1874670273191040/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829258 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829233.811732:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829233.811733:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829233.811739:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787829233.811740:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:0.0:1787829233.811742:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1787829233.811746:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273191040:192.168.203.121@tcp:250:kworker.0
00000100:00080000:0.0:1787829233.811748:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4397
00000100:00080000:0.0:1787829233.811755:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1787829233.811759:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273191168:192.168.203.121@tcp:38:kworker.0
00000100:00080000:0.0:1787829233.811761:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829233.811767:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787829233.811778:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8780 x1874670273191808/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1787829233.811788:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829233.811799:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829233/real 1787829233]  req@ffff9ee0056e8b40 x1874670273191168/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829258 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829233.811808:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8b40 x1874670273191168/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829258 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829233.811814:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829233.811816:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829233.811819:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273191168:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787829233.811837:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273191296:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787829233.811849:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829233.811856:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829233/real 1787829233]  req@ffff9ee0056eb0c0 x1874670273191296/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829258 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829233.811863:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb0c0 x1874670273191296/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829258 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829233.811870:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829233.811872:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829233.811876:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273191296:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787829233.811882:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273191424:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787829233.811900:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829233.811911:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829233/real 1787829233]  req@ffff9ee0056e9a40 x1874670273191424/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829258 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829233.811925:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9a40 x1874670273191424/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829258 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829233.811932:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829233.811934:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829233.811936:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273191424:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787829233.811941:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273191552:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787829233.811955:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829233.811962:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829233/real 1787829233]  req@ffff9ee0056ea580 x1874670273191552/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829258 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829233.811970:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ea580 x1874670273191552/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829258 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829233.811975:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829233.811977:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829233.811979:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273191552:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787829233.811982:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273191680:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787829233.811992:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829233.811997:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829233/real 1787829233]  req@ffff9ee0056e9680 x1874670273191680/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829258 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829233.812004:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9680 x1874670273191680/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829258 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829233.812009:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829233.812011:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829233.812013:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273191680:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787829233.812017:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273191808:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787829233.812026:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829233.812031:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829233/real 1787829233]  req@ffff9ee0056e8780 x1874670273191808/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829258 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829233.812038:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8780 x1874670273191808/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829258 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829233.812043:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829233.812045:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829233.812047:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273191808:192.168.203.121@tcp:8:kworker.0
00010000:00010000:3.0:1787829234.643474:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829234.835423:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787829235.667512:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829235.859432:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829236.691481:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829236.883381:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829237.715478:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829237.907398:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829238.739496:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829238.931415:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787829238.931429:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829238.931437:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787829238.931442:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829238.931452:0:27626:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4402
00000100:00080000:3.0:1787829238.931462:0:27626:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829238.931468:0:27626:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787829238.931499:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707c00 x1874670273191936/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829238.931521:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829238.931524:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787829238.931526:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829238.931529:0:27626:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4402
00000100:00080000:3.0:1787829238.931531:0:27626:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829238.931534:0:27626:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829238.931542:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787829238.931550:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057061c0 x1874670273192064/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829238.931558:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1787829238.931563:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273191936:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787829238.931563:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787829238.931566:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829238.931572:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4402
00000100:00080000:3.0:1787829238.931575:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829238.931577:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829238.931581:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829238.931590:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707840 x1874670273192192/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829238.931596:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829238.931598:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787829238.931599:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829238.931602:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4402
00000100:00080000:3.0:1787829238.931605:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829238.931607:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829238.931610:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829238.931618:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705680 x1874670273192320/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1787829238.931625:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787829238.931628:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829238.931645:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787829238.931648:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829238.931653:0:27626:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4402
00000100:00080000:3.0:1787829238.931656:0:27626:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829238.931659:0:27626:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829238.931663:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787829238.931671:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057070c0 x1874670273192448/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787829238.931679:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829238/real 1787829238]  req@ffff9ee005707c00 x1874670273191936/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829263 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829238.931680:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829238.931688:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787829238.931692:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829238.931699:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4402
00000100:00080000:3.0:1787829238.931703:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1787829238.931708:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707c00 x1874670273191936/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829263 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829238.931708:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829238.931712:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:1.0:1787829238.931724:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:3.0:1787829238.931724:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707480 x1874670273192576/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829238.931732:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829238.931740:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273191936:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787829238.931740:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829238.931746:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787829238.931749:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829238.931752:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4402
00000100:00080000:3.0:1787829238.931754:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829238.931757:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829238.931759:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787829238.931767:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273192064:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787829238.931768:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704000 x1874670273192704/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1787829238.931795:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829238.931806:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829238/real 1787829238]  req@ffff9ee0057061c0 x1874670273192064/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829263 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829238.931815:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057061c0 x1874670273192064/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829263 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829238.931821:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829238.931823:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829238.931825:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273192064:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787829238.931829:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273192192:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787829238.931849:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829238.931856:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829238/real 1787829238]  req@ffff9ee005707840 x1874670273192192/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829263 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829238.931863:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707840 x1874670273192192/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829263 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829238.931868:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829238.931871:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829238.931873:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273192192:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787829238.931876:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273192320:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787829238.931886:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829238.931892:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829238/real 1787829238]  req@ffff9ee005705680 x1874670273192320/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829263 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829238.931898:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705680 x1874670273192320/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829263 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829238.931904:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829238.931906:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829238.931908:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273192320:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787829238.931912:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273192448:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787829238.931921:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829238.931932:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829238/real 1787829238]  req@ffff9ee0057070c0 x1874670273192448/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829263 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829238.931939:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057070c0 x1874670273192448/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829263 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829238.931944:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829238.931946:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829238.931948:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273192448:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787829238.931952:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273192576:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787829238.931962:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829238.931968:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829238/real 1787829238]  req@ffff9ee005707480 x1874670273192576/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829263 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829238.931975:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707480 x1874670273192576/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829263 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829238.931980:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829238.931981:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829238.931984:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273192576:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787829238.931996:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273192704:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787829238.932006:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829238.932012:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829238/real 1787829238]  req@ffff9ee005704000 x1874670273192704/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829263 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829238.932019:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704000 x1874670273192704/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829263 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829238.932024:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829238.932026:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829238.932027:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273192704:192.168.203.121@tcp:8:kworker.0
00010000:00010000:3.0:1787829239.763481:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829239.955445:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787829240.787448:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829240.979427:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829241.811465:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829242.003435:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829242.835458:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829243.027399:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829243.859467:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829244.051410:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787829244.051410:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829244.051421:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787829244.051426:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829244.051446:0:27626:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4407
00000100:00080000:3.0:1787829244.051459:0:27626:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829244.051466:0:27626:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787829244.051503:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706940 x1874670273192832/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829244.051532:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829244.051536:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787829244.051539:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829244.051543:0:27626:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4407
00000100:00080000:3.0:1787829244.051548:0:27626:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829244.051553:0:27626:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787829244.051563:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273192832:192.168.203.121@tcp:250:kworker.0
00000008:00100000:3.0:1787829244.051564:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787829244.051583:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057052c0 x1874670273192960/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829244.051611:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829244.051616:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787829244.051618:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829244.051622:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4407
00000100:00080000:3.0:1787829244.051627:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829244.051632:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000800:00000100:1.0:1787829244.051638:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000008:00100000:3.0:1787829244.051648:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829244.051665:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704780 x1874670273193088/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829244.051678:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829244.051681:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787829244.051684:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1787829244.051688:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829244/real 1787829244]  req@ffff9ee005706940 x1874670273192832/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829269 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829244.051692:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4407
00000100:00080000:3.0:1787829244.051701:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829244.051708:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787829244.051712:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706940 x1874670273192832/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829269 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:3.0:1787829244.051716:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:1.0:1787829244.051724:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829244.051728:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829244.051734:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273192832:192.168.203.121@tcp:250:kworker.0
00000100:00100000:3.0:1787829244.051736:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057043c0 x1874670273193216/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829244.051749:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1787829244.051754:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273192960:192.168.203.121@tcp:38:kworker.0
00000100:00080000:3.0:1787829244.051755:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787829244.051761:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829244.051778:0:27626:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4407
00000100:00080000:3.0:1787829244.051783:0:27626:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000800:00000100:1.0:1787829244.051785:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787829244.051794:0:27626:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787829244.051799:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829244/real 1787829244]  req@ffff9ee0057052c0 x1874670273192960/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829269 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:3.0:1787829244.051802:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787829244.051813:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057052c0 x1874670273192960/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829269 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829244.051820:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:3.0:1787829244.051824:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705a40 x1874670273193344/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829244.051825:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829244.051830:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273192960:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787829244.051840:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273193088:192.168.203.121@tcp:8:kworker.0
00000100:00080000:3.0:1787829244.051859:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:1.0:1787829244.051863:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787829244.051868:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787829244.051872:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1787829244.051874:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829244/real 1787829244]  req@ffff9ee005704780 x1874670273193088/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829269 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829244.051880:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4407
00000100:00100000:1.0:1787829244.051888:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704780 x1874670273193088/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829269 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829244.051889:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829244.051898:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829244.051899:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00080000:1.0:1787829244.051905:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829244.051909:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273193088:192.168.203.121@tcp:8:kworker.0
00000008:00100000:3.0:1787829244.051910:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787829244.051914:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273193216:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787829244.051931:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829244.051932:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704b40 x1874670273193472/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787829244.051940:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829244/real 1787829244]  req@ffff9ee0057043c0 x1874670273193216/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829269 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829244.051978:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1787829244.051984:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057043c0 x1874670273193216/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829269 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829244.051986:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787829244.051993:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829244.051996:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829244.052002:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00080000:3.0:1787829244.052005:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4407
00000100:00100000:1.0:1787829244.052007:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273193216:192.168.203.121@tcp:8:kworker.0
00000100:00080000:3.0:1787829244.052015:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829244.052023:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787829244.052047:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273193344:192.168.203.121@tcp:38:kworker.0
00000008:00100000:3.0:1787829244.052058:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1787829244.052077:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829244.052077:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706580 x1874670273193600/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787829244.052088:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829244/real 1787829244]  req@ffff9ee005705a40 x1874670273193344/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829269 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829244.052117:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705a40 x1874670273193344/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829269 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829244.052123:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829244.052126:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829244.052128:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273193344:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787829244.052133:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273193472:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787829244.052144:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829244.052150:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829244/real 1787829244]  req@ffff9ee005704b40 x1874670273193472/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829269 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829244.052156:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704b40 x1874670273193472/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829269 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829244.052179:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829244.052181:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829244.052183:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273193472:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787829244.052191:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273193600:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787829244.052201:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829244.052208:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829244/real 1787829244]  req@ffff9ee005706580 x1874670273193600/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829269 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829244.052215:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706580 x1874670273193600/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829269 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829244.052220:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829244.052222:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829244.052224:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273193600:192.168.203.121@tcp:8:kworker.0
00010000:00010000:3.0:1787829244.883446:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829245.075463:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787829245.907498:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829246.099397:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829246.931482:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829247.123431:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829247.955496:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829248.147386:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829248.979473:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829249.171382:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:2.0:1787829249.171392:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829249.171397:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787829249.171400:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829249.171408:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4412
00000100:00080000:2.0:1787829249.171416:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829249.171422:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787829249.171452:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729680 x1874670273193728/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829249.171476:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829249.171478:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787829249.171480:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829249.171482:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4412
00000100:00080000:2.0:1787829249.171485:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829249.171488:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829249.171495:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787829249.171505:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273193728:192.168.203.121@tcp:250:kworker.0
00000100:00100000:2.0:1787829249.171506:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057292c0 x1874670273193856/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829249.171519:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829249.171522:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787829249.171523:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829249.171525:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4412
00000100:00080000:2.0:1787829249.171528:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829249.171531:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829249.171534:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787829249.171543:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572bc00 x1874670273193984/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829249.171550:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829249.171552:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787829249.171553:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829249.171556:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4412
00000100:00080000:2.0:1787829249.171569:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829249.171574:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829249.171578:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787829249.171588:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728780 x1874670273194112/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829249.171594:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829249.171597:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787829249.171598:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829249.171601:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4412
00000100:00080000:2.0:1787829249.171604:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829249.171608:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829249.171611:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787829249.171619:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057292c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273193856:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787829249.171621:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a940 x1874670273194240/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829249.171631:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829249.171634:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787829249.171635:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829249.171638:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4412
00000100:00080000:2.0:1787829249.171640:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829249.171642:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829249.171646:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787829249.171655:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729e00 x1874670273194368/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787829249.171658:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273193984:192.168.203.121@tcp:8:kworker.0
00000100:00080000:2.0:1787829249.171675:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829249.171678:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787829249.171680:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1787829249.171683:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273194112:192.168.203.121@tcp:8:kworker.0
00000100:00080000:2.0:1787829249.171684:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4412
00000100:00080000:2.0:1787829249.171689:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829249.171693:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829249.171697:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787829249.171708:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a1c0 x1874670273194496/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787829249.171710:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273194240:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787829249.171739:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273194368:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787829249.171753:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273194496:192.168.203.121@tcp:8:kworker.0
00010000:00010000:3.0:1787829250.003474:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829250.195409:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787829251.027431:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829251.219409:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829252.051475:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829252.243400:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000400:00000100:3.0:1787829252.243532:0:2354:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.203.121:988
00000400:00000100:3.0:1787829252.243577:0:2354:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.203.121@tcp at host 192.168.203.121 was unreachable: the network or that node may be down, or Lustre may be misconfigured.
00000800:00000100:3.0:1787829252.243591:0:2354:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:3.0:1787829252.243622:0:2354:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:3.0:1787829252.243634:0:2354:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:3.0:1787829252.243647:0:2354:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:3.0:1787829252.243659:0:2354:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000100:00100000:1.0:1787829252.243660:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829249/real 1787829252]  req@ffff9ee0057292c0 x1874670273193856/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829274 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000800:00000100:3.0:1787829252.243671:0:2354:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:3.0:1787829252.243685:0:2354:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000100:00100000:1.0:1787829252.243696:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057292c0 x1874670273193856/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829274 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829252.243711:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829252.243717:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829252.243721:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057292c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273193856:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787829252.243730:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829249/real 1787829252]  req@ffff9ee00572bc00 x1874670273193984/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829274 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829252.243746:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572bc00 x1874670273193984/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829274 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829252.243755:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829252.243759:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829252.243763:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273193984:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787829252.243769:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829249/real 1787829252]  req@ffff9ee005728780 x1874670273194112/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829274 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829252.243784:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728780 x1874670273194112/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829274 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829252.243791:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829252.243794:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829252.243797:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273194112:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787829252.243804:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829249/real 1787829252]  req@ffff9ee005729680 x1874670273193728/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829274 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829252.243816:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729680 x1874670273193728/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829274 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829252.243825:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829252.243828:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829252.243832:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273193728:192.168.203.121@tcp:250:kworker.0
00000100:00100000:1.0:1787829252.243860:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829249/real 1787829252]  req@ffff9ee00572a1c0 x1874670273194496/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829274 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829252.243874:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a1c0 x1874670273194496/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829274 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829252.243882:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829252.243892:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829252.243896:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273194496:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787829252.243903:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829249/real 1787829252]  req@ffff9ee00572a940 x1874670273194240/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829274 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829252.243916:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a940 x1874670273194240/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829274 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829252.243925:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829252.243927:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829252.243930:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273194240:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787829252.243936:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829249/real 1787829252]  req@ffff9ee005729e00 x1874670273194368/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829274 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829252.243947:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729e00 x1874670273194368/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829274 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829252.243954:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829252.243958:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829252.243960:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273194368:192.168.203.121@tcp:8:kworker.0
00010000:00010000:0.0:1787829253.075522:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829253.267436:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829254.099426:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829254.291465:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:2.0:1787829254.291472:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829254.291484:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787829254.291489:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829254.291502:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4418
00000100:00080000:2.0:1787829254.291515:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829254.291542:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787829254.291580:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057283c0 x1874670273194624/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829254.291625:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829254.291629:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787829254.291631:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829254.291636:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4418
00000100:00080000:2.0:1787829254.291641:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829254.291658:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829254.291668:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787829254.291683:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728000 x1874670273194752/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829254.291696:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1787829254.291702:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273194624:192.168.203.121@tcp:250:kworker.0
00000100:00080000:2.0:1787829254.291703:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787829254.291708:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829254.291725:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4418
00000100:00080000:2.0:1787829254.291736:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829254.291743:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829254.291751:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787829254.291769:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a580 x1874670273194880/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829254.291781:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829254.291784:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787829254.291786:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829254.291791:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4418
00000100:00080000:2.0:1787829254.291798:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829254.291804:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829254.291809:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787829254.291826:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728b40 x1874670273195008/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1787829254.291841:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:2.0:1787829254.291850:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829254.291856:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787829254.291859:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829254.291867:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4418
00000100:00080000:2.0:1787829254.291875:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829254.291883:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829254.291889:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787829254.291905:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728f00 x1874670273195136/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829254.291917:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829254.291921:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787829254.291924:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1787829254.291932:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829254/real 1787829254]  req@ffff9ee0057283c0 x1874670273194624/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829279 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829254.291937:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4418
00000100:00080000:2.0:1787829254.291946:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829254.291962:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787829254.291969:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057283c0 x1874670273194624/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829279 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:2.0:1787829254.291970:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:1.0:1787829254.291997:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:2.0:1787829254.292000:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b840 x1874670273195264/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829254.292010:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829254.292022:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273194624:192.168.203.121@tcp:250:kworker.0
00000100:00080000:2.0:1787829254.292027:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829254.292035:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787829254.292038:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829254.292044:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4418
00000100:00080000:2.0:1787829254.292049:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829254.292054:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829254.292061:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787829254.292065:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273194752:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787829254.292096:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729a40 x1874670273195392/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1787829254.292110:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829254.292134:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829254/real 1787829254]  req@ffff9ee005728000 x1874670273194752/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829279 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829254.292150:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728000 x1874670273194752/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829279 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829254.292158:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829254.292162:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829254.292166:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273194752:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787829254.292175:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273194880:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787829254.292200:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829254.292214:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829254/real 1787829254]  req@ffff9ee00572a580 x1874670273194880/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829279 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829254.292227:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a580 x1874670273194880/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829279 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829254.292235:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829254.292239:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829254.292243:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273194880:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787829254.292250:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273195008:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787829254.292273:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829254.292286:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829254/real 1787829254]  req@ffff9ee005728b40 x1874670273195008/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829279 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829254.292298:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728b40 x1874670273195008/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829279 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829254.292306:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829254.292310:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829254.292343:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273195008:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787829254.292353:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273195136:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787829254.292375:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829254.292388:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829254/real 1787829254]  req@ffff9ee005728f00 x1874670273195136/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829279 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829254.292401:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728f00 x1874670273195136/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829279 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829254.292414:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829254.292421:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829254.292425:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273195136:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787829254.292433:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273195264:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787829254.292455:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829254.292471:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829254/real 1787829254]  req@ffff9ee00572b840 x1874670273195264/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829279 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829254.292495:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b840 x1874670273195264/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829279 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829254.292504:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829254.292508:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829254.292511:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273195264:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787829254.292570:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273195392:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787829254.292596:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829254.292609:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829254/real 1787829254]  req@ffff9ee005729a40 x1874670273195392/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829279 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829254.292622:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729a40 x1874670273195392/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829279 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829254.292631:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829254.292638:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829254.292641:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273195392:192.168.203.121@tcp:8:kworker.0
00010000:00010000:3.0:1787829255.123554:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829255.315413:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787829256.147447:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829256.339417:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829257.171442:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829257.363395:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829258.195550:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829258.387460:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829259.219589:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829259.411452:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787829259.411581:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829259.411592:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787829259.411597:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829259.411610:0:27626:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4423
00000100:00080000:3.0:1787829259.411623:0:27626:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829259.411633:0:27626:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787829259.411708:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705e00 x1874670273195520/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829259.411756:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829259.411764:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787829259.411768:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829259.411777:0:27626:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4423
00000100:00080000:3.0:1787829259.411786:0:27626:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829259.411796:0:27626:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787829259.411812:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273195520:192.168.203.121@tcp:250:kworker.0
00000008:00100000:3.0:1787829259.411814:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787829259.411847:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706d00 x1874670273195648/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829259.411866:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829259.411871:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787829259.411883:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829259.411889:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4423
00000100:00080000:3.0:1787829259.411895:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829259.411901:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829259.411908:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1787829259.411918:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829259.411928:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706580 x1874670273195776/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829259.411945:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829259.411950:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787829259.411952:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829259.411956:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4423
00000100:00080000:3.0:1787829259.411961:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829259.411966:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829259.411973:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829259.412001:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704b40 x1874670273195904/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787829259.412002:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829259/real 1787829259]  req@ffff9ee005705e00 x1874670273195520/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829284 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829259.412025:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829259.412037:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787829259.412043:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829259.412055:0:27626:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4423
00000100:00080000:3.0:1787829259.412060:0:27626:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829259.412066:0:27626:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829259.412073:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787829259.412084:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705e00 x1874670273195520/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829284 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829259.412088:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705a40 x1874670273196032/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829259.412146:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829259.412152:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787829259.412154:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829259.412156:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829259.412176:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:3.0:1787829259.412187:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4423
00000100:00100000:1.0:1787829259.412194:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273195520:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787829259.412196:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829259.412212:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829259.412223:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829259.412248:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057043c0 x1874670273196160/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787829259.412249:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273195648:192.168.203.121@tcp:38:kworker.0
00000100:00080000:3.0:1787829259.412283:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829259.412291:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787829259.412297:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:1.0:1787829259.412306:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787829259.412315:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4423
00000100:00100000:1.0:1787829259.412369:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829259/real 1787829259]  req@ffff9ee005706d00 x1874670273195648/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829284 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829259.412396:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706d00 x1874670273195648/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829284 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829259.412396:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829259.412418:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829259.412418:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00080000:1.0:1787829259.412442:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000008:00100000:3.0:1787829259.412447:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787829259.412449:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273195648:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787829259.412468:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273195776:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829259.412482:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704780 x1874670273196288/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1787829259.412539:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829259.412569:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829259/real 1787829259]  req@ffff9ee005706580 x1874670273195776/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829284 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829259.412584:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706580 x1874670273195776/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829284 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829259.412602:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829259.412607:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829259.412611:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273195776:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787829259.412618:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273195904:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787829259.412641:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829259.412652:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829259/real 1787829259]  req@ffff9ee005704b40 x1874670273195904/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829284 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829259.412666:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704b40 x1874670273195904/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829284 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829259.412676:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829259.412679:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829259.412683:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273195904:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787829259.412692:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273196032:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787829259.412710:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829259.412721:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829259/real 1787829259]  req@ffff9ee005705a40 x1874670273196032/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829284 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829259.412735:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705a40 x1874670273196032/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829284 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829259.412744:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829259.412747:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829259.412752:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273196032:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787829259.412774:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273196160:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787829259.412793:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829259.412805:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829259/real 1787829259]  req@ffff9ee0057043c0 x1874670273196160/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829284 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829259.412818:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057043c0 x1874670273196160/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829284 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829259.412828:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829259.412831:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829259.412835:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273196160:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787829259.412842:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273196288:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787829259.412860:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829259.412871:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829259/real 1787829259]  req@ffff9ee005704780 x1874670273196288/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829284 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829259.412894:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704780 x1874670273196288/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829284 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829259.412903:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829259.412906:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829259.412910:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273196288:192.168.203.121@tcp:8:kworker.0
00010000:00010000:3.0:1787829260.243572:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829260.435420:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787829261.267617:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829261.459390:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829262.291452:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829262.483365:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829263.315546:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829263.507415:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829264.339515:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1787829264.531414:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1787829264.531419:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787829264.531422:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787829264.531428:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829264.531436:0:27626:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4428
00000100:00080000:3.0:1787829264.531445:0:27626:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829264.531452:0:27626:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787829264.531525:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057052c0 x1874670273196416/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829264.531567:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829264.531572:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787829264.531574:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829264.531579:0:27626:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4428
00000100:00080000:3.0:1787829264.531584:0:27626:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829264.531589:0:27626:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829264.531600:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787829264.531618:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273196416:192.168.203.121@tcp:250:kworker.0
00000100:00100000:3.0:1787829264.531619:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706940 x1874670273196544/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829264.531641:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829264.531645:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787829264.531648:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829264.531652:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4428
00000100:00080000:3.0:1787829264.531656:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829264.531659:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829264.531665:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829264.531679:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704000 x1874670273196672/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829264.531690:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829264.531694:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787829264.531696:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829264.531699:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4428
00000800:00000100:1.0:1787829264.531708:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787829264.531709:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829264.531718:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829264.531724:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829264.531737:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707480 x1874670273196800/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829264.531766:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829264.531770:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787829264.531772:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829264.531777:0:27626:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4428
00000100:00080000:3.0:1787829264.531782:0:27626:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829264.531787:0:27626:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829264.531794:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787829264.531800:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829264/real 1787829264]  req@ffff9ee0057052c0 x1874670273196416/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829289 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829264.531816:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057070c0 x1874670273196928/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829264.531832:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1787829264.531856:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057052c0 x1874670273196416/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829289 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829264.531858:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787829264.531864:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829264.531879:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4428
00000100:00080000:1.0:1787829264.531883:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829264.531884:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829264.531896:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:3.0:1787829264.531897:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787829264.531905:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273196416:192.168.203.121@tcp:250:kworker.0
00000008:00100000:3.0:1787829264.531906:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829264.531926:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705680 x1874670273197056/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787829264.531940:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273196544:192.168.203.121@tcp:38:kworker.0
00000100:00080000:3.0:1787829264.531954:0:27626:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829264.531957:0:27626:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787829264.531960:0:27626:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829264.531966:0:27626:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4428
00000100:00080000:3.0:1787829264.531971:0:27626:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829264.531978:0:27626:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000800:00000100:1.0:1787829264.531980:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000008:00100000:3.0:1787829264.531983:0:27626:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829264.531998:0:27626:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707840 x1874670273197184/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787829264.532009:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829264/real 1787829264]  req@ffff9ee005706940 x1874670273196544/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829289 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829264.532033:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706940 x1874670273196544/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829289 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829264.532048:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829264.532054:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829264.532060:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273196544:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787829264.532069:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273196672:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787829264.532097:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829264.532109:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829264/real 1787829264]  req@ffff9ee005704000 x1874670273196672/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829289 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829264.532121:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704000 x1874670273196672/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829289 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829264.532128:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829264.532131:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829264.532134:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273196672:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787829264.532139:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273196800:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787829264.532154:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829264.532162:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829264/real 1787829264]  req@ffff9ee005707480 x1874670273196800/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829289 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829264.532172:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707480 x1874670273196800/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829289 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829264.532180:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829264.532182:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829264.532185:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273196800:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787829264.532189:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273196928:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787829264.532202:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829264.532210:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829264/real 1787829264]  req@ffff9ee0057070c0 x1874670273196928/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829289 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829264.532227:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057070c0 x1874670273196928/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829289 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829264.532234:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829264.532236:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829264.532239:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273196928:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787829264.532255:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273197056:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787829264.532269:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829264.532298:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829264/real 1787829264]  req@ffff9ee005705680 x1874670273197056/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829289 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829264.532310:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705680 x1874670273197056/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829289 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829264.532319:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829264.532323:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829264.532326:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273197056:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787829264.532333:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273197184:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787829264.532381:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829264.532395:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829264/real 1787829264]  req@ffff9ee005707840 x1874670273197184/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829289 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829264.532407:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707840 x1874670273197184/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829289 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829264.532423:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829264.532427:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829264.532431:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273197184:192.168.203.121@tcp:8:kworker.0
00010000:00010000:3.0:1787829265.363527:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829265.555416:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787829266.387528:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829266.579467:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829267.411540:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829267.603457:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829268.435613:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829268.627458:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829269.459486:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829269.651385:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787829269.651436:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829269.651443:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787829269.651447:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829269.651457:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4433
00000100:00080000:3.0:1787829269.651468:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829269.651487:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787829269.651523:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057061c0 x1874670273197312/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829269.651552:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829269.651556:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787829269.651558:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829269.651563:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4433
00000100:00080000:3.0:1787829269.651569:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829269.651575:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787829269.651579:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273197312:192.168.203.121@tcp:250:kworker.0
00000008:00100000:3.0:1787829269.651587:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787829269.651607:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707c00 x1874670273197440/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829269.651620:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829269.651623:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787829269.651626:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829269.651630:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4433
00000100:00080000:3.0:1787829269.651634:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000800:00000100:1.0:1787829269.651638:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787829269.651643:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829269.651650:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829269.651665:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707840 x1874670273197568/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787829269.651673:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829269/real 1787829269]  req@ffff9ee0057061c0 x1874670273197312/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829294 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829269.651678:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1787829269.651691:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057061c0 x1874670273197312/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829294 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829269.651696:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787829269.651700:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829269.651704:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829269.651709:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4433
00000100:00080000:1.0:1787829269.651712:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829269.651717:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273197312:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787829269.651718:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829269.651727:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829269.651732:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787829269.651738:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273197440:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787829269.651748:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705680 x1874670273197696/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1787829269.651759:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787829269.651772:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1787829269.651777:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829269/real 1787829269]  req@ffff9ee005707c00 x1874670273197440/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829294 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829269.651779:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787829269.651783:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829269.651792:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4433
00000100:00080000:3.0:1787829269.651798:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1787829269.651803:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707c00 x1874670273197440/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829294 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829269.651815:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00080000:1.0:1787829269.651823:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000008:00100000:3.0:1787829269.651825:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00080000:1.0:1787829269.651828:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829269.651833:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273197440:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787829269.651838:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273197568:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829269.651844:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057070c0 x1874670273197824/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829269.651853:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829269.651856:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787829269.651858:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:1.0:1787829269.651861:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787829269.651865:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4433
00000100:00080000:3.0:1787829269.651870:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829269.651876:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787829269.651877:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829269/real 1787829269]  req@ffff9ee005707840 x1874670273197568/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829294 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:3.0:1787829269.651880:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829269.651905:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707480 x1874670273197952/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787829269.651910:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707840 x1874670273197568/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829294 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829269.651915:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829269.651923:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787829269.651926:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829269.651933:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829269.651933:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4433
00000100:00080000:3.0:1787829269.651941:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829269.651943:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00080000:3.0:1787829269.651947:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787829269.651951:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273197568:192.168.203.121@tcp:8:kworker.0
00000008:00100000:3.0:1787829269.651953:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787829269.651967:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273197696:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829269.651972:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704000 x1874670273198080/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1787829269.651990:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829269.652012:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829269/real 1787829269]  req@ffff9ee005705680 x1874670273197696/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829294 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829269.652020:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705680 x1874670273197696/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829294 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829269.652033:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829269.652035:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829269.652038:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273197696:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787829269.652042:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273197824:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787829269.652053:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829269.652059:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829269/real 1787829269]  req@ffff9ee0057070c0 x1874670273197824/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829294 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829269.652067:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057070c0 x1874670273197824/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829294 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829269.652072:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829269.652074:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829269.652076:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273197824:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787829269.652079:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273197952:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787829269.652088:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829269.652093:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829269/real 1787829269]  req@ffff9ee005707480 x1874670273197952/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829294 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829269.652100:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707480 x1874670273197952/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829294 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829269.652105:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829269.652106:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829269.652108:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273197952:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787829269.652116:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273198080:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787829269.652125:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829269.652131:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829269/real 1787829269]  req@ffff9ee005704000 x1874670273198080/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829294 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829269.652138:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704000 x1874670273198080/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829294 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829269.652143:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829269.652145:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829269.652147:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273198080:192.168.203.121@tcp:8:kworker.0
00010000:00010000:3.0:1787829270.483446:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829270.675394:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787829271.507492:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829271.699448:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829272.531506:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829272.723484:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829273.555487:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829273.747469:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829274.579561:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829274.771479:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:0.0:1787829274.771525:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829274.771538:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1787829274.771543:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829274.771555:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4438
00000100:00080000:0.0:1787829274.771567:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829274.771576:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787829274.771618:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ea940 x1874670273198208/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829274.771653:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829274.771658:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787829274.771661:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829274.771668:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4438
00000100:00080000:0.0:1787829274.771674:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829274.771680:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787829274.771687:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273198208:192.168.203.121@tcp:250:kworker.0
00000008:00100000:0.0:1787829274.771693:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787829274.771716:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ead00 x1874670273198336/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829274.771732:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829274.771737:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787829274.771740:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829274.771746:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4438
00000100:00080000:0.0:1787829274.771751:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000800:00000100:1.0:1787829274.771756:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:0.0:1787829274.771762:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829274.771772:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787829274.771791:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8780 x1874670273198464/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787829274.771800:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829274/real 1787829274]  req@ffff9ee0056ea940 x1874670273198208/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829299 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829274.771819:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829274.771826:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:1.0:1787829274.771828:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ea940 x1874670273198208/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829299 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829274.771831:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829274.771844:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4438
00000100:00080000:0.0:1787829274.771849:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829274.771857:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00080000:1.0:1787829274.771861:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000008:00100000:0.0:1787829274.771865:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:1.0:1787829274.771868:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829274.771875:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273198208:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787829274.771891:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9680 x1874670273198592/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787829274.771901:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273198336:192.168.203.121@tcp:38:kworker.0
00000100:00080000:0.0:1787829274.771914:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829274.771920:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787829274.771924:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:1.0:1787829274.771931:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:0.0:1787829274.771937:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4438
00000100:00080000:0.0:1787829274.771946:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1787829274.771950:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829274/real 1787829274]  req@ffff9ee0056ead00 x1874670273198336/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829299 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829274.771958:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829274.771972:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787829274.771972:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ead00 x1874670273198336/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829299 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829274.771986:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829274.771989:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829274.772000:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273198336:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787829274.772001:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ea580 x1874670273198720/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787829274.772016:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273198464:192.168.203.121@tcp:8:kworker.0
00000100:00080000:0.0:1787829274.772025:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829274.772032:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787829274.772035:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829274.772043:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4438
00000100:00080000:0.0:1787829274.772050:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000800:00000100:1.0:1787829274.772058:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:0.0:1787829274.772063:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829274.772072:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787829274.772078:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829274/real 1787829274]  req@ffff9ee0056e8780 x1874670273198464/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829299 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829274.772098:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8780 x1874670273198464/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829299 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829274.772106:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9a40 x1874670273198848/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829274.772125:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829274.772131:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829274.772133:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787829274.772140:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829274.772143:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00080000:0.0:1787829274.772153:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4438
00000100:00100000:1.0:1787829274.772155:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273198464:192.168.203.121@tcp:8:kworker.0
00000100:00080000:0.0:1787829274.772164:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829274.772171:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829274.772177:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787829274.772185:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273198592:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829274.772194:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb0c0 x1874670273198976/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1787829274.772225:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829274.772239:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829274/real 1787829274]  req@ffff9ee0056e9680 x1874670273198592/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829299 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829274.772250:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9680 x1874670273198592/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829299 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829274.772258:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829274.772261:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829274.772263:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273198592:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787829274.772268:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273198720:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787829274.772284:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829274.772291:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829274/real 1787829274]  req@ffff9ee0056ea580 x1874670273198720/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829299 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829274.772301:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ea580 x1874670273198720/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829299 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829274.772307:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829274.772310:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829274.772312:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273198720:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787829274.772339:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273198848:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787829274.772355:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829274.772364:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829274/real 1787829274]  req@ffff9ee0056e9a40 x1874670273198848/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829299 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829274.772374:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9a40 x1874670273198848/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829299 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829274.772380:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829274.772414:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829274.772418:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273198848:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787829274.772434:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273198976:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787829274.772453:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829274.772473:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829274/real 1787829274]  req@ffff9ee0056eb0c0 x1874670273198976/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829299 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829274.772483:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb0c0 x1874670273198976/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829299 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829274.772490:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829274.772492:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829274.772495:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273198976:192.168.203.121@tcp:8:kworker.0
00010000:00010000:3.0:1787829275.603483:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829275.795450:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787829276.627509:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829276.819481:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829277.651546:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829277.843413:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829278.675545:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829278.867438:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829279.699486:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829279.891402:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:1.0:1787829279.891437:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829279.891446:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1787829279.891451:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829279.891461:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4443
00000100:00080000:1.0:1787829279.891489:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829279.891497:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787829279.891535:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0780 x1874670273199104/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829279.891585:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829279.891589:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787829279.891591:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829279.891595:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4443
00000100:00080000:1.0:1787829279.891599:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829279.891605:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829279.891636:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787829279.891651:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273199104:192.168.203.121@tcp:250:kworker.0
00000100:00100000:1.0:1787829279.891651:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0000 x1874670273199232/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829279.891659:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829279.891665:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787829279.891666:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829279.891669:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4443
00000100:00080000:1.0:1787829279.891671:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829279.891673:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829279.891677:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787829279.891684:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a2580 x1874670273199360/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829279.891691:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829279.891693:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787829279.891694:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829279.891697:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4443
00000100:00080000:1.0:1787829279.891706:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829279.891709:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829279.891712:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:0.0:1787829279.891717:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829279.891724:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0b40 x1874670273199488/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829279.891732:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829279.891734:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787829279.891736:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829279.891739:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4443
00000100:00080000:1.0:1787829279.891741:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829279.891744:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829279.891747:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787829279.891754:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829279/real 1787829279]  req@ffff9ee0056a0780 x1874670273199104/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829304 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829279.891758:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a30c0 x1874670273199616/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829279.891778:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829279.891781:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787829279.891782:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829279.891786:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4443
00000100:00100000:0.0:1787829279.891788:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0780 x1874670273199104/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829304 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829279.891789:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829279.891794:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829279.891799:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787829279.891807:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a3480 x1874670273199744/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829279.891822:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829279.891823:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829279.891825:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787829279.891828:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829279.891835:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4443
00000100:00080000:0.0:1787829279.891836:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:1.0:1787829279.891837:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829279.891843:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787829279.891848:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273199104:192.168.203.121@tcp:250:kworker.0
00000008:00100000:1.0:1787829279.891849:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787829279.891858:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1e00 x1874670273199872/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787829279.891882:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273199232:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787829279.891910:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829279.891924:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829279/real 1787829279]  req@ffff9ee0056a0000 x1874670273199232/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829304 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829279.891934:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0000 x1874670273199232/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829304 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829279.891940:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829279.891942:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829279.891945:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273199232:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787829279.891949:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273199360:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829279.891964:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829279.891971:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829279/real 1787829279]  req@ffff9ee0056a2580 x1874670273199360/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829304 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829279.891978:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a2580 x1874670273199360/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829304 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829279.891983:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829279.891985:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829279.891988:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273199360:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829279.891991:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273199488:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829279.892002:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829279.892007:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829279/real 1787829279]  req@ffff9ee0056a0b40 x1874670273199488/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829304 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829279.892015:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0b40 x1874670273199488/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829304 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829279.892019:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829279.892022:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829279.892025:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273199488:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829279.892030:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273199616:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787829279.892058:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829279.892070:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829279/real 1787829279]  req@ffff9ee0056a30c0 x1874670273199616/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829304 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829279.892083:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a30c0 x1874670273199616/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829304 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829279.892090:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829279.892092:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829279.892095:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273199616:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787829279.892099:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273199744:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829279.892124:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829279.892132:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829279/real 1787829279]  req@ffff9ee0056a3480 x1874670273199744/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829304 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829279.892144:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a3480 x1874670273199744/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829304 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829279.892149:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829279.892150:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829279.892152:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273199744:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829279.892156:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273199872:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829279.892187:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829279.892194:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829279/real 1787829279]  req@ffff9ee0056a1e00 x1874670273199872/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829304 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829279.892204:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1e00 x1874670273199872/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829304 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829279.892210:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829279.892213:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829279.892215:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273199872:192.168.203.121@tcp:8:kworker.0
00010000:00010000:3.0:1787829280.723530:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829280.915458:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787829281.747497:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829281.939392:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829282.771489:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829282.963410:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829283.795503:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829283.987384:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829284.819562:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829285.011398:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:1.0:1787829285.011421:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829285.011429:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1787829285.011433:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829285.011443:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4448
00000100:00080000:1.0:1787829285.011454:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829285.011461:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787829285.011497:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a03c0 x1874670273200000/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829285.011525:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829285.011528:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787829285.011530:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829285.011535:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4448
00000100:00080000:1.0:1787829285.011539:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829285.011544:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829285.011555:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787829285.011557:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273200000:192.168.203.121@tcp:250:kworker.0
00000100:00100000:1.0:1787829285.011571:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a2940 x1874670273200128/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829285.011585:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829285.011588:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787829285.011591:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829285.011595:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4448
00000100:00080000:1.0:1787829285.011607:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000800:00000100:0.0:1787829285.011613:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:1.0:1787829285.011617:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829285.011625:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787829285.011640:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a21c0 x1874670273200256/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787829285.011649:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829285/real 1787829285]  req@ffff9ee0056a03c0 x1874670273200000/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829310 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829285.011655:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829285.011663:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787829285.011665:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1787829285.011669:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a03c0 x1874670273200000/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829310 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829285.011671:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4448
00000100:00080000:1.0:1787829285.011678:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829285.011684:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829285.011685:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00080000:0.0:1787829285.011691:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000008:00100000:1.0:1787829285.011694:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787829285.011697:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273200000:192.168.203.121@tcp:250:kworker.0
00000100:00100000:1.0:1787829285.011713:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1680 x1874670273200384/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787829285.011719:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273200128:192.168.203.121@tcp:38:kworker.0
00000100:00080000:1.0:1787829285.011733:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829285.011738:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787829285.011750:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:0.0:1787829285.011755:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:1.0:1787829285.011760:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4448
00000100:00080000:1.0:1787829285.011766:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1787829285.011768:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829285/real 1787829285]  req@ffff9ee0056a2940 x1874670273200128/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829310 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829285.011774:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829285.011783:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787829285.011784:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a2940 x1874670273200128/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829310 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829285.011794:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829285.011797:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829285.011803:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273200128:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787829285.011804:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0f00 x1874670273200512/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787829285.011810:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273200256:192.168.203.121@tcp:8:kworker.0
00000100:00080000:1.0:1787829285.011826:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:0.0:1787829285.011831:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829285.011839:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829285/real 1787829285]  req@ffff9ee0056a21c0 x1874670273200256/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829310 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829285.011840:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787829285.011844:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1787829285.011851:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a21c0 x1874670273200256/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829310 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829285.011859:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4448
00000100:00080000:0.0:1787829285.011864:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829285.011867:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829285.011869:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829285.011878:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273200256:192.168.203.121@tcp:8:kworker.0
00000100:00080000:1.0:1787829285.011878:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829285.011888:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787829285.011895:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273200384:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787829285.011906:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a3c00 x1874670273200640/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1787829285.011911:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829285.011922:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829285/real 1787829285]  req@ffff9ee0056a1680 x1874670273200384/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829310 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829285.011944:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1787829285.011946:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1680 x1874670273200384/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829310 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829285.011950:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787829285.011953:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829285.011962:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829285.011963:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4448
00000100:00080000:0.0:1787829285.011970:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00080000:1.0:1787829285.011972:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1787829285.011975:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273200384:192.168.203.121@tcp:8:kworker.0
00000100:00080000:1.0:1787829285.011993:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787829285.011994:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273200512:192.168.203.121@tcp:38:kworker.0
00000008:00100000:1.0:1787829285.012004:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:0.0:1787829285.012011:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829285.012021:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1a40 x1874670273200768/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787829285.012022:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829285/real 1787829285]  req@ffff9ee0056a0f00 x1874670273200512/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829310 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829285.012055:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0f00 x1874670273200512/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829310 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829285.012061:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829285.012063:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829285.012065:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273200512:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787829285.012077:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273200640:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829285.012089:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829285.012095:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829285/real 1787829285]  req@ffff9ee0056a3c00 x1874670273200640/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829310 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829285.012102:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a3c00 x1874670273200640/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829310 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829285.012107:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829285.012109:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829285.012111:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273200640:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829285.012115:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273200768:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829285.012124:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829285.012129:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829285/real 1787829285]  req@ffff9ee0056a1a40 x1874670273200768/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829310 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829285.012136:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1a40 x1874670273200768/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829310 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829285.012141:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829285.012143:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829285.012145:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273200768:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787829285.843475:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829286.035384:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787829286.867483:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829287.059378:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829287.891423:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829288.083407:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829288.915511:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829289.107372:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829289.939501:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829290.131500:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:1.0:1787829290.131508:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829290.131523:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1787829290.131529:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829290.131543:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4453
00000100:00080000:1.0:1787829290.131556:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829290.131582:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787829290.131621:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a12c0 x1874670273200896/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829290.131670:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829290.131674:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787829290.131677:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829290.131685:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4453
00000100:00080000:1.0:1787829290.131690:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829290.131695:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829290.131707:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787829290.131718:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273200896:192.168.203.121@tcp:250:kworker.0
00000100:00100000:1.0:1787829290.131726:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1a40 x1874670273201024/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829290.131740:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829290.131744:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787829290.131747:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829290.131754:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4453
00000100:00080000:1.0:1787829290.131758:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829290.131762:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829290.131769:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787829290.131787:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a3c00 x1874670273201152/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829290.131798:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829290.131801:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787829290.131804:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829290.131811:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4453
00000800:00000100:3.0:1787829290.131820:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:1.0:1787829290.131824:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829290.131831:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829290.131839:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787829290.131855:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0f00 x1874670273201280/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829290.131869:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829290.131873:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787829290.131876:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829290.131882:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4453
00000100:00080000:1.0:1787829290.131922:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829290.131927:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829290.131932:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787829290.131949:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1680 x1874670273201408/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829290.131975:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829290.131987:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787829290.131989:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829290.131993:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4453
00000100:00080000:1.0:1787829290.131999:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829290.132002:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829290.132008:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787829290.132017:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a21c0 x1874670273201536/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829290.132025:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829290.132028:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787829290.132029:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829290.132032:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4453
00000100:00080000:1.0:1787829290.132034:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829290.132037:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829290.132042:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787829290.132051:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a2940 x1874670273201664/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787829290.132070:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829290/real 1787829290]  req@ffff9ee0056a12c0 x1874670273200896/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829315 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829290.132127:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a12c0 x1874670273200896/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829315 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829290.132153:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829290.132159:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829290.132166:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273200896:192.168.203.121@tcp:250:kworker.0
00000100:00100000:3.0:1787829290.132198:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273201024:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787829290.132223:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829290.132235:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829290/real 1787829290]  req@ffff9ee0056a1a40 x1874670273201024/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829315 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829290.132244:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1a40 x1874670273201024/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829315 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829290.132250:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829290.132253:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829290.132255:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273201024:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787829290.132259:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273201152:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829290.132271:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829290.132293:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829290/real 1787829290]  req@ffff9ee0056a3c00 x1874670273201152/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829315 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829290.132302:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a3c00 x1874670273201152/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829315 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829290.132307:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829290.132310:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829290.132312:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273201152:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829290.132342:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273201280:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829290.132370:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829290.132381:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829290/real 1787829290]  req@ffff9ee0056a0f00 x1874670273201280/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829315 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829290.132390:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0f00 x1874670273201280/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829315 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829290.132400:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829290.132403:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829290.132406:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273201280:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829290.132411:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273201408:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787829290.132425:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829290.132433:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829290/real 1787829290]  req@ffff9ee0056a1680 x1874670273201408/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829315 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829290.132443:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1680 x1874670273201408/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829315 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829290.132449:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829290.132451:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829290.132453:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273201408:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787829290.132457:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273201536:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829290.132467:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829290.132473:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829290/real 1787829290]  req@ffff9ee0056a21c0 x1874670273201536/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829315 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829290.132480:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a21c0 x1874670273201536/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829315 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829290.132485:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829290.132487:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829290.132490:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273201536:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829290.132494:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273201664:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829290.132505:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829290.132510:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829290/real 1787829290]  req@ffff9ee0056a2940 x1874670273201664/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829315 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829290.132517:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a2940 x1874670273201664/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829315 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829290.132522:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829290.132524:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829290.132526:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273201664:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787829290.963480:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829291.155429:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787829291.987516:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829292.179380:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829293.011471:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829293.203432:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829294.035587:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829294.227408:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829295.059452:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829295.251461:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:2.0:1787829295.251465:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829295.251473:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787829295.251478:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829295.251487:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4458
00000100:00080000:2.0:1787829295.251496:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829295.251504:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787829295.251537:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b0c0 x1874670273201792/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829295.251564:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829295.251568:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787829295.251570:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829295.251574:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4458
00000100:00080000:2.0:1787829295.251578:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829295.251582:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829295.251593:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787829295.251605:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273201792:192.168.203.121@tcp:250:kworker.0
00000100:00100000:2.0:1787829295.251610:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b480 x1874670273201920/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829295.251624:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829295.251628:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787829295.251630:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829295.251635:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4458
00000100:00080000:2.0:1787829295.251640:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829295.251644:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829295.251650:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787829295.251664:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572ad00 x1874670273202048/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1787829295.251678:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:2.0:1787829295.251689:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829295.251693:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787829295.251696:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829295.251701:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4458
00000100:00080000:2.0:1787829295.251705:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829295.251710:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829295.251716:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829295.251726:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829295/real 1787829295]  req@ffff9ee00572b0c0 x1874670273201792/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829320 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829295.251732:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729a40 x1874670273202176/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829295.251755:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829295.251760:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00100000:3.0:1787829295.251761:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b0c0 x1874670273201792/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829320 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829295.251764:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829295.251774:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4458
00000100:00080000:2.0:1787829295.251781:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829295.251783:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829295.251788:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00080000:3.0:1787829295.251794:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000008:00100000:2.0:1787829295.251797:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787829295.251801:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273201792:192.168.203.121@tcp:250:kworker.0
00000100:00100000:2.0:1787829295.251814:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b840 x1874670273202304/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787829295.251825:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273201920:192.168.203.121@tcp:38:kworker.0
00000100:00080000:2.0:1787829295.251830:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829295.251835:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787829295.251838:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829295.251844:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4458
00000100:00080000:2.0:1787829295.251849:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000800:00000100:3.0:1787829295.251854:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:2.0:1787829295.251858:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829295.251865:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829295.251868:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829295/real 1787829295]  req@ffff9ee00572b480 x1874670273201920/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829320 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829295.251881:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728f00 x1874670273202432/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787829295.251886:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b480 x1874670273201920/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829320 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829295.251903:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829295.251907:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829295.251909:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787829295.251914:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829295.251916:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00080000:2.0:1787829295.251925:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4458
00000100:00100000:3.0:1787829295.251926:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273201920:192.168.203.121@tcp:38:kworker.0
00000100:00080000:2.0:1787829295.251932:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1787829295.251937:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273202048:192.168.203.121@tcp:8:kworker.0
00000100:00080000:2.0:1787829295.251940:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829295.251949:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:3.0:1787829295.251967:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829295.251968:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728b40 x1874670273202560/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787829295.251985:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829295/real 1787829295]  req@ffff9ee00572ad00 x1874670273202048/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829320 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829295.252001:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572ad00 x1874670273202048/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829320 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829295.252010:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829295.252014:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829295.252017:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273202048:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829295.252024:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273202176:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829295.252045:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829295.252057:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829295/real 1787829295]  req@ffff9ee005729a40 x1874670273202176/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829320 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829295.252076:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729a40 x1874670273202176/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829320 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829295.252082:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829295.252084:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829295.252086:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273202176:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829295.252100:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273202304:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787829295.252114:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829295.252122:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829295/real 1787829295]  req@ffff9ee00572b840 x1874670273202304/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829320 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829295.252129:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b840 x1874670273202304/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829320 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829295.252134:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829295.252136:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829295.252137:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273202304:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787829295.252141:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273202432:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829295.252151:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829295.252156:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829295/real 1787829295]  req@ffff9ee005728f00 x1874670273202432/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829320 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829295.252163:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728f00 x1874670273202432/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829320 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829295.252172:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829295.252174:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829295.252176:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273202432:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829295.252179:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273202560:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829295.252188:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829295.252194:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829295/real 1787829295]  req@ffff9ee005728b40 x1874670273202560/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829320 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829295.252200:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728b40 x1874670273202560/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829320 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829295.252204:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829295.252206:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829295.252208:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273202560:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787829296.083519:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829296.275438:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787829297.107462:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829297.299516:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829298.131509:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829298.323427:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829299.155522:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829299.347408:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829300.179422:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829300.371405:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:0.0:1787829300.371408:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829300.371416:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1787829300.371420:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829300.371429:0:27707:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4464
00000100:00080000:0.0:1787829300.371438:0:27707:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829300.371443:0:27707:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787829300.371475:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8b40 x1874670273202688/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829300.371497:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829300.371499:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787829300.371501:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829300.371503:0:27707:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4464
00000100:00080000:0.0:1787829300.371506:0:27707:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829300.371508:0:27707:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829300.371516:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787829300.371525:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e92c0 x1874670273202816/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829300.371534:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1787829300.371536:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273202688:192.168.203.121@tcp:250:kworker.0
00000100:00080000:0.0:1787829300.371538:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787829300.371543:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829300.371547:0:27707:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4464
00000100:00080000:0.0:1787829300.371549:0:27707:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829300.371552:0:27707:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829300.371555:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787829300.371564:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb840 x1874670273202944/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829300.371577:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829300.371579:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787829300.371581:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829300.371583:0:27707:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4464
00000100:00080000:0.0:1787829300.371588:0:27707:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829300.371590:0:27707:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829300.371593:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:3.0:1787829300.371599:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829300.371603:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb480 x1874670273203072/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829300.371611:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829300.371614:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787829300.371615:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829300.371618:0:27707:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4464
00000100:00080000:0.0:1787829300.371621:0:27707:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829300.371623:0:27707:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829300.371627:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787829300.371637:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829300/real 1787829300]  req@ffff9ee0056e8b40 x1874670273202688/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829325 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829300.371638:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9e00 x1874670273203200/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829300.371653:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829300.371655:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787829300.371656:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829300.371663:0:27707:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4464
00000100:00080000:0.0:1787829300.371669:0:27707:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829300.371672:0:27707:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829300.371675:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829300.371677:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8b40 x1874670273202688/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829325 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829300.371686:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8000 x1874670273203328/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829300.371689:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829300.371700:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:0.0:1787829300.371703:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1787829300.371707:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273202688:192.168.203.121@tcp:250:kworker.0
00000100:00080000:0.0:1787829300.371711:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787829300.371716:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829300.371722:0:27707:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4464
00000100:00080000:0.0:1787829300.371726:0:27707:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1787829300.371730:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273202816:192.168.203.121@tcp:38:kworker.0
00000100:00080000:0.0:1787829300.371736:0:27707:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829300.371744:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:3.0:1787829300.371755:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829300.371761:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e83c0 x1874670273203456/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787829300.371768:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829300/real 1787829300]  req@ffff9ee0056e92c0 x1874670273202816/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829325 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829300.371781:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e92c0 x1874670273202816/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829325 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829300.371789:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829300.371792:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829300.371795:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273202816:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787829300.371799:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273202944:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829300.371813:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829300.371819:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829300/real 1787829300]  req@ffff9ee0056eb840 x1874670273202944/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829325 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829300.371827:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb840 x1874670273202944/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829325 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829300.371833:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829300.371835:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829300.371837:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273202944:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829300.371840:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273203072:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829300.371850:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829300.371856:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829300/real 1787829300]  req@ffff9ee0056eb480 x1874670273203072/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829325 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829300.371864:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb480 x1874670273203072/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829325 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829300.371870:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829300.371871:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829300.371873:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273203072:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829300.371877:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273203200:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787829300.371886:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829300.371892:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829300/real 1787829300]  req@ffff9ee0056e9e00 x1874670273203200/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829325 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829300.371899:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9e00 x1874670273203200/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829325 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829300.371904:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829300.371906:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829300.371908:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273203200:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787829300.371912:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273203328:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829300.371930:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829300.371937:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829300/real 1787829300]  req@ffff9ee0056e8000 x1874670273203328/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829325 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829300.371944:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8000 x1874670273203328/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829325 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829300.371950:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829300.371952:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829300.371954:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273203328:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829300.371966:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273203456:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829300.371977:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829300.371983:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829300/real 1787829300]  req@ffff9ee0056e83c0 x1874670273203456/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829325 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829300.371990:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e83c0 x1874670273203456/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829325 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829300.371995:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829300.371997:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829300.371999:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273203456:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787829301.203469:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829301.395432:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787829302.227667:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829302.419454:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829303.251510:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829303.443381:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829304.275538:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829304.467425:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829305.299508:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829305.491420:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787829305.491462:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829305.491470:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787829305.491474:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829305.491482:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4469
00000100:00080000:3.0:1787829305.491492:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829305.491500:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787829305.491535:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706940 x1874670273203584/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829305.491555:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829305.491559:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787829305.491560:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829305.491562:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4469
00000100:00080000:3.0:1787829305.491565:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829305.491568:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829305.491576:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787829305.491585:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057052c0 x1874670273203712/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787829305.491591:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273203584:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787829305.491595:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829305.491610:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787829305.491611:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829305.491614:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4469
00000100:00080000:3.0:1787829305.491616:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829305.491618:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829305.491622:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829305.491631:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704780 x1874670273203840/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829305.491638:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829305.491641:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787829305.491642:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829305.491644:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4469
00000100:00080000:3.0:1787829305.491646:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829305.491649:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829305.491653:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:0.0:1787829305.491660:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829305.491662:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057043c0 x1874670273203968/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829305.491671:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829305.491673:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787829305.491674:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829305.491678:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4469
00000100:00080000:3.0:1787829305.491680:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829305.491682:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829305.491685:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787829305.491692:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705a40 x1874670273204096/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829305.491698:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1787829305.491700:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829305/real 1787829305]  req@ffff9ee005706940 x1874670273203584/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829330 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829305.491701:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787829305.491704:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829305.491712:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4469
00000100:00080000:3.0:1787829305.491716:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829305.491718:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829305.491721:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787829305.491731:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706940 x1874670273203584/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829330 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829305.491732:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704b40 x1874670273204224/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829305.491764:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829305.491766:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829305.491767:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787829305.491771:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829305.491775:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:3.0:1787829305.491779:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4469
00000100:00100000:0.0:1787829305.491783:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273203584:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787829305.491784:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829305.491791:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829305.491795:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829305.491806:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706580 x1874670273204352/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787829305.491808:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273203712:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787829305.491834:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829305.491845:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829305/real 1787829305]  req@ffff9ee0057052c0 x1874670273203712/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829330 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829305.491854:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057052c0 x1874670273203712/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829330 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829305.491860:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829305.491862:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829305.491865:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273203712:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787829305.491869:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273203840:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829305.491887:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829305.491899:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829305/real 1787829305]  req@ffff9ee005704780 x1874670273203840/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829330 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829305.491912:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704780 x1874670273203840/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829330 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829305.491920:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829305.491923:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829305.491927:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273203840:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829305.491933:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273203968:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829305.491955:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829305.491969:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829305/real 1787829305]  req@ffff9ee0057043c0 x1874670273203968/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829330 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829305.491983:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057043c0 x1874670273203968/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829330 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829305.491990:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829305.491994:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829305.491997:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273203968:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829305.492004:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273204096:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787829305.492025:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829305.492038:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829305/real 1787829305]  req@ffff9ee005705a40 x1874670273204096/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829330 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829305.492051:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705a40 x1874670273204096/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829330 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829305.492059:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829305.492062:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829305.492066:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273204096:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787829305.492072:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273204224:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829305.492095:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829305.492108:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829305/real 1787829305]  req@ffff9ee005704b40 x1874670273204224/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829330 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829305.492129:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704b40 x1874670273204224/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829330 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829305.492137:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829305.492141:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829305.492144:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273204224:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829305.492164:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273204352:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829305.492199:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829305.492208:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829305/real 1787829305]  req@ffff9ee005706580 x1874670273204352/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829330 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829305.492216:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706580 x1874670273204352/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829330 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829305.492221:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829305.492223:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829305.492225:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273204352:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787829306.323504:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829306.515426:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787829307.347524:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829307.539470:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829308.371557:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829308.563439:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829309.395492:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829309.587473:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829310.419527:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1787829310.611378:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829310.611390:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787829310.611394:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1787829310.611403:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787829310.611407:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4474
00000100:00080000:3.0:1787829310.611422:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829310.611431:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787829310.611477:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706d00 x1874670273204480/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829310.611506:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829310.611509:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787829310.611515:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829310.611518:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4474
00000100:00080000:3.0:1787829310.611521:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829310.611524:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829310.611537:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787829310.611551:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705e00 x1874670273204608/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787829310.611558:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273204480:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787829310.611573:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829310.611578:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787829310.611580:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829310.611585:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4474
00000100:00080000:3.0:1787829310.611590:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829310.611595:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829310.611601:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829310.611619:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706580 x1874670273204736/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829310.611630:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829310.611634:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787829310.611636:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829310.611640:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4474
00000100:00080000:3.0:1787829310.611644:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829310.611648:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000800:00000100:0.0:1787829310.611652:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000008:00100000:3.0:1787829310.611655:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829310.611667:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704b40 x1874670273204864/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829310.611675:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829310.611677:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787829310.611679:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829310.611682:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4474
00000100:00080000:3.0:1787829310.611685:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829310.611689:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829310.611692:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787829310.611703:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705a40 x1874670273204992/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787829310.611709:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829310/real 1787829310]  req@ffff9ee005706d00 x1874670273204480/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829335 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829310.611712:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829310.611720:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787829310.611723:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829310.611729:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4474
00000100:00080000:3.0:1787829310.611732:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829310.611735:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787829310.611738:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706d00 x1874670273204480/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829335 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:3.0:1787829310.611740:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829310.611753:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057043c0 x1874670273205120/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829310.611754:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829310.611764:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829310.611766:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787829310.611768:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829310.611769:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:3.0:1787829310.611774:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4474
00000100:00100000:0.0:1787829310.611778:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273204480:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787829310.611779:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829310.611786:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829310.611789:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829310.611795:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704780 x1874670273205248/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787829310.611809:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273204608:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787829310.611835:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829310.611845:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829310/real 1787829310]  req@ffff9ee005705e00 x1874670273204608/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829335 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829310.611854:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705e00 x1874670273204608/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829335 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829310.611860:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829310.611863:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829310.611865:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273204608:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787829310.611869:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273204736:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829310.611882:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829310.611888:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829310/real 1787829310]  req@ffff9ee005706580 x1874670273204736/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829335 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829310.611896:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706580 x1874670273204736/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829335 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829310.611901:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829310.611903:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829310.611905:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273204736:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829310.611909:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273204864:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829310.611920:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829310.611925:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829310/real 1787829310]  req@ffff9ee005704b40 x1874670273204864/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829335 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829310.611934:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704b40 x1874670273204864/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829335 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829310.611943:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829310.611947:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829310.611950:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273204864:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829310.611957:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273204992:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787829310.611977:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829310.611996:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829310/real 1787829310]  req@ffff9ee005705a40 x1874670273204992/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829335 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829310.612006:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705a40 x1874670273204992/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829335 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829310.612012:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829310.612015:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829310.612017:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273204992:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787829310.612021:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273205120:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829310.612036:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829310.612044:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829310/real 1787829310]  req@ffff9ee0057043c0 x1874670273205120/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829335 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829310.612052:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057043c0 x1874670273205120/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829335 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829310.612056:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829310.612058:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829310.612060:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273205120:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829310.612073:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273205248:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829310.612084:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829310.612090:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829310/real 1787829310]  req@ffff9ee005704780 x1874670273205248/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829335 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829310.612098:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704780 x1874670273205248/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829335 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829310.612103:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829310.612105:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829310.612107:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273205248:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787829311.443445:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787829311.635494:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787829312.467535:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787829312.659431:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829313.491532:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787829313.683398:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829314.515517:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787829314.707404:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829315.539516:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1787829315.731406:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829315.731417:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787829315.731422:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829315.731435:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4479
00000100:00100000:1.0:1787829315.731436:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787829315.731451:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829315.731460:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787829315.731505:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057052c0 x1874670273205376/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829315.731541:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829315.731546:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787829315.731548:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829315.731553:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4479
00000100:00080000:3.0:1787829315.731556:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829315.731560:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829315.731571:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787829315.731583:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706940 x1874670273205504/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787829315.731593:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273205376:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787829315.731594:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829315.731599:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787829315.731603:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829315.731609:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4479
00000100:00080000:3.0:1787829315.731613:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829315.731618:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829315.731625:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829315.731638:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704000 x1874670273205632/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829315.731649:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829315.731654:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787829315.731656:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829315.731660:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4479
00000100:00080000:3.0:1787829315.731663:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829315.731666:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829315.731670:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829315.731680:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707480 x1874670273205760/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829315.731687:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829315.731689:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787829315.731691:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829315.731693:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4479
00000100:00080000:3.0:1787829315.731696:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829315.731699:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829315.731702:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787829315.731710:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057070c0 x1874670273205888/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829315.731717:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829315.731720:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787829315.731722:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829315.731729:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4479
00000100:00080000:3.0:1787829315.731736:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829315.731741:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829315.731747:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787829315.731754:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273205504:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787829315.731766:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705680 x1874670273206016/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829315.731786:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829315.731790:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787829315.731792:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829315.731796:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4479
00000100:00100000:0.0:1787829315.731801:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273205632:192.168.203.121@tcp:8:kworker.0
00000100:00080000:3.0:1787829315.731803:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829315.731810:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829315.731816:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829315.731832:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707840 x1874670273206144/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787829315.731852:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273205760:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829315.731901:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273205888:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787829315.731926:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273206016:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829315.731938:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273206144:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787829316.563458:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829316.755421:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787829317.587499:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829317.779388:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829318.611457:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829318.803425:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000400:00000100:3.0:1787829318.804188:0:2352:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.203.121:988
00000400:00000100:3.0:1787829318.804233:0:2352:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.203.121@tcp at host 192.168.203.121 was unreachable: the network or that node may be down, or Lustre may be misconfigured.
00000800:00000100:3.0:1787829318.804255:0:2352:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:3.0:1787829318.804298:0:2352:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:3.0:1787829318.804309:0:2352:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:3.0:1787829318.804654:0:2352:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:3.0:1787829318.804678:0:2352:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:3.0:1787829318.804688:0:2352:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:3.0:1787829318.804696:0:2352:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000100:00100000:0.0:1787829318.804783:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829315/real 1787829318]  req@ffff9ee005705680 x1874670273206016/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829340 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829318.804806:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705680 x1874670273206016/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829340 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829318.804818:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829318.804823:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829318.804828:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273206016:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829318.804837:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829315/real 1787829318]  req@ffff9ee005707840 x1874670273206144/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829340 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829318.804849:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707840 x1874670273206144/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829340 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829318.804857:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829318.804861:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829318.804864:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273206144:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829318.804872:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829315/real 1787829318]  req@ffff9ee005706940 x1874670273205504/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829340 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829318.804884:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706940 x1874670273205504/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829340 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829318.804891:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829318.804896:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829318.804916:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273205504:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787829318.804924:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829315/real 1787829318]  req@ffff9ee005704000 x1874670273205632/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829340 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829318.804934:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704000 x1874670273205632/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829340 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829318.804939:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829318.804942:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829318.804944:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273205632:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829318.804948:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829315/real 1787829318]  req@ffff9ee005707480 x1874670273205760/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829340 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829318.804955:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707480 x1874670273205760/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829340 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829318.804960:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829318.804962:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829318.804964:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273205760:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829318.804968:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829315/real 1787829318]  req@ffff9ee0057070c0 x1874670273205888/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829340 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829318.804980:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057070c0 x1874670273205888/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829340 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829318.804988:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829318.804991:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829318.804995:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273205888:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787829318.805002:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829315/real 1787829318]  req@ffff9ee0057052c0 x1874670273205376/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829340 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829318.805014:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057052c0 x1874670273205376/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829340 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829318.805023:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829318.805026:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829318.805030:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273205376:192.168.203.121@tcp:250:kworker.0
00010000:00010000:0.0:1787829319.635442:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829319.827424:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829320.659446:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829320.851389:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787829320.851397:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829320.851405:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787829320.851410:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829320.851419:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4484
00000100:00080000:3.0:1787829320.851431:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829320.851438:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787829320.851482:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707c00 x1874670273206272/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829320.851506:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829320.851509:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787829320.851516:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829320.851520:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4484
00000100:00080000:3.0:1787829320.851524:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829320.851529:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829320.851540:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787829320.851555:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273206272:192.168.203.121@tcp:250:kworker.0
00000100:00100000:3.0:1787829320.851557:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057061c0 x1874670273206400/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829320.851571:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829320.851574:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787829320.851575:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829320.851578:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4484
00000100:00080000:3.0:1787829320.851581:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829320.851584:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829320.851589:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829320.851604:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057052c0 x1874670273206528/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829320.851615:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829320.851618:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787829320.851620:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829320.851625:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4484
00000100:00080000:3.0:1787829320.851630:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829320.851633:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000800:00000100:0.0:1787829320.851639:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000008:00100000:3.0:1787829320.851653:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829320.851670:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057070c0 x1874670273206656/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829320.851681:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1787829320.851685:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829320/real 1787829320]  req@ffff9ee005707c00 x1874670273206272/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829345 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829320.851686:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787829320.851690:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829320.851699:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4484
00000100:00080000:3.0:1787829320.851706:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829320.851711:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787829320.851715:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707c00 x1874670273206272/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829345 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:3.0:1787829320.851719:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00080000:0.0:1787829320.851734:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:3.0:1787829320.851739:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707480 x1874670273206784/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829320.851743:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829320.851752:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273206272:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787829320.851771:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829320.851776:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787829320.851778:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829320.851784:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4484
00000100:00100000:0.0:1787829320.851789:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273206400:192.168.203.121@tcp:38:kworker.0
00000100:00080000:3.0:1787829320.851790:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829320.851799:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829320.851806:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:0.0:1787829320.851825:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829320.851833:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704000 x1874670273206912/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787829320.851844:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829320/real 1787829320]  req@ffff9ee0057061c0 x1874670273206400/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829345 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829320.851849:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829320.851856:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787829320.851858:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829320.851865:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4484
00000100:00080000:3.0:1787829320.851873:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829320.851879:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787829320.851883:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057061c0 x1874670273206400/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829345 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:3.0:1787829320.851887:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:0.0:1787829320.851901:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:3.0:1787829320.851907:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706940 x1874670273207040/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829320.851908:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829320.851918:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273206400:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787829320.851931:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273206528:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829320.851956:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829320.851968:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829320/real 1787829320]  req@ffff9ee0057052c0 x1874670273206528/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829345 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829320.851979:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057052c0 x1874670273206528/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829345 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829320.851987:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829320.851990:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829320.851993:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273206528:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829320.851999:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273206656:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829320.852018:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829320.852029:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829320/real 1787829320]  req@ffff9ee0057070c0 x1874670273206656/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829345 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829320.852042:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057070c0 x1874670273206656/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829345 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829320.852050:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829320.852053:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829320.852057:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273206656:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829320.852085:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273206784:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787829320.852107:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829320.852120:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829320/real 1787829320]  req@ffff9ee005707480 x1874670273206784/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829345 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829320.852133:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707480 x1874670273206784/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829345 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829320.852139:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829320.852143:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829320.852146:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273206784:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787829320.852165:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273206912:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829320.852186:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829320.852215:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829320/real 1787829320]  req@ffff9ee005704000 x1874670273206912/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829345 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829320.852227:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704000 x1874670273206912/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829345 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829320.852241:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829320.852245:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829320.852249:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273206912:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829320.852255:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273207040:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829320.852272:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829320.852280:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829320/real 1787829320]  req@ffff9ee005706940 x1874670273207040/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829345 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829320.852289:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706940 x1874670273207040/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829345 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829320.852297:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829320.852300:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829320.852303:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273207040:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787829321.683511:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829321.875413:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787829322.707438:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829322.899385:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829323.731495:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829323.923451:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829324.755447:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829324.947392:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829325.779461:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1787829325.971412:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829325.971424:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787829325.971429:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829325.971439:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4489
00000100:00080000:3.0:1787829325.971449:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829325.971461:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787829325.971479:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00100000:3.0:1787829325.971494:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707840 x1874670273207168/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829325.971522:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829325.971525:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787829325.971527:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829325.971530:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4489
00000100:00080000:3.0:1787829325.971533:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829325.971536:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829325.971545:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787829325.971551:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273207168:192.168.203.121@tcp:250:kworker.0
00000100:00100000:3.0:1787829325.971557:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705680 x1874670273207296/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829325.971568:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829325.971571:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787829325.971573:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829325.971577:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4489
00000100:00080000:3.0:1787829325.971580:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829325.971583:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829325.971587:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829325.971594:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704780 x1874670273207424/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829325.971602:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:1.0:1787829325.971611:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787829325.971612:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787829325.971615:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829325.971620:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4489
00000100:00080000:3.0:1787829325.971622:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829325.971625:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829325.971628:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829325.971636:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057043c0 x1874670273207552/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829325.971642:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829325.971644:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787829325.971646:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829325.971648:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4489
00000100:00080000:3.0:1787829325.971650:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829325.971653:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829325.971656:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787829325.971662:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829325/real 1787829325]  req@ffff9ee005707840 x1874670273207168/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829350 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829325.971666:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705a40 x1874670273207680/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829325.971684:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829325.971687:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787829325.971688:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1787829325.971691:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707840 x1874670273207168/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829350 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829325.971694:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4489
00000100:00080000:3.0:1787829325.971700:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829325.971707:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829325.971710:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829325.971713:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273207168:192.168.203.121@tcp:250:kworker.0
00000100:00100000:1.0:1787829325.971730:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273207296:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787829325.971750:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829325.971760:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829325/real 1787829325]  req@ffff9ee005705680 x1874670273207296/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829350 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829325.971774:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705680 x1874670273207296/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829350 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829325.971780:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829325.971782:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829325.971785:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273207296:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787829325.971789:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273207424:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787829325.971801:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829325.971808:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829325/real 1787829325]  req@ffff9ee005704780 x1874670273207424/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829350 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829325.971816:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704780 x1874670273207424/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829350 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829325.971821:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829325.971823:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829325.971825:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273207424:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787829325.971829:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273207552:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787829325.971841:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829325.971847:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829325/real 1787829325]  req@ffff9ee0057043c0 x1874670273207552/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829350 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829325.971855:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057043c0 x1874670273207552/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829350 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829325.971860:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829325.971863:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829325.971866:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273207552:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787829325.971869:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273207680:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787829325.971880:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829325.971886:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829325/real 1787829325]  req@ffff9ee005705a40 x1874670273207680/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829350 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829325.971893:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705a40 x1874670273207680/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829350 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829325.971897:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829325.971900:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829325.971902:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273207680:192.168.203.121@tcp:38:kworker.0
00000100:00080000:3.0:1787829325.971957:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829325.971963:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829325.971975:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704b40 x1874670273207808/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829325.971991:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829325.971994:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787829325.971997:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829325.972001:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4489
00000100:00080000:3.0:1787829325.972006:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1787829325.972010:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273207808:192.168.203.121@tcp:8:kworker.0
00000100:00080000:3.0:1787829325.972013:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829325.972019:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829325.972044:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706580 x1874670273207936/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1787829325.972050:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829325.972085:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829325/real 1787829325]  req@ffff9ee005704b40 x1874670273207808/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829350 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829325.972096:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704b40 x1874670273207808/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829350 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829325.972103:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829325.972106:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829325.972108:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273207808:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787829325.972118:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273207936:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787829325.972141:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829325.972153:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829325/real 1787829325]  req@ffff9ee005706580 x1874670273207936/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829350 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829325.972162:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706580 x1874670273207936/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829350 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829325.972168:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829325.972170:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829325.972172:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273207936:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787829326.803441:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829326.995408:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787829327.827486:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829328.019389:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829328.851446:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829329.043420:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829329.875448:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829330.067379:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829330.899426:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829331.091432:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:0.0:1787829331.091448:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829331.091455:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1787829331.091459:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829331.091469:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4494
00000100:00080000:0.0:1787829331.091479:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829331.091486:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787829331.091520:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ebc00 x1874670273208064/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829331.091553:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829331.091556:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787829331.091558:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829331.091563:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4494
00000100:00080000:0.0:1787829331.091567:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829331.091572:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829331.091582:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787829331.091588:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273208064:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787829331.091597:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8f00 x1874670273208192/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829331.091609:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829331.091612:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787829331.091614:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829331.091618:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4494
00000100:00080000:0.0:1787829331.091622:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829331.091626:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829331.091631:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787829331.091642:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e83c0 x1874670273208320/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829331.091651:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829331.091657:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000800:00000100:1.0:1787829331.091657:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:0.0:1787829331.091663:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829331.091669:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4494
00000100:00080000:0.0:1787829331.091673:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829331.091677:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829331.091682:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787829331.091692:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8000 x1874670273208448/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787829331.091702:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829331/real 1787829331]  req@ffff9ee0056ebc00 x1874670273208064/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829356 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829331.091703:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829331.091713:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787829331.091717:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829331.091725:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4494
00000100:00100000:1.0:1787829331.091729:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ebc00 x1874670273208064/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829356 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829331.091730:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829331.091740:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00080000:1.0:1787829331.091743:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000008:00100000:0.0:1787829331.091747:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00080000:1.0:1787829331.091748:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829331.091754:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273208064:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787829331.091763:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9e00 x1874670273208576/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829331.091775:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1787829331.091777:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273208192:192.168.203.121@tcp:38:kworker.0
00000100:00080000:0.0:1787829331.091782:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787829331.091786:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829331.091791:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4494
00000100:00080000:0.0:1787829331.091802:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000800:00000100:1.0:1787829331.091803:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:0.0:1787829331.091812:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787829331.091818:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829331/real 1787829331]  req@ffff9ee0056e8f00 x1874670273208192/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829356 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:0.0:1787829331.091826:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787829331.091831:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8f00 x1874670273208192/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829356 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829331.091844:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb480 x1874670273208704/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829331.091854:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829331.091862:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00080000:0.0:1787829331.091865:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1787829331.091867:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273208192:192.168.203.121@tcp:38:kworker.0
00000100:00080000:0.0:1787829331.091873:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:1.0:1787829331.091877:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273208320:192.168.203.121@tcp:8:kworker.0
00000100:00080000:0.0:1787829331.091878:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829331.091887:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4494
00000100:00080000:0.0:1787829331.091892:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829331.091897:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000800:00000100:1.0:1787829331.091901:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000008:00100000:0.0:1787829331.091905:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787829331.091912:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829331/real 1787829331]  req@ffff9ee0056e83c0 x1874670273208320/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829356 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829331.091921:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb840 x1874670273208832/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787829331.091925:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e83c0 x1874670273208320/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829356 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829331.091947:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829331.091951:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829331.091955:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273208320:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787829331.091959:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273208448:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787829331.091973:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829331.091979:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829331/real 1787829331]  req@ffff9ee0056e8000 x1874670273208448/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829356 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829331.091986:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8000 x1874670273208448/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829356 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829331.092007:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829331.092009:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829331.092012:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273208448:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787829331.092024:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273208576:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787829331.092038:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829331.092045:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829331/real 1787829331]  req@ffff9ee0056e9e00 x1874670273208576/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829356 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829331.092053:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9e00 x1874670273208576/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829356 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829331.092058:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829331.092060:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829331.092062:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273208576:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787829331.092065:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273208704:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787829331.092075:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829331.092080:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829331/real 1787829331]  req@ffff9ee0056eb480 x1874670273208704/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829356 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829331.092087:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb480 x1874670273208704/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829356 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829331.092092:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829331.092094:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829331.092096:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273208704:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787829331.092100:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273208832:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787829331.092109:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829331.092114:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829331/real 1787829331]  req@ffff9ee0056eb840 x1874670273208832/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829356 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829331.092121:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb840 x1874670273208832/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829356 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829331.092126:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829331.092127:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829331.092129:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273208832:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787829331.923471:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829332.115403:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787829332.947496:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829333.139420:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829333.971452:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829334.163416:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829334.995500:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829335.187375:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829336.019458:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1787829336.211400:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1787829336.211407:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:0.0:1787829336.211408:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1787829336.211413:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829336.211423:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4499
00000100:00080000:0.0:1787829336.211432:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829336.211438:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787829336.211472:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e92c0 x1874670273208960/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829336.211499:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829336.211502:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787829336.211503:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829336.211506:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4499
00000100:00080000:0.0:1787829336.211508:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829336.211511:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829336.211520:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787829336.211529:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8b40 x1874670273209088/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787829336.211538:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273208960:192.168.203.121@tcp:250:kworker.0
00000100:00080000:0.0:1787829336.211544:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829336.211548:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787829336.211550:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829336.211553:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4499
00000100:00080000:0.0:1787829336.211555:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829336.211558:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829336.211562:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787829336.211569:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb0c0 x1874670273209216/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829336.211576:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829336.211579:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787829336.211580:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829336.211587:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4499
00000100:00080000:0.0:1787829336.211604:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829336.211606:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829336.211609:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1787829336.211617:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829336.211620:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9a40 x1874670273209344/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829336.211637:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829336.211640:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787829336.211641:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829336.211644:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4499
00000100:00080000:0.0:1787829336.211647:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829336.211649:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829336.211653:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787829336.211662:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829336/real 1787829336]  req@ffff9ee0056e92c0 x1874670273208960/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829361 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829336.211664:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ea580 x1874670273209472/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829336.211685:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829336.211688:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787829336.211690:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1787829336.211692:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e92c0 x1874670273208960/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829361 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829336.211695:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4499
00000100:00080000:0.0:1787829336.211698:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829336.211700:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829336.211703:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787829336.211714:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9680 x1874670273209600/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829336.211721:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829336.211723:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829336.211729:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787829336.211730:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829336.211732:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:0.0:1787829336.211735:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4499
00000100:00080000:0.0:1787829336.211741:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1787829336.211745:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273208960:192.168.203.121@tcp:250:kworker.0
00000100:00080000:0.0:1787829336.211746:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829336.211753:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787829336.211761:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8780 x1874670273209728/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787829336.211777:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273209088:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787829336.211805:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829336.211819:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829336/real 1787829336]  req@ffff9ee0056e8b40 x1874670273209088/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829361 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829336.211831:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8b40 x1874670273209088/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829361 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829336.211840:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829336.211844:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829336.211848:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273209088:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787829336.211854:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273209216:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787829336.211875:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829336.211886:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829336/real 1787829336]  req@ffff9ee0056eb0c0 x1874670273209216/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829361 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829336.211898:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb0c0 x1874670273209216/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829361 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829336.211906:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829336.211909:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829336.211913:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273209216:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787829336.211919:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273209344:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787829336.211940:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829336.211952:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829336/real 1787829336]  req@ffff9ee0056e9a40 x1874670273209344/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829361 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829336.211979:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9a40 x1874670273209344/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829361 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829336.211987:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829336.211990:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829336.211994:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273209344:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787829336.212000:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273209472:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787829336.212019:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829336.212030:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829336/real 1787829336]  req@ffff9ee0056ea580 x1874670273209472/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829361 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829336.212042:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ea580 x1874670273209472/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829361 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829336.212050:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829336.212054:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829336.212058:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273209472:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787829336.212063:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273209600:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787829336.212079:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829336.212089:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829336/real 1787829336]  req@ffff9ee0056e9680 x1874670273209600/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829361 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829336.212100:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9680 x1874670273209600/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829361 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829336.212108:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829336.212111:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829336.212115:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273209600:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787829336.212121:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273209728:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787829336.212140:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829336.212153:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829336/real 1787829336]  req@ffff9ee0056e8780 x1874670273209728/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829361 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829336.212165:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8780 x1874670273209728/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829361 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829336.212173:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829336.212177:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829336.212180:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273209728:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787829337.043484:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829337.235427:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787829338.067467:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829338.259407:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829339.091520:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829339.283414:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829340.115472:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829340.307419:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829341.139487:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829341.331429:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:1.0:1787829341.331456:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829341.331460:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1787829341.331464:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829341.331472:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4505
00000100:00080000:1.0:1787829341.331481:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829341.331487:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787829341.331518:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a03c0 x1874670273209856/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829341.331542:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829341.331545:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787829341.331546:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829341.331549:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4505
00000100:00080000:1.0:1787829341.331551:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829341.331553:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829341.331561:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787829341.331569:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1e00 x1874670273209984/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829341.331577:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829341.331580:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787829341.331582:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1787829341.331585:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273209856:192.168.203.121@tcp:250:kworker.0
00000100:00080000:1.0:1787829341.331587:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4505
00000100:00080000:1.0:1787829341.331599:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829341.331604:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829341.331608:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787829341.331615:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a3480 x1874670273210112/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829341.331623:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829341.331625:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787829341.331627:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829341.331630:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4505
00000100:00080000:1.0:1787829341.331632:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829341.331635:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829341.331638:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787829341.331647:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a30c0 x1874670273210240/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829341.331653:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:2.0:1787829341.331656:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:1.0:1787829341.331657:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787829341.331660:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829341.331664:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4505
00000100:00080000:1.0:1787829341.331667:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829341.331670:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829341.331673:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787829341.331682:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0b40 x1874670273210368/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829341.331688:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829341.331690:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787829341.331692:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1787829341.331696:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829341/real 1787829341]  req@ffff9ee0056a03c0 x1874670273209856/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829366 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829341.331697:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4505
00000100:00080000:1.0:1787829341.331708:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829341.331713:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787829341.331716:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a03c0 x1874670273209856/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829366 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:1.0:1787829341.331718:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:2.0:1787829341.331731:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:1.0:1787829341.331734:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a2580 x1874670273210496/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829341.331737:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829341.331744:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273209856:192.168.203.121@tcp:250:kworker.0
00000100:00080000:1.0:1787829341.331753:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829341.331757:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787829341.331758:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829341.331763:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4505
00000100:00080000:1.0:1787829341.331767:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1787829341.331771:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273209984:192.168.203.121@tcp:38:kworker.0
00000100:00080000:1.0:1787829341.331774:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829341.331782:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787829341.331798:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0000 x1874670273210624/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1787829341.331799:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829341.331810:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829341/real 1787829341]  req@ffff9ee0056a1e00 x1874670273209984/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829366 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829341.331822:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1e00 x1874670273209984/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829366 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829341.331834:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829341.331836:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829341.331839:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273209984:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787829341.331843:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273210112:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787829341.331855:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829341.331862:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829341/real 1787829341]  req@ffff9ee0056a3480 x1874670273210112/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829366 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829341.331869:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a3480 x1874670273210112/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829366 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829341.331874:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829341.331876:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829341.331878:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273210112:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787829341.331882:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273210240:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787829341.331891:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829341.331896:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829341/real 1787829341]  req@ffff9ee0056a30c0 x1874670273210240/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829366 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829341.331904:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a30c0 x1874670273210240/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829366 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829341.331908:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829341.331910:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829341.331913:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273210240:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787829341.331917:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273210368:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787829341.331947:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829341.331955:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829341/real 1787829341]  req@ffff9ee0056a0b40 x1874670273210368/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829366 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829341.331963:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0b40 x1874670273210368/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829366 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829341.331968:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829341.331970:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829341.331972:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273210368:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787829341.331976:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273210496:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787829341.331986:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829341.331991:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829341/real 1787829341]  req@ffff9ee0056a2580 x1874670273210496/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829366 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829341.331999:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a2580 x1874670273210496/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829366 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829341.332003:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829341.332005:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829341.332007:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273210496:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787829341.332021:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273210624:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787829341.332030:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829341.332036:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829341/real 1787829341]  req@ffff9ee0056a0000 x1874670273210624/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829366 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829341.332043:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0000 x1874670273210624/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829366 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829341.332048:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829341.332050:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829341.332052:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273210624:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787829342.163489:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829342.355401:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787829343.187478:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829343.379438:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829344.211501:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829344.403408:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829345.235502:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829345.427405:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829346.259517:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1787829346.451475:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1787829346.451483:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:0.0:1787829346.451486:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1787829346.451493:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829346.451507:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4510
00000100:00080000:0.0:1787829346.451520:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829346.451527:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787829346.451571:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ead00 x1874670273210752/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829346.451604:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829346.451609:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787829346.451611:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829346.451616:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4510
00000100:00080000:0.0:1787829346.451621:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829346.451625:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829346.451636:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787829346.451648:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ea940 x1874670273210880/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829346.451658:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829346.451661:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787829346.451662:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829346.451668:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4510
00000100:00100000:2.0:1787829346.451669:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273210752:192.168.203.121@tcp:250:kworker.0
00000100:00080000:0.0:1787829346.451671:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829346.451675:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829346.451680:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787829346.451696:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8780 x1874670273211008/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829346.451708:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829346.451712:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787829346.451714:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829346.451718:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4510
00000100:00080000:0.0:1787829346.451723:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829346.451727:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829346.451733:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787829346.451743:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9680 x1874670273211136/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829346.451751:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829346.451754:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787829346.451755:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829346.451758:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4510
00000100:00080000:0.0:1787829346.451762:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829346.451765:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829346.451768:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000800:00000100:2.0:1787829346.451772:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829346.451779:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ea580 x1874670273211264/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829346.451787:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829346.451790:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787829346.451791:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829346.451794:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4510
00000100:00080000:0.0:1787829346.451797:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829346.451799:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829346.451802:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787829346.451809:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9a40 x1874670273211392/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829346.451815:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829346.451817:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787829346.451818:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829346.451821:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4510
00000100:00080000:0.0:1787829346.451823:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829346.451826:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829346.451829:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787829346.451836:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829346/real 1787829346]  req@ffff9ee0056ead00 x1874670273210752/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829371 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829346.451842:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb0c0 x1874670273211520/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787829346.451872:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ead00 x1874670273210752/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829371 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829346.451903:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829346.451909:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829346.451914:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273210752:192.168.203.121@tcp:250:kworker.0
00000100:00100000:2.0:1787829346.451943:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273210880:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787829346.451982:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829346.451998:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829346/real 1787829346]  req@ffff9ee0056ea940 x1874670273210880/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829371 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829346.452020:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ea940 x1874670273210880/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829371 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829346.452038:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829346.452042:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829346.452046:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273210880:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787829346.452052:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273211008:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787829346.452078:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829346.452091:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829346/real 1787829346]  req@ffff9ee0056e8780 x1874670273211008/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829371 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829346.452104:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8780 x1874670273211008/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829371 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829346.452113:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829346.452116:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829346.452120:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273211008:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787829346.452126:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273211136:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787829346.452143:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829346.452152:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829346/real 1787829346]  req@ffff9ee0056e9680 x1874670273211136/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829371 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829346.452164:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9680 x1874670273211136/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829371 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829346.452179:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829346.452182:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829346.452186:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273211136:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787829346.452191:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273211264:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787829346.452207:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829346.452218:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829346/real 1787829346]  req@ffff9ee0056ea580 x1874670273211264/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829371 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829346.452230:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ea580 x1874670273211264/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829371 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829346.452239:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829346.452243:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829346.452246:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273211264:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787829346.452254:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273211392:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787829346.452275:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829346.452288:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829346/real 1787829346]  req@ffff9ee0056e9a40 x1874670273211392/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829371 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829346.452302:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9a40 x1874670273211392/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829371 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829346.452311:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829346.452363:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829346.452368:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273211392:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787829346.452376:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273211520:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787829346.452411:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829346.452427:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829346/real 1787829346]  req@ffff9ee0056eb0c0 x1874670273211520/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829371 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829346.452441:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb0c0 x1874670273211520/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829371 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829346.452450:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829346.452454:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829346.452457:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273211520:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787829347.283564:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829347.475460:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787829348.307508:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829348.499397:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829349.331472:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829349.523388:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829350.355464:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829350.548367:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829351.379540:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829351.571420:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:0.0:1787829351.571461:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829351.571468:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1787829351.571472:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829351.571482:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4515
00000100:00080000:0.0:1787829351.571491:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829351.571497:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787829351.571526:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8b40 x1874670273211648/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829351.571549:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829351.571552:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787829351.571559:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829351.571561:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4515
00000100:00080000:0.0:1787829351.571566:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829351.571569:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829351.571577:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787829351.571585:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e92c0 x1874670273211776/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829351.571592:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829351.571595:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787829351.571596:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829351.571600:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4515
00000100:00080000:0.0:1787829351.571602:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829351.571606:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829351.571609:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787829351.571617:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb840 x1874670273211904/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829351.571624:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829351.571628:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787829351.571630:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1787829351.571630:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273211648:192.168.203.121@tcp:250:kworker.0
00000100:00080000:0.0:1787829351.571637:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4515
00000100:00080000:0.0:1787829351.571640:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829351.571642:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829351.571645:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787829351.571653:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb480 x1874670273212032/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829351.571659:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829351.571661:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787829351.571662:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829351.571664:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4515
00000100:00080000:0.0:1787829351.571666:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829351.571669:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829351.571673:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787829351.571683:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9e00 x1874670273212160/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1787829351.571692:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:0.0:1787829351.571700:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829351.571705:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787829351.571707:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829351.571713:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4515
00000100:00080000:0.0:1787829351.571718:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829351.571722:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829351.571728:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787829351.571732:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829351/real 1787829351]  req@ffff9ee0056e8b40 x1874670273211648/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829376 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829351.571743:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8000 x1874670273212288/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829351.571754:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829351.571756:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787829351.571757:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1787829351.571762:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8b40 x1874670273211648/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829376 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829351.571763:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4515
00000100:00080000:0.0:1787829351.571769:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829351.571775:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829351.571781:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:2.0:1787829351.571783:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:0.0:1787829351.571790:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e83c0 x1874670273212416/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829351.571792:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829351.571803:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273211648:192.168.203.121@tcp:250:kworker.0
00000100:00100000:2.0:1787829351.571814:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273211776:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787829351.571864:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829351.571878:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829351/real 1787829351]  req@ffff9ee0056e92c0 x1874670273211776/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829376 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829351.571887:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e92c0 x1874670273211776/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829376 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829351.571893:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829351.571896:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829351.571898:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273211776:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787829351.571924:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273211904:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787829351.571940:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829351.571950:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829351/real 1787829351]  req@ffff9ee0056eb840 x1874670273211904/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829376 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829351.571963:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb840 x1874670273211904/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829376 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829351.571972:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829351.571976:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829351.571979:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273211904:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787829351.571986:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273212032:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787829351.572005:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829351.572013:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829351/real 1787829351]  req@ffff9ee0056eb480 x1874670273212032/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829376 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829351.572021:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb480 x1874670273212032/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829376 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829351.572027:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829351.572029:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829351.572031:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273212032:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787829351.572035:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273212160:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787829351.572045:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829351.572051:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829351/real 1787829351]  req@ffff9ee0056e9e00 x1874670273212160/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829376 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829351.572058:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9e00 x1874670273212160/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829376 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829351.572063:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829351.572065:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829351.572067:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273212160:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787829351.572070:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273212288:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787829351.572079:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829351.572085:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829351/real 1787829351]  req@ffff9ee0056e8000 x1874670273212288/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829376 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829351.572097:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8000 x1874670273212288/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829376 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829351.572102:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829351.572103:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829351.572105:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273212288:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787829351.572108:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273212416:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787829351.572118:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829351.572123:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829351/real 1787829351]  req@ffff9ee0056e83c0 x1874670273212416/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829376 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829351.572130:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e83c0 x1874670273212416/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829376 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829351.572134:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829351.572136:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829351.572137:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273212416:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787829352.403498:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787829352.595411:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787829353.427470:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787829353.619369:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829354.451516:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787829354.643430:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829355.475462:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787829355.667415:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829356.499515:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1787829356.691436:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829356.691447:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00100000:0.0:1787829356.691451:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787829356.691452:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829356.691464:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4520
00000100:00080000:3.0:1787829356.691474:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829356.691480:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787829356.691515:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705e00 x1874670273212544/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829356.691542:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829356.691545:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787829356.691546:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829356.691549:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4520
00000100:00080000:3.0:1787829356.691559:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829356.691563:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829356.691572:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787829356.691583:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706d00 x1874670273212672/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787829356.691589:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273212544:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787829356.691595:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829356.691599:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787829356.691600:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829356.691603:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4520
00000100:00080000:3.0:1787829356.691605:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829356.691608:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829356.691613:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829356.691623:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706580 x1874670273212800/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829356.691629:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829356.691631:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787829356.691633:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829356.691642:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4520
00000100:00080000:3.0:1787829356.691646:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000800:00000100:2.0:1787829356.691649:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787829356.691653:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829356.691658:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829356.691668:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704b40 x1874670273212928/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829356.691676:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829356.691678:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787829356.691679:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829356.691682:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4520
00000100:00080000:3.0:1787829356.691685:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829356.691687:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829356.691691:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787829356.691692:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829356/real 1787829356]  req@ffff9ee005705e00 x1874670273212544/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829381 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829356.691702:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705a40 x1874670273213056/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829356.691711:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1787829356.691714:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705e00 x1874670273212544/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829381 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829356.691715:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787829356.691720:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829356.691729:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4520
00000100:00080000:3.0:1787829356.691733:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829356.691734:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829356.691737:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00080000:2.0:1787829356.691741:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000008:00100000:3.0:1787829356.691743:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787829356.691748:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273212544:192.168.203.121@tcp:250:kworker.0
00000100:00100000:3.0:1787829356.691754:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057043c0 x1874670273213184/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829356.691761:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829356.691763:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787829356.691765:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829356.691768:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4520
00000100:00100000:2.0:1787829356.691770:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273212672:192.168.203.121@tcp:38:kworker.0
00000100:00080000:3.0:1787829356.691772:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829356.691779:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829356.691782:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829356.691792:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704780 x1874670273213312/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1787829356.691799:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829356.691827:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829356/real 1787829356]  req@ffff9ee005706d00 x1874670273212672/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829381 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829356.691844:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706d00 x1874670273212672/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829381 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829356.691853:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829356.691857:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829356.691860:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273212672:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787829356.691867:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273212800:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787829356.691887:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829356.691896:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829356/real 1787829356]  req@ffff9ee005706580 x1874670273212800/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829381 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829356.691904:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706580 x1874670273212800/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829381 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829356.691910:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829356.691912:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829356.691914:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273212800:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787829356.691919:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273212928:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787829356.691929:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829356.691935:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829356/real 1787829356]  req@ffff9ee005704b40 x1874670273212928/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829381 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829356.691942:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704b40 x1874670273212928/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829381 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829356.691947:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829356.691949:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829356.691951:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273212928:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787829356.691954:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273213056:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787829356.691963:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829356.691969:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829356/real 1787829356]  req@ffff9ee005705a40 x1874670273213056/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829381 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829356.691978:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705a40 x1874670273213056/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829381 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829356.691986:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829356.691989:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829356.691993:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273213056:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787829356.691999:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273213184:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787829356.692020:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829356.692031:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829356/real 1787829356]  req@ffff9ee0057043c0 x1874670273213184/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829381 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829356.692044:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057043c0 x1874670273213184/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829381 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829356.692053:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829356.692055:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829356.692057:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273213184:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787829356.692073:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273213312:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787829356.692094:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829356.692106:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829356/real 1787829356]  req@ffff9ee005704780 x1874670273213312/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829381 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829356.692119:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704780 x1874670273213312/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829381 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829356.692128:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829356.692131:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829356.692135:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273213312:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787829357.523465:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787829357.715462:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787829358.547575:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787829358.739449:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829359.571478:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787829359.763430:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829360.595544:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787829360.787438:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829361.619487:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787829361.811382:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:1.0:1787829361.811442:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829361.811451:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1787829361.811457:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829361.811468:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4525
00000100:00080000:1.0:1787829361.811481:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829361.811490:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787829361.811530:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0780 x1874670273213440/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829361.811560:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829361.811563:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787829361.811566:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829361.811576:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4525
00000100:00080000:1.0:1787829361.811580:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829361.811584:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829361.811596:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787829361.811606:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273213440:192.168.203.121@tcp:250:kworker.0
00000100:00100000:1.0:1787829361.811615:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0000 x1874670273213568/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829361.811627:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829361.811631:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787829361.811634:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829361.811640:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4525
00000100:00080000:1.0:1787829361.811643:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829361.811648:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829361.811653:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787829361.811666:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a2580 x1874670273213696/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829361.811674:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829361.811677:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787829361.811679:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829361.811682:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4525
00000100:00080000:1.0:1787829361.811693:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829361.811695:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829361.811698:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:3.0:1787829361.811707:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829361.811709:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0b40 x1874670273213824/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829361.811718:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829361.811720:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787829361.811722:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829361.811725:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4525
00000100:00080000:1.0:1787829361.811728:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829361.811731:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829361.811734:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787829361.811742:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a30c0 x1874670273213952/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829361.811749:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829361.811752:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787829361.811753:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829361.811755:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4525
00000100:00080000:1.0:1787829361.811757:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829361.811759:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829361.811762:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787829361.811768:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a3480 x1874670273214080/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829361.811788:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829361.811793:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787829361.811795:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829361.811801:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4525
00000100:00080000:1.0:1787829361.811805:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829361.811808:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829361.811812:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787829361.811820:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1e00 x1874670273214208/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787829361.811868:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829361/real 1787829361]  req@ffff9ee0056a0780 x1874670273213440/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829386 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829361.812044:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0780 x1874670273213440/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829386 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829361.812104:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829361.812115:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829361.812123:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273213440:192.168.203.121@tcp:250:kworker.0
00000100:00100000:3.0:1787829361.812159:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273213568:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787829361.812188:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829361.812203:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829361/real 1787829361]  req@ffff9ee0056a0000 x1874670273213568/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829386 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829361.812226:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0000 x1874670273213568/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829386 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829361.812236:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829361.812240:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829361.812244:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273213568:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787829361.812251:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273213696:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829361.812273:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829361.812295:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829361/real 1787829361]  req@ffff9ee0056a2580 x1874670273213696/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829386 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829361.812304:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a2580 x1874670273213696/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829386 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829361.812310:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829361.812312:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829361.812341:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273213696:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829361.812347:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273213824:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829361.812365:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829361.812375:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829361/real 1787829361]  req@ffff9ee0056a0b40 x1874670273213824/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829386 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829361.812384:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0b40 x1874670273213824/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829386 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829361.812390:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829361.812393:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829361.812395:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273213824:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829361.812400:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273213952:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787829361.812418:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829361.812430:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829361/real 1787829361]  req@ffff9ee0056a30c0 x1874670273213952/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829386 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829361.812442:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a30c0 x1874670273213952/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829386 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829361.812451:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829361.812455:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829361.812459:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273213952:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787829361.812465:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273214080:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829361.812483:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829361.812493:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829361/real 1787829361]  req@ffff9ee0056a3480 x1874670273214080/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829386 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829361.812503:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a3480 x1874670273214080/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829386 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829361.812509:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829361.812511:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829361.812513:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273214080:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829361.812517:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273214208:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829361.812530:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829361.812536:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829361/real 1787829361]  req@ffff9ee0056a1e00 x1874670273214208/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829386 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829361.812543:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1e00 x1874670273214208/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829386 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829361.812548:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829361.812550:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829361.812552:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273214208:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787829362.643553:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787829362.835447:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787829363.667490:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787829363.859432:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829364.691527:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787829364.883428:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829365.715539:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787829365.907505:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829366.739537:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829366.931401:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787829366.931406:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829366.931414:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787829366.931419:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829366.931430:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4530
00000100:00080000:3.0:1787829366.931438:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829366.931444:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787829366.931481:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705680 x1874670273214336/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829366.931510:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829366.931515:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787829366.931517:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829366.931521:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4530
00000100:00080000:3.0:1787829366.931525:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829366.931530:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829366.931538:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787829366.931550:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707840 x1874670273214464/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829366.931559:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1787829366.931563:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273214336:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787829366.931564:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787829366.931567:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829366.931574:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4530
00000100:00080000:3.0:1787829366.931577:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829366.931579:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829366.931589:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829366.931599:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706940 x1874670273214592/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829366.931606:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829366.931609:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787829366.931610:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829366.931614:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4530
00000100:00080000:3.0:1787829366.931617:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829366.931620:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829366.931623:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:2.0:1787829366.931627:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829366.931632:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704000 x1874670273214720/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829366.931641:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829366.931644:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787829366.931645:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829366.931648:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4530
00000100:00080000:3.0:1787829366.931650:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829366.931653:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829366.931656:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787829366.931663:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707480 x1874670273214848/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829366.931670:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1787829366.931671:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829366/real 1787829366]  req@ffff9ee005705680 x1874670273214336/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829391 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829366.931673:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787829366.931677:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829366.931686:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4530
00000100:00080000:3.0:1787829366.931691:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829366.931698:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829366.931705:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787829366.931712:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705680 x1874670273214336/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829391 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829366.931715:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057070c0 x1874670273214976/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829366.931736:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829366.931737:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829366.931757:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:3.0:1787829366.931758:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787829366.931762:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1787829366.931764:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273214336:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787829366.931769:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4530
00000100:00080000:3.0:1787829366.931774:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829366.931777:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829366.931782:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787829366.931790:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273214464:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787829366.931794:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057052c0 x1874670273215104/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1787829366.931817:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829366.931829:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829366/real 1787829366]  req@ffff9ee005707840 x1874670273214464/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829391 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829366.931837:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707840 x1874670273214464/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829391 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829366.931843:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829366.931845:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829366.931848:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273214464:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787829366.931852:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273214592:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787829366.931863:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829366.931869:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829366/real 1787829366]  req@ffff9ee005706940 x1874670273214592/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829391 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829366.931876:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706940 x1874670273214592/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829391 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829366.931886:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829366.931888:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829366.931890:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273214592:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787829366.931893:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273214720:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787829366.931902:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829366.931908:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829366/real 1787829366]  req@ffff9ee005704000 x1874670273214720/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829391 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829366.931914:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704000 x1874670273214720/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829391 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829366.931919:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829366.931921:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829366.931923:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273214720:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787829366.931926:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273214848:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787829366.931935:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829366.931940:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829366/real 1787829366]  req@ffff9ee005707480 x1874670273214848/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829391 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829366.931947:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707480 x1874670273214848/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829391 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829366.931952:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829366.931954:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829366.931956:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273214848:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787829366.931960:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273214976:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787829366.931969:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829366.931974:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829366/real 1787829366]  req@ffff9ee0057070c0 x1874670273214976/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829391 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829366.931981:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057070c0 x1874670273214976/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829391 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829366.931985:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829366.931987:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829366.931989:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273214976:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787829366.932000:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273215104:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787829366.932010:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829366.932015:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829366/real 1787829366]  req@ffff9ee0057052c0 x1874670273215104/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829391 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829366.932022:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057052c0 x1874670273215104/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829391 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829366.932027:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829366.932029:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829366.932031:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273215104:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787829367.763475:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829367.955409:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787829368.787535:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829368.979487:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829369.811519:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829370.003432:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829370.835480:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829371.027386:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829371.859497:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1787829372.051400:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1787829372.051405:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787829372.051409:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787829372.051414:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829372.051422:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4535
00000100:00080000:3.0:1787829372.051431:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829372.051438:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787829372.051474:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057061c0 x1874670273215232/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829372.051495:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829372.051501:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787829372.051502:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829372.051505:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4535
00000100:00080000:3.0:1787829372.051508:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829372.051512:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829372.051521:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787829372.051527:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273215232:192.168.203.121@tcp:250:kworker.0
00000100:00100000:3.0:1787829372.051532:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707c00 x1874670273215360/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829372.051540:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829372.051543:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787829372.051544:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829372.051546:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4535
00000100:00080000:3.0:1787829372.051549:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829372.051551:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829372.051555:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829372.051564:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057052c0 x1874670273215488/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829372.051570:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829372.051572:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787829372.051574:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829372.051576:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4535
00000100:00080000:3.0:1787829372.051579:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829372.051581:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000800:00000100:2.0:1787829372.051585:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000008:00100000:3.0:1787829372.051585:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829372.051595:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057070c0 x1874670273215616/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829372.051602:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829372.051605:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787829372.051607:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829372.051610:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4535
00000100:00080000:3.0:1787829372.051613:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829372.051615:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829372.051618:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787829372.051625:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707480 x1874670273215744/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829372.051630:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829372.051632:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787829372.051634:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1787829372.051638:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829372/real 1787829372]  req@ffff9ee0057061c0 x1874670273215232/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829397 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829372.051639:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4535
00000100:00080000:3.0:1787829372.051644:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829372.051650:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829372.051658:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787829372.051665:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057061c0 x1874670273215232/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829397 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829372.051669:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704000 x1874670273215872/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829372.051689:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829372.051693:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:3.0:1787829372.051694:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1787829372.051698:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273215232:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787829372.051699:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787829372.051715:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829372.051722:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4535
00000100:00080000:3.0:1787829372.051727:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829372.051732:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787829372.051734:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273215360:192.168.203.121@tcp:38:kworker.0
00000008:00100000:3.0:1787829372.051742:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829372.051759:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706940 x1874670273216000/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1787829372.051763:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829372.051776:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829372/real 1787829372]  req@ffff9ee005707c00 x1874670273215360/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829397 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829372.051786:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707c00 x1874670273215360/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829397 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829372.051792:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829372.051795:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829372.051798:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273215360:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787829372.051802:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273215488:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787829372.051814:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829372.051820:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829372/real 1787829372]  req@ffff9ee0057052c0 x1874670273215488/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829397 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829372.051828:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057052c0 x1874670273215488/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829397 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829372.051833:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829372.051835:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829372.051837:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273215488:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787829372.051841:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273215616:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787829372.051850:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829372.051856:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829372/real 1787829372]  req@ffff9ee0057070c0 x1874670273215616/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829397 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829372.051862:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057070c0 x1874670273215616/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829397 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829372.051867:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829372.051869:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829372.051870:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273215616:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787829372.051874:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273215744:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787829372.051883:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829372.051888:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829372/real 1787829372]  req@ffff9ee005707480 x1874670273215744/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829397 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829372.051900:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707480 x1874670273215744/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829397 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829372.051905:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829372.051907:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829372.051908:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273215744:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787829372.051912:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273215872:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787829372.051921:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829372.051926:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829372/real 1787829372]  req@ffff9ee005704000 x1874670273215872/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829397 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829372.051933:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704000 x1874670273215872/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829397 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829372.051937:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829372.051939:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829372.051941:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273215872:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787829372.051952:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273216000:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787829372.051962:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829372.051968:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829372/real 1787829372]  req@ffff9ee005706940 x1874670273216000/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829397 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829372.051975:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706940 x1874670273216000/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829397 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829372.051984:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829372.051986:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829372.051988:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273216000:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787829372.883454:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829373.075428:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787829373.907479:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829374.099421:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829374.931464:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829375.123411:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829375.955469:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829376.147443:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829376.979530:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1787829377.171393:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1787829377.171398:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787829377.171401:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787829377.171406:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829377.171415:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4540
00000100:00080000:3.0:1787829377.171424:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829377.171430:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787829377.171460:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707840 x1874670273216128/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829377.171480:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829377.171483:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787829377.171485:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829377.171487:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4540
00000100:00080000:3.0:1787829377.171490:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829377.171492:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829377.171500:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787829377.171509:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705680 x1874670273216256/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787829377.171514:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273216128:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787829377.171522:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829377.171526:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787829377.171527:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829377.171531:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4540
00000100:00080000:3.0:1787829377.171534:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829377.171536:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829377.171540:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829377.171548:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704780 x1874670273216384/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829377.171555:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829377.171557:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787829377.171559:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829377.171561:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4540
00000100:00080000:3.0:1787829377.171565:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829377.171567:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829377.171570:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:2.0:1787829377.171579:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829377.171580:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057043c0 x1874670273216512/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829377.171589:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829377.171592:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787829377.171593:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829377.171596:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4540
00000100:00080000:3.0:1787829377.171599:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829377.171602:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829377.171605:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787829377.171612:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705a40 x1874670273216640/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829377.171619:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1787829377.171623:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829377/real 1787829377]  req@ffff9ee005707840 x1874670273216128/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829402 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829377.171623:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787829377.171627:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829377.171635:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4540
00000100:00080000:3.0:1787829377.171640:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829377.171644:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829377.171647:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787829377.171650:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707840 x1874670273216128/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829402 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829377.171658:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704b40 x1874670273216768/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829377.171662:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829377.171686:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:3.0:1787829377.171686:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829377.171692:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:2.0:1787829377.171695:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273216128:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787829377.171695:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829377.171702:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4540
00000100:00080000:3.0:1787829377.171707:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829377.171710:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829377.171714:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829377.171723:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706580 x1874670273216896/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787829377.171730:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273216256:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787829377.171763:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829377.171777:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829377/real 1787829377]  req@ffff9ee005705680 x1874670273216256/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829402 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829377.171792:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705680 x1874670273216256/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829402 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829377.171800:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829377.171804:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829377.171808:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273216256:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787829377.171814:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273216384:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787829377.171836:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829377.171848:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829377/real 1787829377]  req@ffff9ee005704780 x1874670273216384/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829402 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829377.171861:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704780 x1874670273216384/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829402 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829377.171871:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829377.171874:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829377.171877:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273216384:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787829377.171884:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273216512:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787829377.171900:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829377.171908:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829377/real 1787829377]  req@ffff9ee0057043c0 x1874670273216512/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829402 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829377.171916:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057043c0 x1874670273216512/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829402 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829377.171921:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829377.171923:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829377.171925:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273216512:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787829377.171928:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273216640:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787829377.171938:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829377.171944:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829377/real 1787829377]  req@ffff9ee005705a40 x1874670273216640/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829402 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829377.171951:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705a40 x1874670273216640/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829402 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829377.171956:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829377.171958:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829377.171960:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273216640:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787829377.171963:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273216768:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787829377.171972:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829377.171978:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829377/real 1787829377]  req@ffff9ee005704b40 x1874670273216768/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829402 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829377.171984:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704b40 x1874670273216768/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829402 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829377.171989:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829377.171990:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829377.171992:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273216768:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787829377.172004:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273216896:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787829377.172014:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829377.172020:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829377/real 1787829377]  req@ffff9ee005706580 x1874670273216896/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829402 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829377.172031:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706580 x1874670273216896/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829402 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829377.172036:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829377.172038:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829377.172040:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273216896:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787829378.003519:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829378.195425:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787829379.027457:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829379.219389:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829380.051523:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829380.243406:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829381.075470:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829381.267421:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829382.099484:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829382.291433:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:0.0:1787829382.291487:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829382.291495:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1787829382.291500:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829382.291511:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4546
00000100:00080000:0.0:1787829382.291522:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829382.291530:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787829382.291567:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8f00 x1874670273217024/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829382.291616:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829382.291620:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787829382.291623:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829382.291627:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4546
00000100:00080000:0.0:1787829382.291631:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829382.291651:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829382.291662:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787829382.291669:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273217024:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787829382.291682:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ebc00 x1874670273217152/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829382.291695:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829382.291699:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787829382.291701:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829382.291706:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4546
00000100:00080000:0.0:1787829382.291711:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829382.291716:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829382.291723:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787829382.291738:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e83c0 x1874670273217280/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829382.291750:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829382.291755:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787829382.291757:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1787829382.291762:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273217152:192.168.203.121@tcp:38:kworker.0
00000100:00080000:0.0:1787829382.291765:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4546
00000100:00080000:0.0:1787829382.291772:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829382.291776:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829382.291782:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787829382.291801:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8000 x1874670273217408/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787829382.291801:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273217280:192.168.203.121@tcp:8:kworker.0
00000100:00080000:0.0:1787829382.291822:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829382.291826:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787829382.291829:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1787829382.291830:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273217408:192.168.203.121@tcp:8:kworker.0
00000100:00080000:0.0:1787829382.291838:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4546
00000100:00080000:0.0:1787829382.291845:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829382.291851:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829382.291857:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787829382.291872:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9e00 x1874670273217536/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829382.291894:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829382.291898:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787829382.291900:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829382.291905:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4546
00000100:00080000:0.0:1787829382.291910:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829382.291915:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829382.291921:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787829382.291940:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273217536:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787829382.291941:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb480 x1874670273217664/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829382.291959:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829382.291963:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787829382.291966:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829382.291971:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4546
00000100:00080000:0.0:1787829382.291975:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829382.291980:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787829382.291986:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273217664:192.168.203.121@tcp:8:kworker.0
00000008:00100000:0.0:1787829382.291987:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787829382.292006:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb840 x1874670273217792/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787829382.292036:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273217792:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787829383.123493:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829383.315519:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787829384.147480:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829384.339421:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829385.171462:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829385.363561:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000400:00000100:2.0:1787829385.363845:0:2355:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.203.121:988
00000400:00000100:2.0:1787829385.363888:0:2355:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.203.121@tcp at host 192.168.203.121 was unreachable: the network or that node may be down, or Lustre may be misconfigured.
00000800:00000100:2.0:1787829385.363906:0:2355:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:2.0:1787829385.363947:0:2355:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:2.0:1787829385.363958:0:2355:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:2.0:1787829385.363966:0:2355:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:2.0:1787829385.363973:0:2355:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:2.0:1787829385.363981:0:2355:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:2.0:1787829385.363988:0:2355:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000100:00100000:3.0:1787829385.363991:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829382/real 1787829385]  req@ffff9ee0056e9e00 x1874670273217536/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829407 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829385.364028:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9e00 x1874670273217536/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829407 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829385.364041:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829385.364047:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829385.364056:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273217536:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787829385.364064:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829382/real 1787829385]  req@ffff9ee0056e8000 x1874670273217408/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829407 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829385.364077:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8000 x1874670273217408/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829407 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829385.364085:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829385.364089:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829385.364092:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273217408:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829385.364098:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829382/real 1787829385]  req@ffff9ee0056ebc00 x1874670273217152/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829407 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829385.364109:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ebc00 x1874670273217152/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829407 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829385.364117:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829385.364120:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829385.364123:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273217152:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787829385.364129:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829382/real 1787829385]  req@ffff9ee0056e83c0 x1874670273217280/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829407 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829385.364139:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e83c0 x1874670273217280/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829407 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829385.364147:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829385.364150:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829385.364154:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273217280:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829385.364160:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829382/real 1787829385]  req@ffff9ee0056e8f00 x1874670273217024/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829407 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829385.364171:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8f00 x1874670273217024/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829407 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829385.364178:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829385.364181:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829385.364184:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273217024:192.168.203.121@tcp:250:kworker.0
00000100:00100000:3.0:1787829385.364210:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829382/real 1787829385]  req@ffff9ee0056eb840 x1874670273217792/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829407 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829385.364222:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb840 x1874670273217792/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829407 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829385.364229:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829385.364232:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829385.364236:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273217792:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829385.364241:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829382/real 1787829385]  req@ffff9ee0056eb480 x1874670273217664/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829407 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829385.364251:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb480 x1874670273217664/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829407 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829385.364259:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829385.364262:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829385.364265:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273217664:192.168.203.121@tcp:8:kworker.0
00010000:00010000:0.0:1787829386.195504:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829386.387447:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829387.219490:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1787829387.411437:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829387.411448:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787829387.411453:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829387.411463:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4551
00000100:00100000:1.0:1787829387.411474:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787829387.411474:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829387.411481:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787829387.411516:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706d00 x1874670273217920/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829387.411542:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829387.411544:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787829387.411546:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829387.411549:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4551
00000100:00080000:3.0:1787829387.411552:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829387.411554:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829387.411562:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787829387.411575:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705e00 x1874670273218048/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829387.411587:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829387.411591:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787829387.411595:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1787829387.411596:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273217920:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787829387.411614:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4551
00000100:00080000:3.0:1787829387.411621:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829387.411626:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829387.411631:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829387.411645:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706580 x1874670273218176/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829387.411655:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829387.411659:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787829387.411661:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829387.411664:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4551
00000100:00080000:3.0:1787829387.411668:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829387.411672:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829387.411677:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:2.0:1787829387.411684:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829387.411690:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704b40 x1874670273218304/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829387.411701:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829387.411705:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787829387.411706:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829387.411710:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4551
00000100:00080000:3.0:1787829387.411714:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829387.411719:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829387.411725:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787829387.411728:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829387/real 1787829387]  req@ffff9ee005706d00 x1874670273217920/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829412 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829387.411740:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705a40 x1874670273218432/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829387.411753:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1787829387.411755:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706d00 x1874670273217920/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829412 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829387.411759:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787829387.411763:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829387.411774:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4551
00000100:00080000:2.0:1787829387.411780:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829387.411781:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829387.411791:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:3.0:1787829387.411791:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829387.411801:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787829387.411803:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273217920:192.168.203.121@tcp:250:kworker.0
00000100:00100000:3.0:1787829387.411815:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057043c0 x1874670273218560/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829387.411825:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829387.411828:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787829387.411831:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1787829387.411832:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273218048:192.168.203.121@tcp:38:kworker.0
00000100:00080000:3.0:1787829387.411837:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4551
00000100:00080000:3.0:1787829387.411843:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829387.411847:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829387.411852:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829387.411864:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704780 x1874670273218688/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1787829387.411873:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829387.411896:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829387/real 1787829387]  req@ffff9ee005705e00 x1874670273218048/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829412 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829387.411912:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705e00 x1874670273218048/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829412 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829387.411922:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829387.411926:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829387.411930:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273218048:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787829387.411937:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273218176:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787829387.411961:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829387.411973:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829387/real 1787829387]  req@ffff9ee005706580 x1874670273218176/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829412 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829387.411986:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706580 x1874670273218176/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829412 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829387.411994:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829387.411998:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829387.412002:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273218176:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787829387.412009:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273218304:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787829387.412037:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829387.412049:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829387/real 1787829387]  req@ffff9ee005704b40 x1874670273218304/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829412 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829387.412061:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704b40 x1874670273218304/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829412 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829387.412069:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829387.412073:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829387.412076:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273218304:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787829387.412082:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273218432:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787829387.412102:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829387.412114:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829387/real 1787829387]  req@ffff9ee005705a40 x1874670273218432/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829412 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829387.412126:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705a40 x1874670273218432/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829412 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829387.412135:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829387.412138:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829387.412141:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273218432:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787829387.412148:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273218560:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787829387.412168:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829387.412180:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829387/real 1787829387]  req@ffff9ee0057043c0 x1874670273218560/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829412 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829387.412192:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057043c0 x1874670273218560/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829412 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829387.412200:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829387.412203:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829387.412206:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273218560:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787829387.412227:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273218688:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787829387.412247:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829387.412259:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829387/real 1787829387]  req@ffff9ee005704780 x1874670273218688/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829412 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829387.412278:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704780 x1874670273218688/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829412 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829387.412286:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829387.412289:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829387.412293:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273218688:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787829388.243456:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829388.435537:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787829389.267514:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829389.459465:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829390.291491:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829390.483377:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829391.315433:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829391.507417:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829392.339519:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829392.531410:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:2.0:1787829392.531432:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829392.531438:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787829392.531442:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829392.531449:0:27707:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4556
00000100:00080000:2.0:1787829392.531459:0:27707:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829392.531464:0:27707:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787829392.531496:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a580 x1874670273218816/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829392.531520:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829392.531522:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787829392.531524:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829392.531526:0:27707:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4556
00000100:00080000:2.0:1787829392.531529:0:27707:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829392.531532:0:27707:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829392.531540:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787829392.531553:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728000 x1874670273218944/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787829392.531555:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273218816:192.168.203.121@tcp:250:kworker.0
00000800:00000100:3.0:1787829392.531626:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829392.531663:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829392/real 1787829392]  req@ffff9ee00572a580 x1874670273218816/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829417 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829392.531676:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a580 x1874670273218816/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829417 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829392.531684:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829392.531688:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829392.531692:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273218816:192.168.203.121@tcp:250:kworker.0
00000100:00080000:2.0:1787829392.531759:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829392.531762:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787829392.531763:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829392.531767:0:27707:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4556
00000100:00080000:2.0:1787829392.531770:0:27707:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829392.531774:0:27707:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829392.531778:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829392.531784:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273218944:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787829392.531790:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057283c0 x1874670273219072/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829392.531799:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829392.531801:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787829392.531803:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829392.531806:0:27707:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4556
00000100:00080000:2.0:1787829392.531809:0:27707:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000800:00000100:3.0:1787829392.531813:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:2.0:1787829392.531816:0:27707:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829392.531821:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829392.531830:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829392/real 1787829392]  req@ffff9ee005728000 x1874670273218944/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829417 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829392.531831:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729e00 x1874670273219200/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829392.531859:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829392.531863:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00100000:3.0:1787829392.531863:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728000 x1874670273218944/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829417 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829392.531865:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829392.531874:0:27707:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4556
00000100:00080000:2.0:1787829392.531879:0:27707:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829392.531881:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829392.531883:0:27707:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829392.531888:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00080000:3.0:1787829392.531888:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829392.531893:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273218944:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787829392.531898:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a940 x1874670273219328/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829392.531906:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1787829392.531907:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273219072:192.168.203.121@tcp:8:kworker.0
00000100:00080000:2.0:1787829392.531911:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787829392.531914:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829392.531918:0:27707:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4556
00000100:00080000:2.0:1787829392.531920:0:27707:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829392.531923:0:27707:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829392.531926:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787829392.531934:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a1c0 x1874670273219456/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1787829392.531942:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:2.0:1787829392.531944:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829392.531947:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787829392.531949:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829392.531953:0:27707:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4556
00000100:00080000:2.0:1787829392.531956:0:27707:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829392.531959:0:27707:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829392.531964:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829392.531964:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829392/real 1787829392]  req@ffff9ee0057283c0 x1874670273219072/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829417 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829392.531978:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729680 x1874670273219584/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787829392.532000:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057283c0 x1874670273219072/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829417 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829392.532008:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829392.532011:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829392.532014:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273219072:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829392.532021:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273219200:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829392.532036:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829392.532043:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829392/real 1787829392]  req@ffff9ee005729e00 x1874670273219200/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829417 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829392.532050:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729e00 x1874670273219200/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829417 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829392.532055:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829392.532057:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829392.532059:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273219200:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829392.532069:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273219328:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787829392.532079:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829392.532085:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829392/real 1787829392]  req@ffff9ee00572a940 x1874670273219328/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829417 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829392.532092:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a940 x1874670273219328/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829417 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829392.532102:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829392.532104:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829392.532106:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273219328:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787829392.532109:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273219456:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829392.532118:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829392.532123:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829392/real 1787829392]  req@ffff9ee00572a1c0 x1874670273219456/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829417 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829392.532130:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a1c0 x1874670273219456/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829417 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829392.532135:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829392.532137:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829392.532139:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273219456:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829392.532142:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273219584:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829392.532151:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829392.532156:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829392/real 1787829392]  req@ffff9ee005729680 x1874670273219584/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829417 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829392.532163:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729680 x1874670273219584/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829417 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829392.532178:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829392.532180:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829392.532183:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273219584:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787829393.363484:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829393.555413:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787829394.387439:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829394.579426:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829395.411497:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829395.603457:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829396.435451:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829396.627392:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829397.459522:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829397.651423:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:1.0:1787829397.651466:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829397.651472:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1787829397.651476:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829397.651486:0:27707:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4561
00000100:00080000:1.0:1787829397.651498:0:27707:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829397.651504:0:27707:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787829397.651548:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a03c0 x1874670273219712/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829397.651570:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829397.651573:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787829397.651574:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829397.651577:0:27707:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4561
00000100:00080000:1.0:1787829397.651582:0:27707:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829397.651587:0:27707:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829397.651597:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787829397.651614:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a2940 x1874670273219840/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829397.651626:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829397.651630:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787829397.651633:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829397.651638:0:27707:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4561
00000100:00080000:1.0:1787829397.651642:0:27707:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829397.651648:0:27707:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829397.651655:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829397.651657:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273219712:192.168.203.121@tcp:250:kworker.0
00000100:00100000:1.0:1787829397.651679:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a21c0 x1874670273219968/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829397.651695:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829397.651697:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787829397.651699:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829397.651703:0:27707:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4561
00000100:00080000:1.0:1787829397.651708:0:27707:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829397.651713:0:27707:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829397.651719:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787829397.651734:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1680 x1874670273220096/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829397.651746:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829397.651750:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787829397.651752:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829397.651756:0:27707:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4561
00000100:00080000:1.0:1787829397.651760:0:27707:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829397.651764:0:27707:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829397.651769:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787829397.651780:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0f00 x1874670273220224/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1787829397.651790:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:1.0:1787829397.651795:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829397.651798:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787829397.651803:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829397.651807:0:27707:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4561
00000100:00080000:1.0:1787829397.651811:0:27707:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829397.651814:0:27707:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829397.651818:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787829397.651829:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a3c00 x1874670273220352/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829397.651839:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829397.651842:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787829397.651844:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829397.651848:0:27707:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4561
00000100:00080000:1.0:1787829397.651852:0:27707:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829397.651855:0:27707:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829397.651860:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787829397.651871:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1a40 x1874670273220480/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787829397.651978:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829397/real 1787829397]  req@ffff9ee0056a03c0 x1874670273219712/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829422 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829397.652000:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a03c0 x1874670273219712/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829422 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829397.652011:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829397.652017:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829397.652022:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273219712:192.168.203.121@tcp:250:kworker.0
00000100:00100000:3.0:1787829397.652030:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273219840:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787829397.652054:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829397.652067:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829397/real 1787829397]  req@ffff9ee0056a2940 x1874670273219840/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829422 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829397.652080:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a2940 x1874670273219840/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829422 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829397.652090:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829397.652093:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829397.652097:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273219840:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787829397.652118:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273219968:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829397.652136:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829397.652144:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829397/real 1787829397]  req@ffff9ee0056a21c0 x1874670273219968/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829422 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829397.652152:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a21c0 x1874670273219968/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829422 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829397.652157:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829397.652159:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829397.652161:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273219968:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829397.652175:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273220096:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829397.652198:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829397.652210:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829397/real 1787829397]  req@ffff9ee0056a1680 x1874670273220096/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829422 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829397.652223:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1680 x1874670273220096/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829422 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829397.652232:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829397.652235:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829397.652239:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273220096:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829397.652245:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273220224:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787829397.652261:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829397.652269:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829397/real 1787829397]  req@ffff9ee0056a0f00 x1874670273220224/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829422 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829397.652282:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0f00 x1874670273220224/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829422 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829397.652288:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829397.652289:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829397.652291:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273220224:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787829397.652295:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273220352:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829397.652305:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829397.652310:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829397/real 1787829397]  req@ffff9ee0056a3c00 x1874670273220352/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829422 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829397.652342:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a3c00 x1874670273220352/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829422 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829397.652348:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829397.652351:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829397.652354:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273220352:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829397.652358:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273220480:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829397.652371:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829397.652378:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829397/real 1787829397]  req@ffff9ee0056a1a40 x1874670273220480/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829422 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829397.652385:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1a40 x1874670273220480/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829422 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829397.652395:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829397.652398:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829397.652401:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273220480:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787829398.483507:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829398.675383:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829399.507549:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829399.699400:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829400.531477:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829400.723389:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829401.555512:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829401.747401:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829402.579483:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1787829402.771404:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829402.771412:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1787829402.771416:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829402.771425:0:27707:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4566
00000100:00100000:2.0:1787829402.771427:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:1.0:1787829402.771434:0:27707:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829402.771442:0:27707:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787829402.771472:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a12c0 x1874670273220608/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829402.771513:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829402.771516:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787829402.771517:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829402.771520:0:27707:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4566
00000100:00080000:1.0:1787829402.771523:0:27707:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829402.771526:0:27707:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829402.771533:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787829402.771545:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1a40 x1874670273220736/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829402.771554:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829402.771558:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00100000:3.0:1787829402.771558:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273220608:192.168.203.121@tcp:250:kworker.0
00000100:00080000:1.0:1787829402.771561:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829402.771568:0:27707:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4566
00000100:00080000:1.0:1787829402.771570:0:27707:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829402.771572:0:27707:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829402.771576:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787829402.771585:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a3c00 x1874670273220864/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829402.771597:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829402.771599:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787829402.771601:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829402.771604:0:27707:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4566
00000100:00080000:1.0:1787829402.771607:0:27707:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829402.771609:0:27707:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829402.771612:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787829402.771620:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0f00 x1874670273220992/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829402.771627:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:3.0:1787829402.771629:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:1.0:1787829402.771631:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787829402.771633:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829402.771637:0:27707:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4566
00000100:00080000:1.0:1787829402.771640:0:27707:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829402.771642:0:27707:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829402.771646:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787829402.771654:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1680 x1874670273221120/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829402.771660:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829402.771662:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787829402.771664:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829402.771667:0:27707:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4566
00000100:00080000:1.0:1787829402.771670:0:27707:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1787829402.771674:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829402/real 1787829402]  req@ffff9ee0056a12c0 x1874670273220608/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829427 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829402.771675:0:27707:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829402.771681:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787829402.771694:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a21c0 x1874670273221248/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787829402.771699:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a12c0 x1874670273220608/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829427 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829402.771708:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829402.771714:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787829402.771715:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829402.771716:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829402.771720:0:27707:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4566
00000100:00080000:3.0:1787829402.771724:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:1.0:1787829402.771725:0:27707:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1787829402.771730:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273220608:192.168.203.121@tcp:250:kworker.0
00000100:00080000:1.0:1787829402.771731:0:27707:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829402.771739:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787829402.771747:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a2940 x1874670273221376/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787829402.771754:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273220736:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787829402.771773:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829402.771782:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829402/real 1787829402]  req@ffff9ee0056a1a40 x1874670273220736/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829427 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829402.771791:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1a40 x1874670273220736/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829427 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829402.771796:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829402.771798:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829402.771801:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273220736:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787829402.771805:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273220864:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829402.771816:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829402.771821:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829402/real 1787829402]  req@ffff9ee0056a3c00 x1874670273220864/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829427 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829402.771829:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a3c00 x1874670273220864/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829427 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829402.771834:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829402.771836:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829402.771837:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273220864:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829402.771841:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273220992:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829402.771850:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829402.771855:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829402/real 1787829402]  req@ffff9ee0056a0f00 x1874670273220992/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829427 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829402.771862:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0f00 x1874670273220992/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829427 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829402.771867:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829402.771869:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829402.771871:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273220992:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829402.771874:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273221120:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787829402.771883:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829402.771889:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829402/real 1787829402]  req@ffff9ee0056a1680 x1874670273221120/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829427 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829402.771896:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1680 x1874670273221120/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829427 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829402.771900:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829402.771902:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829402.771904:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273221120:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787829402.771907:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273221248:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829402.771916:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829402.771922:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829402/real 1787829402]  req@ffff9ee0056a21c0 x1874670273221248/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829427 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829402.771928:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a21c0 x1874670273221248/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829427 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829402.771933:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829402.771935:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829402.771936:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273221248:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829402.771948:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273221376:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829402.771958:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829402.771964:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829402/real 1787829402]  req@ffff9ee0056a2940 x1874670273221376/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829427 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829402.771970:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a2940 x1874670273221376/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829427 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829402.771976:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829402.771978:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829402.771980:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273221376:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787829403.603474:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829403.795444:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829404.627650:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829404.819440:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829405.651480:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829405.843389:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829406.675457:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829406.867424:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829407.699493:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829407.891388:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:0.0:1787829407.891424:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829407.891431:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1787829407.891435:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829407.891444:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4571
00000100:00080000:0.0:1787829407.891466:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829407.891474:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787829407.891509:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e92c0 x1874670273221504/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829407.891535:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829407.891542:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787829407.891544:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829407.891548:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4571
00000100:00080000:0.0:1787829407.891552:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829407.891557:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829407.891567:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787829407.891573:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273221504:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787829407.891583:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8b40 x1874670273221632/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829407.891595:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829407.891598:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787829407.891601:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829407.891604:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4571
00000100:00080000:0.0:1787829407.891608:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829407.891612:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829407.891617:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:3.0:1787829407.891628:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829407.891632:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb0c0 x1874670273221760/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829407.891644:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829407.891648:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787829407.891649:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829407.891653:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4571
00000100:00080000:0.0:1787829407.891658:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829407.891662:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787829407.891665:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829407/real 1787829407]  req@ffff9ee0056e92c0 x1874670273221504/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829432 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:0.0:1787829407.891669:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829407.891684:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e92c0 x1874670273221504/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829432 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829407.891690:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9a40 x1874670273221888/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829407.891695:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829407.891703:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829407.891711:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273221504:192.168.203.121@tcp:250:kworker.0
00000100:00080000:0.0:1787829407.891712:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829407.891718:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787829407.891721:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829407.891726:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4571
00000100:00080000:0.0:1787829407.891731:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1787829407.891734:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273221632:192.168.203.121@tcp:38:kworker.0
00000100:00080000:0.0:1787829407.891739:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829407.891747:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000800:00000100:3.0:1787829407.891758:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829407.891764:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ea580 x1874670273222016/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787829407.891770:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829407/real 1787829407]  req@ffff9ee0056e8b40 x1874670273221632/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829432 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829407.891785:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1787829407.891790:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8b40 x1874670273221632/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829432 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829407.891793:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787829407.891799:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829407.891802:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829407.891807:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4571
00000100:00080000:3.0:1787829407.891808:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829407.891814:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273221632:192.168.203.121@tcp:38:kworker.0
00000100:00080000:0.0:1787829407.891816:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1787829407.891821:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273221760:192.168.203.121@tcp:8:kworker.0
00000100:00080000:0.0:1787829407.891825:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829407.891833:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:3.0:1787829407.891840:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829407.891850:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9680 x1874670273222144/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787829407.891851:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829407/real 1787829407]  req@ffff9ee0056eb0c0 x1874670273221760/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829432 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829407.891883:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1787829407.891884:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb0c0 x1874670273221760/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829432 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829407.891893:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787829407.891899:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829407.891899:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829407.891908:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00080000:0.0:1787829407.891911:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4571
00000100:00100000:3.0:1787829407.891914:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273221760:192.168.203.121@tcp:8:kworker.0
00000100:00080000:0.0:1787829407.891918:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1787829407.891922:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273221888:192.168.203.121@tcp:8:kworker.0
00000100:00080000:0.0:1787829407.891927:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829407.891934:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:3.0:1787829407.891940:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829407.891949:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829407/real 1787829407]  req@ffff9ee0056e9a40 x1874670273221888/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829432 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829407.891954:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8780 x1874670273222272/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787829407.891970:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9a40 x1874670273221888/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829432 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829407.891981:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829407.891985:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829407.891989:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273221888:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829407.892006:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273222016:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787829407.892028:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829407.892038:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829407/real 1787829407]  req@ffff9ee0056ea580 x1874670273222016/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829432 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829407.892046:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ea580 x1874670273222016/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829432 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829407.892052:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829407.892054:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829407.892056:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273222016:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787829407.892059:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273222144:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829407.892071:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829407.892077:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829407/real 1787829407]  req@ffff9ee0056e9680 x1874670273222144/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829432 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829407.892084:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9680 x1874670273222144/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829432 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829407.892089:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829407.892090:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829407.892092:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273222144:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829407.892095:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273222272:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829407.892104:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829407.892110:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829407/real 1787829407]  req@ffff9ee0056e8780 x1874670273222272/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829432 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829407.892122:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8780 x1874670273222272/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829432 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829407.892130:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829407.892133:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829407.892137:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273222272:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787829408.723484:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829408.915411:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829409.747519:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829409.939426:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829410.771540:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829410.963433:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829411.795474:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829411.987401:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829412.819508:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1787829413.011442:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829413.011454:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00100000:2.0:1787829413.011458:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787829413.011459:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829413.011473:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4576
00000100:00080000:3.0:1787829413.011483:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829413.011490:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787829413.011532:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705680 x1874670273222400/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829413.011554:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829413.011558:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787829413.011560:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829413.011565:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4576
00000100:00080000:3.0:1787829413.011571:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829413.011576:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787829413.011583:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273222400:192.168.203.121@tcp:250:kworker.0
00000008:00100000:3.0:1787829413.011587:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787829413.011606:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707840 x1874670273222528/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829413.011619:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829413.011624:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787829413.011626:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829413.011630:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4576
00000100:00080000:3.0:1787829413.011636:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000800:00000100:0.0:1787829413.011639:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787829413.011645:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829413.011652:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829413.011668:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706940 x1874670273222656/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787829413.011675:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829413/real 1787829413]  req@ffff9ee005705680 x1874670273222400/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829438 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829413.011693:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705680 x1874670273222400/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829438 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829413.011694:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829413.011702:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787829413.011706:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829413.011716:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4576
00000100:00080000:0.0:1787829413.011717:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829413.011724:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829413.011725:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:3.0:1787829413.011732:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829413.011738:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787829413.011743:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273222400:192.168.203.121@tcp:250:kworker.0
00000100:00100000:3.0:1787829413.011754:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704000 x1874670273222784/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829413.011762:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829413.011765:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787829413.011766:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1787829413.011769:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273222528:192.168.203.121@tcp:38:kworker.0
00000100:00080000:3.0:1787829413.011773:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4576
00000100:00080000:3.0:1787829413.011779:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829413.011784:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829413.011788:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787829413.011798:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707480 x1874670273222912/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1787829413.011808:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787829413.011813:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829413.011818:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787829413.011820:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1787829413.011827:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829413/real 1787829413]  req@ffff9ee005707840 x1874670273222528/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829438 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829413.011827:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4576
00000100:00080000:3.0:1787829413.011834:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829413.011843:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829413.011851:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787829413.011853:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707840 x1874670273222528/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829438 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829413.011865:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:3.0:1787829413.011869:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057070c0 x1874670273223040/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829413.011870:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829413.011877:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273222528:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787829413.011887:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273222656:192.168.203.121@tcp:8:kworker.0
00000100:00080000:3.0:1787829413.011893:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829413.011898:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787829413.011900:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829413.011906:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4576
00000800:00000100:0.0:1787829413.011910:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787829413.011914:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829413.011920:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787829413.011923:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829413/real 1787829413]  req@ffff9ee005706940 x1874670273222656/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829438 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:3.0:1787829413.011926:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787829413.011938:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706940 x1874670273222656/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829438 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829413.011943:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057052c0 x1874670273223168/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829413.011947:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829413.011954:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829413.011960:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273222656:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829413.011970:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273222784:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829413.011984:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829413.011992:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829413/real 1787829413]  req@ffff9ee005704000 x1874670273222784/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829438 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829413.012003:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704000 x1874670273222784/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829438 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829413.012012:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829413.012016:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829413.012020:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273222784:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829413.012036:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273222912:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787829413.012056:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829413.012064:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829413/real 1787829413]  req@ffff9ee005707480 x1874670273222912/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829438 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829413.012073:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707480 x1874670273222912/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829438 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829413.012078:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829413.012080:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829413.012082:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273222912:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787829413.012086:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273223040:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829413.012096:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829413.012102:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829413/real 1787829413]  req@ffff9ee0057070c0 x1874670273223040/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829438 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829413.012110:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057070c0 x1874670273223040/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829438 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829413.012114:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829413.012116:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829413.012118:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273223040:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829413.012121:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273223168:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829413.012130:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829413.012135:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829413/real 1787829413]  req@ffff9ee0057052c0 x1874670273223168/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829438 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829413.012144:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057052c0 x1874670273223168/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829438 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829413.012158:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829413.012171:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829413.012174:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273223168:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787829413.843460:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829414.035455:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829414.867498:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829415.059422:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829415.891449:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829416.083392:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829416.915465:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829417.107409:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829417.939453:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829418.131379:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:0.0:1787829418.131399:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829418.131406:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1787829418.131410:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829418.131418:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4581
00000100:00080000:0.0:1787829418.131428:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829418.131433:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787829418.131462:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ea940 x1874670273223296/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829418.131483:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829418.131486:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787829418.131487:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829418.131490:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4581
00000100:00080000:0.0:1787829418.131492:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829418.131495:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829418.131502:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787829418.131510:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ead00 x1874670273223424/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787829418.131520:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273223296:192.168.203.121@tcp:250:kworker.0
00000100:00080000:0.0:1787829418.131527:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829418.131530:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787829418.131532:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829418.131535:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4581
00000100:00080000:0.0:1787829418.131537:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829418.131539:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829418.131543:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787829418.131552:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8780 x1874670273223552/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829418.131558:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829418.131560:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787829418.131562:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829418.131564:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4581
00000100:00080000:0.0:1787829418.131568:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829418.131570:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829418.131573:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:3.0:1787829418.131578:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829418.131585:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9680 x1874670273223680/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829418.131595:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829418.131599:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787829418.131601:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829418.131605:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4581
00000100:00080000:0.0:1787829418.131610:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829418.131615:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829418.131621:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787829418.131625:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829418/real 1787829418]  req@ffff9ee0056ea940 x1874670273223296/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829443 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829418.131635:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ea580 x1874670273223808/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787829418.131642:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ea940 x1874670273223296/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829443 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829418.131646:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829418.131655:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787829418.131659:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829418.131659:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829418.131670:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4581
00000100:00080000:3.0:1787829418.131670:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829418.131675:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273223296:192.168.203.121@tcp:250:kworker.0
00000100:00080000:0.0:1787829418.131678:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829418.131685:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829418.131691:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829418.131702:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273223424:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787829418.131706:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9a40 x1874670273223936/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829418.131716:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829418.131719:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787829418.131720:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829418.131723:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4581
00000100:00080000:0.0:1787829418.131727:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829418.131732:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000800:00000100:3.0:1787829418.131735:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000008:00100000:0.0:1787829418.131737:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787829418.131748:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb0c0 x1874670273224064/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787829418.131757:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829418/real 1787829418]  req@ffff9ee0056ead00 x1874670273223424/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829443 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829418.131772:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ead00 x1874670273223424/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829443 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829418.131778:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829418.131781:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829418.131784:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273223424:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787829418.131789:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273223552:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829418.131806:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829418.131814:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829418/real 1787829418]  req@ffff9ee0056e8780 x1874670273223552/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829443 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829418.131826:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8780 x1874670273223552/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829443 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829418.131833:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829418.131837:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829418.131840:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273223552:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829418.131846:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273223680:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829418.131880:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829418.131892:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829418/real 1787829418]  req@ffff9ee0056e9680 x1874670273223680/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829443 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829418.131904:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9680 x1874670273223680/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829443 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829418.131913:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829418.131917:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829418.131920:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273223680:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829418.131926:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273223808:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787829418.131944:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829418.131952:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829418/real 1787829418]  req@ffff9ee0056ea580 x1874670273223808/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829443 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829418.131960:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ea580 x1874670273223808/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829443 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829418.131970:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829418.131972:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829418.131974:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273223808:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787829418.131986:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273223936:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829418.131997:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829418.132003:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829418/real 1787829418]  req@ffff9ee0056e9a40 x1874670273223936/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829443 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829418.132010:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9a40 x1874670273223936/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829443 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829418.132015:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829418.132016:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829418.132018:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273223936:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829418.132022:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273224064:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829418.132031:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829418.132036:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829418/real 1787829418]  req@ffff9ee0056eb0c0 x1874670273224064/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829443 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829418.132043:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb0c0 x1874670273224064/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829443 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829418.132048:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829418.132050:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829418.132052:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273224064:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787829418.963471:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829419.155418:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829419.987496:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829420.179385:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829421.011531:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829421.203422:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829422.035506:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829422.227384:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829423.059523:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829423.251430:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:2.0:1787829423.251447:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829423.251453:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787829423.251456:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829423.251466:0:27707:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4586
00000100:00080000:2.0:1787829423.251475:0:27707:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829423.251481:0:27707:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787829423.251513:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728780 x1874670273224192/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829423.251533:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829423.251536:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787829423.251538:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829423.251541:0:27707:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4586
00000100:00080000:2.0:1787829423.251544:0:27707:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829423.251548:0:27707:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829423.251556:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787829423.251561:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273224192:192.168.203.121@tcp:250:kworker.0
00000100:00100000:2.0:1787829423.251573:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572bc00 x1874670273224320/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829423.251587:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829423.251591:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787829423.251593:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829423.251598:0:27707:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4586
00000100:00080000:2.0:1787829423.251604:0:27707:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829423.251609:0:27707:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829423.251615:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:3.0:1787829423.251618:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829423.251631:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057292c0 x1874670273224448/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829423.251639:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829423.251642:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787829423.251643:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829423.251646:0:27707:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4586
00000100:00080000:2.0:1787829423.251649:0:27707:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829423.251652:0:27707:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829423.251656:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787829423.251669:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729680 x1874670273224576/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787829423.251681:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829423/real 1787829423]  req@ffff9ee005728780 x1874670273224192/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829448 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829423.251682:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829423.251692:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787829423.251697:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829423.251703:0:27707:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4586
00000100:00080000:2.0:1787829423.251708:0:27707:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829423.251713:0:27707:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787829423.251717:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728780 x1874670273224192/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829448 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:2.0:1787829423.251720:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00080000:3.0:1787829423.251732:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829423.251736:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829423.251742:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a1c0 x1874670273224704/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787829423.251742:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273224192:192.168.203.121@tcp:250:kworker.0
00000100:00080000:2.0:1787829423.251760:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829423.251762:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787829423.251764:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829423.251769:0:27707:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4586
00000100:00100000:3.0:1787829423.251771:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273224320:192.168.203.121@tcp:38:kworker.0
00000100:00080000:2.0:1787829423.251774:0:27707:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829423.251780:0:27707:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829423.251784:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787829423.251794:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a940 x1874670273224832/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1787829423.251800:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:2.0:1787829423.251810:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829423.251813:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787829423.251814:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1787829423.251818:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829423/real 1787829423]  req@ffff9ee00572bc00 x1874670273224320/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829448 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829423.251821:0:27707:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4586
00000100:00080000:2.0:1787829423.251826:0:27707:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829423.251832:0:27707:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829423.251839:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829423.251843:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572bc00 x1874670273224320/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829448 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829423.251851:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729e00 x1874670273224960/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829423.251851:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829423.251860:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829423.251868:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273224320:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787829423.251876:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057292c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273224448:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829423.251894:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829423.251901:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829423/real 1787829423]  req@ffff9ee0057292c0 x1874670273224448/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829448 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829423.251908:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057292c0 x1874670273224448/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829448 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829423.251913:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829423.251915:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829423.251917:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057292c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273224448:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829423.251920:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273224576:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829423.251930:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829423.251936:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829423/real 1787829423]  req@ffff9ee005729680 x1874670273224576/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829448 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829423.251943:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729680 x1874670273224576/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829448 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829423.251947:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829423.251949:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829423.251951:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273224576:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829423.251954:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273224704:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787829423.251964:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829423.251969:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829423/real 1787829423]  req@ffff9ee00572a1c0 x1874670273224704/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829448 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829423.251980:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a1c0 x1874670273224704/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829448 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829423.251985:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829423.251987:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829423.251989:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273224704:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787829423.252001:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273224832:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829423.252011:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829423.252017:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829423/real 1787829423]  req@ffff9ee00572a940 x1874670273224832/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829448 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829423.252024:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a940 x1874670273224832/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829448 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829423.252029:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829423.252031:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829423.252033:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273224832:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829423.252036:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273224960:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829423.252045:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829423.252051:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829423/real 1787829423]  req@ffff9ee005729e00 x1874670273224960/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829448 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829423.252058:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729e00 x1874670273224960/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829448 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829423.252067:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829423.252069:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829423.252071:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273224960:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787829424.083475:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829424.275419:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829425.107504:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829425.299407:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829426.131475:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829426.323438:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829427.155486:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829427.347392:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829428.179461:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829428.371426:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:2.0:1787829428.371441:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829428.371450:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787829428.371455:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829428.371469:0:27707:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4592
00000100:00080000:2.0:1787829428.371484:0:27707:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829428.371494:0:27707:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787829428.371545:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057283c0 x1874670273225088/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829428.371577:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829428.371580:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787829428.371582:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829428.371585:0:27707:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4592
00000100:00080000:2.0:1787829428.371588:0:27707:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829428.371592:0:27707:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829428.371602:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787829428.371613:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728000 x1874670273225216/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829428.371627:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829428.371630:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787829428.371632:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1787829428.371636:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273225088:192.168.203.121@tcp:250:kworker.0
00000100:00080000:2.0:1787829428.371637:0:27707:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4592
00000100:00080000:2.0:1787829428.371642:0:27707:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829428.371646:0:27707:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829428.371649:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787829428.371657:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a580 x1874670273225344/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829428.371664:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829428.371667:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787829428.371668:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829428.371671:0:27707:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4592
00000100:00080000:2.0:1787829428.371673:0:27707:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829428.371675:0:27707:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829428.371678:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787829428.371685:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728b40 x1874670273225472/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829428.371692:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829428.371694:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787829428.371695:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829428.371698:0:27707:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4592
00000100:00080000:2.0:1787829428.371702:0:27707:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829428.371705:0:27707:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829428.371708:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787829428.371718:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728f00 x1874670273225600/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1787829428.371725:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:2.0:1787829428.371735:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829428.371739:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787829428.371742:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829428.371748:0:27707:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4592
00000100:00080000:2.0:1787829428.371753:0:27707:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829428.371758:0:27707:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829428.371764:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787829428.371778:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b840 x1874670273225728/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787829428.371787:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829428/real 1787829428]  req@ffff9ee0057283c0 x1874670273225088/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829453 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829428.371790:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829428.371799:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787829428.371803:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829428.371810:0:27707:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4592
00000100:00100000:3.0:1787829428.371813:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057283c0 x1874670273225088/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829453 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829428.371818:0:27707:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829428.371827:0:27707:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00080000:3.0:1787829428.371827:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829428.371836:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000008:00100000:2.0:1787829428.371838:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829428.371840:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273225088:192.168.203.121@tcp:250:kworker.0
00000100:00100000:2.0:1787829428.371857:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729a40 x1874670273225856/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787829428.371867:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273225216:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787829428.371895:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829428.371908:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829428/real 1787829428]  req@ffff9ee005728000 x1874670273225216/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829453 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829428.371929:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728000 x1874670273225216/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829453 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829428.371939:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829428.371942:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829428.371947:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273225216:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787829428.371955:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273225344:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829428.371980:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829428.371993:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829428/real 1787829428]  req@ffff9ee00572a580 x1874670273225344/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829453 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829428.372006:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a580 x1874670273225344/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829453 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829428.372015:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829428.372018:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829428.372022:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273225344:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829428.372029:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273225472:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829428.372049:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829428.372058:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829428/real 1787829428]  req@ffff9ee005728b40 x1874670273225472/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829453 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829428.372072:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728b40 x1874670273225472/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829453 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829428.372080:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829428.372084:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829428.372088:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273225472:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829428.372095:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273225600:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787829428.372128:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829428.372141:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829428/real 1787829428]  req@ffff9ee005728f00 x1874670273225600/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829453 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829428.372155:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728f00 x1874670273225600/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829453 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829428.372161:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829428.372163:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829428.372166:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273225600:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787829428.372170:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273225728:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829428.372187:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829428.372198:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829428/real 1787829428]  req@ffff9ee00572b840 x1874670273225728/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829453 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829428.372211:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b840 x1874670273225728/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829453 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829428.372220:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829428.372224:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829428.372228:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273225728:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829428.372253:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273225856:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829428.372276:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829428.372288:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829428/real 1787829428]  req@ffff9ee005729a40 x1874670273225856/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829453 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829428.372299:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729a40 x1874670273225856/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829453 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829428.372307:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829428.372309:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829428.372311:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273225856:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787829429.203479:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829429.395418:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829430.227454:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829430.419432:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829431.251458:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829431.443425:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829432.275495:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829432.467421:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829433.299433:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1787829433.491397:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1787829433.491400:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:2.0:1787829433.491408:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787829433.491412:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829433.491421:0:27707:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4597
00000100:00080000:2.0:1787829433.491431:0:27707:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829433.491437:0:27707:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787829433.491467:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572ad00 x1874670273225984/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829433.491493:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829433.491496:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787829433.491498:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829433.491502:0:27707:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4597
00000100:00080000:2.0:1787829433.491505:0:27707:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829433.491508:0:27707:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829433.491517:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787829433.491527:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b480 x1874670273226112/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787829433.491537:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273225984:192.168.203.121@tcp:250:kworker.0
00000100:00080000:2.0:1787829433.491538:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829433.491544:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787829433.491549:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829433.491553:0:27707:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4597
00000100:00080000:2.0:1787829433.491556:0:27707:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829433.491560:0:27707:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829433.491565:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787829433.491574:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b0c0 x1874670273226240/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829433.491581:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829433.491584:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787829433.491585:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829433.491588:0:27707:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4597
00000100:00080000:2.0:1787829433.491603:0:27707:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829433.491606:0:27707:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829433.491609:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:3.0:1787829433.491621:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829433.491622:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729a40 x1874670273226368/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829433.491642:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829433.491646:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787829433.491648:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829433.491654:0:27707:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4597
00000100:00080000:2.0:1787829433.491659:0:27707:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829433.491666:0:27707:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829433.491672:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787829433.491684:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b840 x1874670273226496/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829433.491690:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829433.491693:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787829433.491695:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829433.491697:0:27707:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4597
00000100:00080000:2.0:1787829433.491699:0:27707:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829433.491702:0:27707:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829433.491705:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787829433.491711:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728f00 x1874670273226624/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829433.491717:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829433.491720:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787829433.491721:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829433.491723:0:27707:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4597
00000100:00080000:2.0:1787829433.491726:0:27707:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829433.491728:0:27707:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829433.491730:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829433.491731:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829433/real 1787829433]  req@ffff9ee00572ad00 x1874670273225984/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829458 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829433.491737:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728b40 x1874670273226752/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787829433.491775:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572ad00 x1874670273225984/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829458 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829433.491902:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829433.491909:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829433.491914:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273225984:192.168.203.121@tcp:250:kworker.0
00000100:00100000:3.0:1787829433.491982:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273226112:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787829433.492012:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829433.492036:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829433/real 1787829433]  req@ffff9ee00572b480 x1874670273226112/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829458 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829433.492051:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b480 x1874670273226112/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829458 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829433.492059:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829433.492063:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829433.492067:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273226112:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787829433.492074:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273226240:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829433.492097:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829433.492109:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829433/real 1787829433]  req@ffff9ee00572b0c0 x1874670273226240/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829458 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829433.492122:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b0c0 x1874670273226240/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829458 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829433.492131:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829433.492134:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829433.492138:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273226240:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829433.492145:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273226368:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829433.492165:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829433.492177:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829433/real 1787829433]  req@ffff9ee005729a40 x1874670273226368/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829458 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829433.492189:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729a40 x1874670273226368/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829458 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829433.492197:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829433.492201:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829433.492204:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273226368:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829433.492210:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273226496:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787829433.492230:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829433.492243:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829433/real 1787829433]  req@ffff9ee00572b840 x1874670273226496/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829458 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829433.492256:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b840 x1874670273226496/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829458 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829433.492265:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829433.492268:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829433.492271:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273226496:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787829433.492293:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273226624:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829433.492345:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829433.492365:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829433/real 1787829433]  req@ffff9ee005728f00 x1874670273226624/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829458 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829433.492378:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728f00 x1874670273226624/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829458 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829433.492386:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829433.492389:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829433.492393:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273226624:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829433.492399:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273226752:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829433.492420:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829433.492432:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829433/real 1787829433]  req@ffff9ee005728b40 x1874670273226752/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829458 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829433.492444:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728b40 x1874670273226752/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829458 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829433.492453:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829433.492456:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829433.492459:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273226752:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787829434.323477:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829434.515422:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829435.347456:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829435.539436:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829436.371467:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829436.563414:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829437.395439:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829437.587393:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829438.419523:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829438.611420:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787829438.611425:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829438.611432:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787829438.611435:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829438.611444:0:27707:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4602
00000100:00080000:3.0:1787829438.611453:0:27707:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829438.611460:0:27707:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787829438.611489:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707c00 x1874670273226880/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829438.611519:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829438.611522:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787829438.611523:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829438.611526:0:27707:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4602
00000100:00080000:3.0:1787829438.611528:0:27707:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829438.611530:0:27707:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829438.611538:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787829438.611547:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057061c0 x1874670273227008/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829438.611556:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829438.611561:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00100000:0.0:1787829438.611562:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273226880:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787829438.611563:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829438.611572:0:27707:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4602
00000100:00080000:3.0:1787829438.611575:0:27707:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829438.611577:0:27707:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829438.611580:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829438.611593:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057052c0 x1874670273227136/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829438.611613:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829438.611617:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787829438.611619:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:0.0:1787829438.611622:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787829438.611629:0:27707:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4602
00000100:00080000:3.0:1787829438.611636:0:27707:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829438.611641:0:27707:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829438.611647:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787829438.611657:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829438/real 1787829438]  req@ffff9ee005707c00 x1874670273226880/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829463 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829438.611665:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057070c0 x1874670273227264/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787829438.611675:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707c00 x1874670273226880/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829463 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829438.611681:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829438.611686:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829438.611687:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787829438.611690:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829438.611697:0:27707:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4602
00000100:00080000:0.0:1787829438.611703:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:3.0:1787829438.611703:0:27707:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1787829438.611709:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273226880:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787829438.611715:0:27707:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829438.611722:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787829438.611729:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273227008:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787829438.611738:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707480 x1874670273227392/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1787829438.611749:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829438.611758:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829438/real 1787829438]  req@ffff9ee0057061c0 x1874670273227008/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829463 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829438.611766:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829438.611775:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787829438.611779:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1787829438.611781:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057061c0 x1874670273227008/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829463 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829438.611788:0:27707:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4602
00000100:00080000:0.0:1787829438.611790:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829438.611795:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00080000:3.0:1787829438.611795:0:27707:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1787829438.611798:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273227008:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787829438.611806:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273227136:192.168.203.121@tcp:8:kworker.0
00000100:00080000:3.0:1787829438.611806:0:27707:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829438.611818:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:0.0:1787829438.611827:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829438.611838:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829438/real 1787829438]  req@ffff9ee0057052c0 x1874670273227136/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829463 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829438.611838:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704000 x1874670273227520/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787829438.611870:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057052c0 x1874670273227136/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829463 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829438.611875:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829438.611878:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00080000:3.0:1787829438.611881:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1787829438.611882:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273227136:192.168.203.121@tcp:8:kworker.0
00000100:00080000:3.0:1787829438.611891:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:0.0:1787829438.611892:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273227264:192.168.203.121@tcp:8:kworker.0
00000100:00080000:3.0:1787829438.611897:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829438.611905:0:27707:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4602
00000800:00000100:0.0:1787829438.611910:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787829438.611912:0:27707:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1787829438.611918:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829438/real 1787829438]  req@ffff9ee0057070c0 x1874670273227264/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829463 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829438.611922:0:27707:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829438.611934:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787829438.611936:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057070c0 x1874670273227264/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829463 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829438.611949:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:3.0:1787829438.611953:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706940 x1874670273227648/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829438.611954:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829438.611960:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273227264:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829438.611978:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273227392:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787829438.611993:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829438.612000:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829438/real 1787829438]  req@ffff9ee005707480 x1874670273227392/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829463 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829438.612007:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707480 x1874670273227392/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829463 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829438.612013:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829438.612015:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829438.612016:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273227392:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787829438.612020:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273227520:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829438.612029:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829438.612035:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829438/real 1787829438]  req@ffff9ee005704000 x1874670273227520/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829463 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829438.612041:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704000 x1874670273227520/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829463 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829438.612046:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829438.612048:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829438.612051:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273227520:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829438.612054:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273227648:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829438.612063:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829438.612068:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829438/real 1787829438]  req@ffff9ee005706940 x1874670273227648/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829463 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829438.612075:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706940 x1874670273227648/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829463 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829438.612080:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829438.612082:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829438.612084:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273227648:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787829439.443500:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829439.635391:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829440.467479:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829440.659413:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829441.491456:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829441.683380:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829442.515487:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829442.707407:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829443.539481:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829443.731371:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:2.0:1787829443.731412:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829443.731417:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787829443.731420:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829443.731428:0:27707:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4607
00000100:00080000:2.0:1787829443.731438:0:27707:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829443.731444:0:27707:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787829443.731473:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a580 x1874670273227776/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829443.731495:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829443.731498:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787829443.731499:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829443.731502:0:27707:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4607
00000100:00080000:2.0:1787829443.731504:0:27707:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829443.731507:0:27707:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829443.731514:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787829443.731522:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728000 x1874670273227904/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829443.731530:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829443.731532:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787829443.731533:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829443.731536:0:27707:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4607
00000100:00080000:2.0:1787829443.731538:0:27707:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829443.731541:0:27707:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829443.731546:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787829443.731551:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057283c0 x1874670273228032/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787829443.731561:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273227776:192.168.203.121@tcp:250:kworker.0
00000100:00080000:2.0:1787829443.731561:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829443.731566:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787829443.731570:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829443.731574:0:27707:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4607
00000100:00080000:2.0:1787829443.731576:0:27707:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829443.731578:0:27707:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829443.731580:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787829443.731596:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729e00 x1874670273228160/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829443.731602:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829443.731604:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787829443.731605:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829443.731609:0:27707:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4607
00000100:00080000:2.0:1787829443.731611:0:27707:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829443.731614:0:27707:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829443.731617:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787829443.731628:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a940 x1874670273228288/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1787829443.731637:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:2.0:1787829443.731637:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829443.731643:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787829443.731645:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829443.731648:0:27707:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4607
00000100:00080000:2.0:1787829443.731650:0:27707:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829443.731653:0:27707:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829443.731657:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787829443.731666:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a1c0 x1874670273228416/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829443.731672:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829443.731674:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787829443.731676:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829443.731679:0:27707:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4607
00000100:00080000:2.0:1787829443.731682:0:27707:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1787829443.731685:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829443/real 1787829443]  req@ffff9ee00572a580 x1874670273227776/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829468 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829443.731687:0:27707:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829443.731694:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787829443.731706:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729680 x1874670273228544/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787829443.731711:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a580 x1874670273227776/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829468 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829443.731731:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829443.731734:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829443.731737:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273227776:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787829443.731745:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273227904:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787829443.731763:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829443.731773:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829443/real 1787829443]  req@ffff9ee005728000 x1874670273227904/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829468 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829443.731781:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728000 x1874670273227904/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829468 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829443.731786:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829443.731789:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829443.731791:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273227904:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787829443.731816:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273228032:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829443.731829:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829443.731836:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829443/real 1787829443]  req@ffff9ee0057283c0 x1874670273228032/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829468 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829443.731844:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057283c0 x1874670273228032/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829468 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829443.731850:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829443.731852:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829443.731854:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273228032:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829443.731857:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273228160:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829443.731866:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829443.731871:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829443/real 1787829443]  req@ffff9ee005729e00 x1874670273228160/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829468 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829443.731879:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729e00 x1874670273228160/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829468 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829443.731884:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829443.731886:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829443.731887:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273228160:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829443.731891:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273228288:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787829443.731900:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829443.731906:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829443/real 1787829443]  req@ffff9ee00572a940 x1874670273228288/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829468 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829443.731913:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a940 x1874670273228288/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829468 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829443.731918:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829443.731919:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829443.731921:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273228288:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787829443.731925:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273228416:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829443.731934:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829443.731939:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829443/real 1787829443]  req@ffff9ee00572a1c0 x1874670273228416/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829468 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829443.731945:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a1c0 x1874670273228416/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829468 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829443.731954:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829443.731956:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829443.731958:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273228416:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829443.731961:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273228544:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829443.731970:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829443.731976:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829443/real 1787829443]  req@ffff9ee005729680 x1874670273228544/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829468 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829443.731982:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729680 x1874670273228544/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829468 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829443.731987:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829443.731989:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829443.731991:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273228544:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787829444.563503:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829444.755405:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829445.587460:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829445.779439:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829446.611479:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829446.803409:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829447.635456:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829447.827428:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829448.659495:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829448.851397:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:2.0:1787829448.851410:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829448.851416:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787829448.851420:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829448.851428:0:27707:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4612
00000100:00080000:2.0:1787829448.851438:0:27707:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829448.851447:0:27707:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787829448.851490:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057292c0 x1874670273228672/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829448.851510:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829448.851513:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787829448.851514:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829448.851517:0:27707:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4612
00000100:00080000:2.0:1787829448.851523:0:27707:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829448.851528:0:27707:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787829448.851536:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057292c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273228672:192.168.203.121@tcp:250:kworker.0
00000008:00100000:2.0:1787829448.851538:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787829448.851556:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572bc00 x1874670273228800/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829448.851568:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829448.851571:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787829448.851573:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829448.851576:0:27707:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4612
00000100:00080000:2.0:1787829448.851579:0:27707:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829448.851582:0:27707:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829448.851586:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787829448.851595:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728780 x1874670273228928/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829448.851602:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829448.851604:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787829448.851605:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829448.851608:0:27707:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4612
00000100:00080000:2.0:1787829448.851611:0:27707:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829448.851615:0:27707:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829448.851621:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787829448.851635:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729680 x1874670273229056/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787829448.851650:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273228800:192.168.203.121@tcp:38:kworker.0
00000100:00080000:2.0:1787829448.851656:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829448.851660:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787829448.851662:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829448.851668:0:27707:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4612
00000100:00080000:2.0:1787829448.851672:0:27707:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829448.851678:0:27707:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829448.851682:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787829448.851694:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a1c0 x1874670273229184/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787829448.851701:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273228928:192.168.203.121@tcp:8:kworker.0
00000100:00080000:2.0:1787829448.851708:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829448.851713:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787829448.851715:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829448.851720:0:27707:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4612
00000100:00080000:2.0:1787829448.851726:0:27707:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829448.851730:0:27707:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829448.851736:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787829448.851744:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273229056:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787829448.851750:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a940 x1874670273229312/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829448.851762:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829448.851766:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787829448.851768:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829448.851772:0:27707:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4612
00000100:00080000:2.0:1787829448.851777:0:27707:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829448.851782:0:27707:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787829448.851785:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273229184:192.168.203.121@tcp:38:kworker.0
00000008:00100000:2.0:1787829448.851790:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787829448.851806:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729e00 x1874670273229440/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787829448.851826:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273229312:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829448.851850:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273229440:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787829449.683433:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829449.875435:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829450.707525:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829450.899430:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829451.731494:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829451.923397:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000400:00000100:3.0:1787829451.923513:0:2353:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.203.121:988
00000400:00000100:3.0:1787829451.923545:0:2353:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.203.121@tcp at host 192.168.203.121 was unreachable: the network or that node may be down, or Lustre may be misconfigured.
00000800:00000100:3.0:1787829451.923598:0:2353:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:3.0:1787829451.923639:0:2353:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:3.0:1787829451.923649:0:2353:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:3.0:1787829451.923658:0:2353:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:3.0:1787829451.923668:0:2353:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:3.0:1787829451.923679:0:2353:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:3.0:1787829451.923693:0:2353:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000100:00100000:0.0:1787829451.923697:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829448/real 1787829451]  req@ffff9ee005729680 x1874670273229056/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829473 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829451.923722:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729680 x1874670273229056/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829473 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829451.923734:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829451.923739:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829451.923743:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273229056:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829451.923751:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829448/real 1787829451]  req@ffff9ee00572a1c0 x1874670273229184/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829473 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829451.923764:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a1c0 x1874670273229184/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829473 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829451.923771:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829451.923775:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829451.923787:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273229184:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787829451.923796:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829448/real 1787829451]  req@ffff9ee00572bc00 x1874670273228800/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829473 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829451.923809:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572bc00 x1874670273228800/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829473 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829451.923818:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829451.923822:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829451.923826:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273228800:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787829451.923833:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829448/real 1787829451]  req@ffff9ee005728780 x1874670273228928/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829473 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829451.923850:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728780 x1874670273228928/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829473 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829451.923860:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829451.923862:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829451.923865:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273228928:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829451.923870:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829448/real 1787829451]  req@ffff9ee0057292c0 x1874670273228672/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829473 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829451.923884:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057292c0 x1874670273228672/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829473 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829451.923892:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829451.923896:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829451.923899:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057292c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273228672:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787829451.923928:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829448/real 1787829451]  req@ffff9ee00572a940 x1874670273229312/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829473 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829451.923941:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a940 x1874670273229312/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829473 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829451.923950:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829451.923954:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829451.923957:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273229312:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829451.923964:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829448/real 1787829451]  req@ffff9ee005729e00 x1874670273229440/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829473 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829451.923977:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729e00 x1874670273229440/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829473 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829451.923986:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829451.923989:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829451.923992:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273229440:192.168.203.121@tcp:8:kworker.0
00010000:00010000:0.0:1787829452.755466:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829452.947400:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829453.779493:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829453.971388:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787829453.971461:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829453.971467:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787829453.971470:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829453.971478:0:27707:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4617
00000100:00080000:3.0:1787829453.971487:0:27707:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829453.971493:0:27707:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787829453.971523:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707840 x1874670273229568/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829453.971554:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829453.971559:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787829453.971561:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829453.971565:0:27707:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4617
00000100:00080000:3.0:1787829453.971569:0:27707:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829453.971574:0:27707:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829453.971585:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787829453.971599:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705680 x1874670273229696/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829453.971612:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829453.971616:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787829453.971618:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829453.971624:0:27707:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4617
00000100:00080000:3.0:1787829453.971628:0:27707:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829453.971633:0:27707:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829453.971640:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787829453.971641:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273229568:192.168.203.121@tcp:250:kworker.0
00000100:00100000:3.0:1787829453.971657:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704780 x1874670273229824/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829453.971671:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829453.971675:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787829453.971677:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829453.971682:0:27707:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4617
00000100:00080000:3.0:1787829453.971686:0:27707:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829453.971691:0:27707:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829453.971696:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829453.971710:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057043c0 x1874670273229952/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1787829453.971720:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787829453.971728:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829453.971733:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787829453.971735:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829453.971743:0:27707:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4617
00000100:00080000:3.0:1787829453.971747:0:27707:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829453.971752:0:27707:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829453.971757:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787829453.971767:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829453/real 1787829453]  req@ffff9ee005707840 x1874670273229568/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829478 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829453.971773:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705a40 x1874670273230080/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829453.971794:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829453.971798:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787829453.971799:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829453.971804:0:27707:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4617
00000100:00080000:3.0:1787829453.971809:0:27707:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1787829453.971815:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707840 x1874670273229568/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829478 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829453.971816:0:27707:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829453.971826:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:0.0:1787829453.971833:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:3.0:1787829453.971839:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704b40 x1874670273230208/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829453.971842:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:3.0:1787829453.971852:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829453.971855:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787829453.971856:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829453.971862:0:27707:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4617
00000100:00100000:0.0:1787829453.971863:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273229568:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787829453.971866:0:27707:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829453.971873:0:27707:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787829453.971880:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273229696:192.168.203.121@tcp:38:kworker.0
00000008:00100000:3.0:1787829453.971880:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829453.971896:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706580 x1874670273230336/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1787829453.971918:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829453.971938:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829453/real 1787829453]  req@ffff9ee005705680 x1874670273229696/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829478 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829453.971954:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705680 x1874670273229696/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829478 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829453.971962:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829453.971966:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829453.971970:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273229696:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787829453.972002:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273229824:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829453.972028:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829453.972041:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829453/real 1787829453]  req@ffff9ee005704780 x1874670273229824/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829478 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829453.972053:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704780 x1874670273229824/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829478 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829453.972062:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829453.972066:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829453.972070:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273229824:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829453.972092:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273229952:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829453.972112:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829453.972123:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829453/real 1787829453]  req@ffff9ee0057043c0 x1874670273229952/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829478 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829453.972159:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057043c0 x1874670273229952/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829478 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829453.972168:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829453.972171:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829453.972175:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273229952:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829453.972182:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273230080:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787829453.972202:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829453.972214:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829453/real 1787829453]  req@ffff9ee005705a40 x1874670273230080/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829478 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829453.972226:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705a40 x1874670273230080/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829478 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829453.972233:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829453.972236:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829453.972239:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273230080:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787829453.972245:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273230208:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829453.972263:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829453.972273:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829453/real 1787829453]  req@ffff9ee005704b40 x1874670273230208/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829478 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829453.972283:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704b40 x1874670273230208/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829478 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829453.972296:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829453.972299:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829453.972302:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273230208:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829453.972307:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273230336:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829453.972375:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829453.972388:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829453/real 1787829453]  req@ffff9ee005706580 x1874670273230336/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829478 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829453.972402:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706580 x1874670273230336/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829478 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829453.972411:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829453.972415:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829453.972419:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273230336:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787829454.803504:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829454.995433:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829455.827471:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829456.019436:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829456.851494:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829457.043416:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829457.875518:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829458.067434:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829458.899491:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829459.091403:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:0.0:1787829459.091425:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829459.091431:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1787829459.091434:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829459.091444:0:27707:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4622
00000100:00080000:0.0:1787829459.091455:0:27707:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829459.091463:0:27707:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787829459.091499:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8b40 x1874670273230464/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829459.091523:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829459.091526:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787829459.091527:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829459.091530:0:27707:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4622
00000100:00080000:0.0:1787829459.091534:0:27707:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829459.091537:0:27707:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829459.091546:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787829459.091554:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273230464:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787829459.091557:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e92c0 x1874670273230592/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829459.091570:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829459.091572:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787829459.091573:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829459.091576:0:27707:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4622
00000100:00080000:0.0:1787829459.091579:0:27707:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829459.091581:0:27707:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829459.091584:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787829459.091593:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb480 x1874670273230720/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829459.091599:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829459.091601:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787829459.091603:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829459.091605:0:27707:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4622
00000100:00080000:0.0:1787829459.091616:0:27707:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829459.091619:0:27707:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829459.091623:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:3.0:1787829459.091625:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829459.091634:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb840 x1874670273230848/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829459.091643:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829459.091646:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787829459.091647:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829459.091650:0:27707:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4622
00000100:00080000:0.0:1787829459.091652:0:27707:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829459.091655:0:27707:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829459.091660:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787829459.091663:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829459/real 1787829459]  req@ffff9ee0056e8b40 x1874670273230464/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829484 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829459.091671:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8f00 x1874670273230976/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829459.091681:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1787829459.091684:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8b40 x1874670273230464/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829484 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829459.091685:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787829459.091688:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829459.091696:0:27707:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4622
00000100:00080000:3.0:1787829459.091702:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829459.091706:0:27707:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829459.091707:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:0.0:1787829459.091714:0:27707:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787829459.091715:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273230464:192.168.203.121@tcp:250:kworker.0
00000008:00100000:0.0:1787829459.091719:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787829459.091730:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e83c0 x1874670273231104/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787829459.091736:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273230592:192.168.203.121@tcp:38:kworker.0
00000100:00080000:0.0:1787829459.091751:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829459.091754:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787829459.091756:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829459.091760:0:27707:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4622
00000800:00000100:3.0:1787829459.091764:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:0.0:1787829459.091766:0:27707:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829459.091771:0:27707:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829459.091775:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829459.091778:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829459/real 1787829459]  req@ffff9ee0056e92c0 x1874670273230592/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829484 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829459.091794:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ebc00 x1874670273231232/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787829459.091794:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e92c0 x1874670273230592/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829484 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829459.091823:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829459.091826:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829459.091829:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273230592:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787829459.091834:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273230720:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829459.091850:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829459.091857:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829459/real 1787829459]  req@ffff9ee0056eb480 x1874670273230720/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829484 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829459.091865:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb480 x1874670273230720/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829484 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829459.091870:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829459.091872:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829459.091874:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273230720:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829459.091878:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273230848:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829459.091888:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829459.091893:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829459/real 1787829459]  req@ffff9ee0056eb840 x1874670273230848/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829484 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829459.091900:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb840 x1874670273230848/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829484 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829459.091905:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829459.091907:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829459.091908:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273230848:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829459.091912:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273230976:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787829459.091921:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829459.091926:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829459/real 1787829459]  req@ffff9ee0056e8f00 x1874670273230976/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829484 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829459.091938:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8f00 x1874670273230976/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829484 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829459.091943:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829459.091945:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829459.091947:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273230976:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787829459.091957:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273231104:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829459.091967:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829459.091972:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829459/real 1787829459]  req@ffff9ee0056e83c0 x1874670273231104/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829484 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829459.091979:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e83c0 x1874670273231104/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829484 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829459.091983:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829459.091986:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829459.091988:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273231104:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829459.091991:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273231232:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829459.092000:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829459.092005:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829459/real 1787829459]  req@ffff9ee0056ebc00 x1874670273231232/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829484 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829459.092011:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ebc00 x1874670273231232/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829484 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829459.092020:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829459.092022:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829459.092025:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273231232:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787829459.923501:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829460.115421:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829460.947500:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829461.139379:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829461.971468:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829462.163460:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829462.995474:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829463.187427:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829464.019476:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1787829464.211416:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1787829464.211418:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787829464.211427:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787829464.211433:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829464.211442:0:27707:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4627
00000100:00080000:3.0:1787829464.211453:0:27707:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829464.211460:0:27707:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787829464.211496:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705e00 x1874670273231360/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829464.211531:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829464.211535:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787829464.211537:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829464.211544:0:27707:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4627
00000100:00080000:3.0:1787829464.211548:0:27707:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829464.211552:0:27707:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829464.211562:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787829464.211573:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706d00 x1874670273231488/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829464.211586:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829464.211594:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00100000:0.0:1787829464.211595:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273231360:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787829464.211597:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829464.211614:0:27707:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4627
00000100:00080000:3.0:1787829464.211618:0:27707:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829464.211622:0:27707:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829464.211628:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829464.211646:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706580 x1874670273231616/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829464.211657:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829464.211661:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787829464.211662:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829464.211666:0:27707:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4627
00000100:00080000:3.0:1787829464.211671:0:27707:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829464.211675:0:27707:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829464.211680:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:0.0:1787829464.211687:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829464.211700:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704b40 x1874670273231744/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829464.211714:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829464.211719:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787829464.211720:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829464.211725:0:27707:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4627
00000100:00080000:3.0:1787829464.211730:0:27707:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829464.211733:0:27707:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829464.211739:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787829464.211748:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705a40 x1874670273231872/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829464.211758:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829464.211761:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787829464.211763:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829464.211767:0:27707:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4627
00000100:00080000:3.0:1787829464.211770:0:27707:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829464.211773:0:27707:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829464.211778:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829464.211786:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057043c0 x1874670273232000/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829464.211794:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829464.211798:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787829464.211799:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829464.211802:0:27707:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4627
00000100:00080000:3.0:1787829464.211816:0:27707:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829464.211819:0:27707:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829464.211824:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829464.211833:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704780 x1874670273232128/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787829464.212897:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829464/real 1787829464]  req@ffff9ee005705e00 x1874670273231360/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829489 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829464.212916:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705e00 x1874670273231360/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829489 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829464.212932:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829464.212938:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829464.212943:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273231360:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787829464.212976:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273231488:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787829464.213001:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829464.213011:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829464/real 1787829464]  req@ffff9ee005706d00 x1874670273231488/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829489 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829464.213021:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706d00 x1874670273231488/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829489 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829464.213027:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829464.213030:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829464.213032:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273231488:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787829464.213037:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273231616:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829464.213050:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829464.213057:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829464/real 1787829464]  req@ffff9ee005706580 x1874670273231616/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829489 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829464.213083:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706580 x1874670273231616/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829489 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829464.213090:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829464.213092:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829464.213095:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273231616:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829464.213100:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273231744:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829464.213116:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829464.213123:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829464/real 1787829464]  req@ffff9ee005704b40 x1874670273231744/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829489 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829464.213137:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704b40 x1874670273231744/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829489 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829464.213142:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829464.213144:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829464.213146:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273231744:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829464.213150:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273231872:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787829464.213161:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829464.213167:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829464/real 1787829464]  req@ffff9ee005705a40 x1874670273231872/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829489 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829464.213174:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705a40 x1874670273231872/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829489 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829464.213179:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829464.213181:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829464.213183:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273231872:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787829464.213187:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273232000:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829464.213197:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829464.213203:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829464/real 1787829464]  req@ffff9ee0057043c0 x1874670273232000/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829489 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829464.213209:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057043c0 x1874670273232000/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829489 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829464.213218:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829464.213221:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829464.213223:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273232000:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829464.213226:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273232128:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829464.213238:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829464.213243:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829464/real 1787829464]  req@ffff9ee005704780 x1874670273232128/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829489 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829464.213249:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704780 x1874670273232128/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829489 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829464.213254:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829464.213256:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829464.213258:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273232128:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787829465.043477:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829465.235423:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829466.067516:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829466.259403:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829467.091452:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829467.283436:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829468.115522:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829468.307439:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829469.139496:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829469.331415:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787829469.331416:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829469.331425:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787829469.331428:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829469.331436:0:27707:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4633
00000100:00080000:3.0:1787829469.331445:0:27707:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829469.331451:0:27707:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787829469.331485:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705680 x1874670273232256/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829469.331509:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829469.331512:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787829469.331514:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829469.331517:0:27707:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4633
00000100:00080000:3.0:1787829469.331520:0:27707:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829469.331523:0:27707:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829469.331531:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787829469.331545:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707840 x1874670273232384/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829469.331557:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829469.331563:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00100000:0.0:1787829469.331564:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273232256:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787829469.331566:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829469.331575:0:27707:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4633
00000100:00080000:3.0:1787829469.331579:0:27707:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829469.331594:0:27707:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829469.331604:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829469.331615:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706940 x1874670273232512/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1787829469.331623:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787829469.331630:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829469.331634:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787829469.331635:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829469.331640:0:27707:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4633
00000100:00080000:3.0:1787829469.331643:0:27707:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829469.331646:0:27707:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829469.331649:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829469.331659:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704000 x1874670273232640/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829469.331665:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829469.331667:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787829469.331671:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1787829469.331672:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829469/real 1787829469]  req@ffff9ee005705680 x1874670273232256/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829494 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829469.331676:0:27707:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4633
00000100:00080000:3.0:1787829469.331682:0:27707:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829469.331688:0:27707:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787829469.331695:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705680 x1874670273232256/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829494 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:3.0:1787829469.331695:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787829469.331713:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707480 x1874670273232768/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829469.331719:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829469.331728:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:3.0:1787829469.331730:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829469.331735:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00100000:0.0:1787829469.331737:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273232256:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787829469.331738:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829469.331746:0:27707:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4633
00000100:00080000:3.0:1787829469.331751:0:27707:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829469.331756:0:27707:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829469.331762:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787829469.331767:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273232384:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787829469.331775:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057070c0 x1874670273232896/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829469.331787:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:0.0:1787829469.331792:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787829469.331792:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787829469.331795:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829469.331801:0:27707:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4633
00000100:00080000:3.0:1787829469.331805:0:27707:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1787829469.331808:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829469/real 1787829469]  req@ffff9ee005707840 x1874670273232384/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829494 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829469.331811:0:27707:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829469.331818:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787829469.331825:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707840 x1874670273232384/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829494 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829469.331832:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:3.0:1787829469.331834:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057052c0 x1874670273233024/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829469.331838:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829469.331844:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273232384:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787829469.331856:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273232512:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829469.331872:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829469.331879:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829469/real 1787829469]  req@ffff9ee005706940 x1874670273232512/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829494 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829469.331889:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706940 x1874670273232512/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829494 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829469.331895:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829469.331897:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829469.331899:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273232512:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829469.331905:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273232640:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829469.331918:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829469.331925:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829469/real 1787829469]  req@ffff9ee005704000 x1874670273232640/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829494 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829469.331937:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704000 x1874670273232640/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829494 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829469.331943:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829469.331945:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829469.331947:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273232640:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829469.331951:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273232768:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787829469.331963:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829469.331969:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829469/real 1787829469]  req@ffff9ee005707480 x1874670273232768/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829494 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829469.331977:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707480 x1874670273232768/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829494 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829469.331982:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829469.331984:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829469.331986:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273232768:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787829469.332010:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273232896:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829469.332026:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829469.332051:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829469/real 1787829469]  req@ffff9ee0057070c0 x1874670273232896/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829494 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829469.332061:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057070c0 x1874670273232896/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829494 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829469.332067:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829469.332069:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829469.332073:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273232896:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829469.332078:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273233024:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829469.332093:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829469.332116:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829469/real 1787829469]  req@ffff9ee0057052c0 x1874670273233024/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829494 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829469.332126:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057052c0 x1874670273233024/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829494 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829469.332132:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829469.332134:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829469.332136:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273233024:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787829470.163478:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829470.355394:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829471.187515:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829471.379438:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829472.211462:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829472.403494:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829473.235464:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829473.427416:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829474.259476:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1787829474.451432:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1787829474.451433:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:0.0:1787829474.451442:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1787829474.451446:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829474.451453:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4638
00000100:00080000:0.0:1787829474.451463:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829474.451469:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787829474.451499:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8000 x1874670273233152/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829474.451520:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829474.451523:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787829474.451524:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829474.451527:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4638
00000100:00080000:0.0:1787829474.451529:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829474.451532:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829474.451539:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787829474.451547:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9e00 x1874670273233280/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829474.451555:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829474.451560:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00100000:3.0:1787829474.451561:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273233152:192.168.203.121@tcp:250:kworker.0
00000100:00080000:0.0:1787829474.451562:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829474.451570:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4638
00000100:00080000:0.0:1787829474.451573:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829474.451576:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829474.451579:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787829474.451589:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ebc00 x1874670273233408/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829474.451596:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829474.451598:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787829474.451600:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829474.451603:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4638
00000100:00080000:0.0:1787829474.451607:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829474.451609:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829474.451613:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787829474.451625:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e83c0 x1874670273233536/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829474.451634:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829474.451637:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787829474.451639:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829474.451643:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4638
00000100:00080000:0.0:1787829474.451647:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829474.451651:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829474.451656:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000800:00000100:3.0:1787829474.451666:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829474.451670:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8f00 x1874670273233664/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829474.451684:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829474.451687:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787829474.451689:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829474.451693:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4638
00000100:00080000:0.0:1787829474.451698:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829474.451703:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829474.451708:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787829474.451723:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb840 x1874670273233792/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787829474.451728:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829474/real 1787829474]  req@ffff9ee0056e8000 x1874670273233152/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829499 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829474.451743:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829474.451749:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787829474.451751:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829474.451758:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4638
00000100:00100000:3.0:1787829474.451758:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8000 x1874670273233152/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829499 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829474.451766:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829474.451775:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00080000:3.0:1787829474.451777:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000008:00100000:0.0:1787829474.451784:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:3.0:1787829474.451785:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829474.451793:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273233152:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787829474.451804:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb480 x1874670273233920/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787829474.451818:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273233280:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787829474.451844:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829474.451858:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829474/real 1787829474]  req@ffff9ee0056e9e00 x1874670273233280/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829499 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829474.451871:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9e00 x1874670273233280/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829499 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829474.451879:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829474.451881:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829474.451883:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273233280:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787829474.451888:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273233408:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829474.451902:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829474.451909:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829474/real 1787829474]  req@ffff9ee0056ebc00 x1874670273233408/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829499 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829474.451916:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ebc00 x1874670273233408/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829499 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829474.451921:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829474.451923:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829474.451925:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273233408:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829474.451929:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273233536:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829474.451938:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829474.451945:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829474/real 1787829474]  req@ffff9ee0056e83c0 x1874670273233536/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829499 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829474.451952:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e83c0 x1874670273233536/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829499 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829474.451957:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829474.451958:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829474.451960:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273233536:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829474.451963:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273233664:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787829474.451972:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829474.451978:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829474/real 1787829474]  req@ffff9ee0056e8f00 x1874670273233664/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829499 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829474.451985:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8f00 x1874670273233664/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829499 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829474.451989:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829474.451991:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829474.452008:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273233664:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787829474.452013:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273233792:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829474.452026:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829474.452034:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829474/real 1787829474]  req@ffff9ee0056eb840 x1874670273233792/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829499 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829474.452041:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb840 x1874670273233792/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829499 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829474.452047:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829474.452049:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829474.452051:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273233792:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829474.452064:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273233920:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829474.452074:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829474.452080:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829474/real 1787829474]  req@ffff9ee0056eb480 x1874670273233920/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829499 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829474.452087:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb480 x1874670273233920/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829499 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829474.452092:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829474.452094:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829474.452095:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273233920:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787829475.283506:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829475.475415:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829476.307483:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829476.499430:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829477.331522:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829477.523426:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829478.355519:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829478.547435:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829479.379481:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829479.571432:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:1.0:1787829479.571483:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829479.571488:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1787829479.571491:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829479.571499:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4643
00000100:00080000:1.0:1787829479.571508:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829479.571515:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787829479.571550:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a03c0 x1874670273234048/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829479.571570:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829479.571573:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787829479.571574:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829479.571577:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4643
00000100:00080000:1.0:1787829479.571579:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829479.571583:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829479.571591:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787829479.571604:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1e00 x1874670273234176/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787829479.571614:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273234048:192.168.203.121@tcp:250:kworker.0
00000100:00080000:1.0:1787829479.571618:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829479.571626:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787829479.571628:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829479.571632:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4643
00000100:00080000:1.0:1787829479.571636:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829479.571641:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829479.571646:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787829479.571659:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a3480 x1874670273234304/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829479.571667:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829479.571669:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787829479.571671:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829479.571673:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4643
00000100:00080000:1.0:1787829479.571676:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000800:00000100:3.0:1787829479.571681:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:1.0:1787829479.571682:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829479.571688:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787829479.571697:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a30c0 x1874670273234432/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829479.571707:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829479.571710:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787829479.571712:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829479.571717:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4643
00000100:00080000:1.0:1787829479.571722:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1787829479.571727:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829479/real 1787829479]  req@ffff9ee0056a03c0 x1874670273234048/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829504 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829479.571731:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829479.571740:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787829479.571754:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a03c0 x1874670273234048/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829504 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829479.571755:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0b40 x1874670273234560/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829479.571787:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829479.571790:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829479.571791:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787829479.571795:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829479.571799:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:1.0:1787829479.571804:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4643
00000100:00100000:3.0:1787829479.571808:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273234048:192.168.203.121@tcp:250:kworker.0
00000100:00080000:1.0:1787829479.571809:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829479.571817:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829479.571822:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787829479.571828:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a2580 x1874670273234688/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787829479.571834:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273234176:192.168.203.121@tcp:38:kworker.0
00000100:00080000:1.0:1787829479.571837:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829479.571841:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787829479.571843:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829479.571847:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4643
00000100:00080000:1.0:1787829479.571850:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829479.571853:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829479.571857:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:3.0:1787829479.571861:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829479.571867:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0000 x1874670273234816/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787829479.571875:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829479/real 1787829479]  req@ffff9ee0056a1e00 x1874670273234176/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829504 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829479.571886:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1e00 x1874670273234176/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829504 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829479.571892:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829479.571895:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829479.571897:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273234176:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787829479.571902:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273234304:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829479.571914:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829479.571920:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829479/real 1787829479]  req@ffff9ee0056a3480 x1874670273234304/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829504 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829479.571928:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a3480 x1874670273234304/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829504 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829479.571933:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829479.571934:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829479.571936:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273234304:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829479.571940:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273234432:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829479.571949:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829479.571955:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829479/real 1787829479]  req@ffff9ee0056a30c0 x1874670273234432/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829504 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829479.571978:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a30c0 x1874670273234432/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829504 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829479.571984:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829479.571986:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829479.571988:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273234432:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829479.571992:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273234560:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787829479.572006:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829479.572013:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829479/real 1787829479]  req@ffff9ee0056a0b40 x1874670273234560/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829504 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829479.572020:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0b40 x1874670273234560/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829504 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829479.572025:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829479.572027:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829479.572029:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273234560:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787829479.572042:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273234688:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829479.572052:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829479.572058:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829479/real 1787829479]  req@ffff9ee0056a2580 x1874670273234688/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829504 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829479.572065:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a2580 x1874670273234688/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829504 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829479.572071:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829479.572073:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829479.572075:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273234688:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829479.572078:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273234816:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829479.572087:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829479.572092:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829479/real 1787829479]  req@ffff9ee0056a0000 x1874670273234816/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829504 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829479.572099:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0000 x1874670273234816/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829504 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829479.572104:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829479.572106:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829479.572107:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273234816:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787829480.403494:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829480.595386:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829481.427500:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829481.619413:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829482.451478:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829482.643402:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829483.475489:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829483.667493:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829484.499476:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1787829484.691418:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1787829484.691419:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:2.0:1787829484.691431:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787829484.691436:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829484.691448:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4648
00000100:00080000:2.0:1787829484.691462:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829484.691471:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787829484.691514:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057283c0 x1874670273234944/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829484.691540:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829484.691544:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787829484.691546:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829484.691551:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4648
00000100:00080000:2.0:1787829484.691555:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829484.691559:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787829484.691571:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273234944:192.168.203.121@tcp:250:kworker.0
00000008:00100000:2.0:1787829484.691572:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787829484.691590:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728000 x1874670273235072/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829484.691602:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829484.691606:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787829484.691608:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829484.691612:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4648
00000100:00080000:2.0:1787829484.691616:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829484.691620:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829484.691626:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787829484.691636:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a580 x1874670273235200/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829484.691646:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829484.691650:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787829484.691651:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829484.691655:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4648
00000100:00080000:2.0:1787829484.691659:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829484.691662:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829484.691667:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787829484.691677:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728b40 x1874670273235328/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829484.691687:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829484.691690:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787829484.691693:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829484.691697:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4648
00000100:00080000:2.0:1787829484.691701:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829484.691705:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829484.691709:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787829484.691719:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728f00 x1874670273235456/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829484.691738:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829484.691741:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787829484.691743:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829484.691748:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4648
00000100:00080000:2.0:1787829484.691751:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829484.691754:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829484.691759:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787829484.691768:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b840 x1874670273235584/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829484.691777:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829484.691781:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787829484.691785:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:3.0:1787829484.691793:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:2.0:1787829484.691806:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4648
00000100:00080000:2.0:1787829484.691810:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829484.691815:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829484.691820:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787829484.691833:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729a40 x1874670273235712/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787829484.691895:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829484/real 1787829484]  req@ffff9ee0057283c0 x1874670273234944/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829509 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829484.691921:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057283c0 x1874670273234944/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829509 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829484.691944:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829484.691949:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829484.691954:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273234944:192.168.203.121@tcp:250:kworker.0
00000100:00100000:3.0:1787829484.691979:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273235072:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787829484.692042:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829484.692053:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829484/real 1787829484]  req@ffff9ee005728000 x1874670273235072/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829509 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829484.692063:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728000 x1874670273235072/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829509 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829484.692069:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829484.692071:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829484.692073:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273235072:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787829484.692078:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273235200:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829484.692092:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829484.692098:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829484/real 1787829484]  req@ffff9ee00572a580 x1874670273235200/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829509 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829484.692106:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a580 x1874670273235200/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829509 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829484.692111:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829484.692113:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829484.692115:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273235200:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829484.692119:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273235328:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829484.692129:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829484.692135:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829484/real 1787829484]  req@ffff9ee005728b40 x1874670273235328/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829509 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829484.692142:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728b40 x1874670273235328/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829509 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829484.692147:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829484.692149:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829484.692151:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273235328:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829484.692155:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273235456:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787829484.692171:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829484.692180:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829484/real 1787829484]  req@ffff9ee005728f00 x1874670273235456/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829509 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829484.692187:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728f00 x1874670273235456/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829509 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829484.692192:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829484.692195:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829484.692196:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273235456:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787829484.692200:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273235584:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829484.692211:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829484.692216:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829484/real 1787829484]  req@ffff9ee00572b840 x1874670273235584/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829509 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829484.692223:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b840 x1874670273235584/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829509 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829484.692228:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829484.692231:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829484.692233:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273235584:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829484.692236:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273235712:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829484.692246:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829484.692251:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829484/real 1787829484]  req@ffff9ee005729a40 x1874670273235712/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829509 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829484.692258:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729a40 x1874670273235712/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829509 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829484.692262:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829484.692264:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829484.692266:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273235712:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787829485.523521:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829485.715443:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829486.547466:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829486.739379:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829487.571520:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829487.763449:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829488.595483:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829488.787432:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829489.619462:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829489.811431:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:2.0:1787829489.811458:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829489.811464:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787829489.811468:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829489.811476:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4653
00000100:00080000:2.0:1787829489.811485:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829489.811491:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787829489.811530:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b0c0 x1874670273235840/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829489.811556:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829489.811559:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787829489.811560:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829489.811563:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4653
00000100:00080000:2.0:1787829489.811566:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829489.811569:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829489.811577:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787829489.811588:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b480 x1874670273235968/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829489.811596:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829489.811598:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787829489.811600:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829489.811606:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4653
00000100:00100000:3.0:1787829489.811608:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273235840:192.168.203.121@tcp:250:kworker.0
00000100:00080000:2.0:1787829489.811609:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829489.811616:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829489.811620:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787829489.811628:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572ad00 x1874670273236096/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829489.811634:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829489.811637:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787829489.811638:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829489.811641:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4653
00000100:00080000:2.0:1787829489.811643:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829489.811645:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829489.811648:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787829489.811656:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729a40 x1874670273236224/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829489.811662:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829489.811665:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787829489.811666:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:3.0:1787829489.811670:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:2.0:1787829489.811672:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4653
00000100:00080000:2.0:1787829489.811677:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829489.811681:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829489.811685:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787829489.811698:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b840 x1874670273236352/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787829489.811713:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829489/real 1787829489]  req@ffff9ee00572b0c0 x1874670273235840/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829514 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829489.811717:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829489.811726:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787829489.811730:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829489.811735:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4653
00000100:00100000:3.0:1787829489.811739:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b0c0 x1874670273235840/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829514 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829489.811741:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829489.811750:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00080000:3.0:1787829489.811754:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000008:00100000:2.0:1787829489.811756:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:3.0:1787829489.811760:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829489.811765:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273235840:192.168.203.121@tcp:250:kworker.0
00000100:00100000:2.0:1787829489.811771:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728f00 x1874670273236480/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829489.811778:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829489.811781:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787829489.811782:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829489.811785:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4653
00000100:00080000:2.0:1787829489.811787:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1787829489.811789:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273235968:192.168.203.121@tcp:38:kworker.0
00000100:00080000:2.0:1787829489.811793:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829489.811799:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787829489.811807:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728b40 x1874670273236608/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1787829489.811817:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829489.811829:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829489/real 1787829489]  req@ffff9ee00572b480 x1874670273235968/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829514 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829489.811842:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b480 x1874670273235968/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829514 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829489.811848:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829489.811850:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829489.811852:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273235968:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787829489.811856:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273236096:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829489.811868:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829489.811874:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829489/real 1787829489]  req@ffff9ee00572ad00 x1874670273236096/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829514 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829489.811881:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572ad00 x1874670273236096/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829514 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829489.811900:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829489.811904:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829489.811907:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273236096:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829489.811913:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273236224:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829489.811927:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829489.811935:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829489/real 1787829489]  req@ffff9ee005729a40 x1874670273236224/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829514 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829489.811943:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729a40 x1874670273236224/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829514 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829489.811948:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829489.811951:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829489.811953:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273236224:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829489.811956:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273236352:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787829489.811966:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829489.811971:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829489/real 1787829489]  req@ffff9ee00572b840 x1874670273236352/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829514 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829489.811978:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b840 x1874670273236352/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829514 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829489.811983:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829489.811985:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829489.811987:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273236352:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787829489.811990:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273236480:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829489.811999:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829489.812005:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829489/real 1787829489]  req@ffff9ee005728f00 x1874670273236480/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829514 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829489.812011:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728f00 x1874670273236480/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829514 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829489.812017:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829489.812019:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829489.812021:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273236480:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829489.812036:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273236608:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829489.812045:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829489.812051:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829489/real 1787829489]  req@ffff9ee005728b40 x1874670273236608/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829514 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829489.812058:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728b40 x1874670273236608/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829514 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829489.812064:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829489.812065:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829489.812067:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273236608:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787829490.643492:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829490.835423:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829491.667528:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829491.859397:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829492.691532:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829492.883450:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829493.715482:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829493.907398:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829494.739486:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829494.931411:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:0.0:1787829494.931422:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829494.931427:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1787829494.931431:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829494.931439:0:27707:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4658
00000100:00080000:0.0:1787829494.931448:0:27707:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829494.931454:0:27707:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787829494.931487:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e92c0 x1874670273236736/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829494.931509:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829494.931511:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787829494.931513:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829494.931515:0:27707:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4658
00000100:00080000:0.0:1787829494.931518:0:27707:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829494.931520:0:27707:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829494.931528:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787829494.931536:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8b40 x1874670273236864/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829494.931544:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829494.931546:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787829494.931547:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829494.931549:0:27707:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4658
00000100:00080000:0.0:1787829494.931552:0:27707:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1787829494.931556:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273236736:192.168.203.121@tcp:250:kworker.0
00000100:00080000:0.0:1787829494.931557:0:27707:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829494.931563:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787829494.931571:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb0c0 x1874670273236992/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829494.931577:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829494.931580:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787829494.931581:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829494.931584:0:27707:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4658
00000100:00080000:0.0:1787829494.931586:0:27707:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829494.931589:0:27707:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829494.931592:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787829494.931600:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9a40 x1874670273237120/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829494.931605:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829494.931608:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787829494.931609:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829494.931612:0:27707:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4658
00000100:00080000:0.0:1787829494.931614:0:27707:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829494.931616:0:27707:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829494.931620:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000800:00000100:3.0:1787829494.931621:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829494.931630:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ea580 x1874670273237248/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829494.931638:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829494.931640:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787829494.931641:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829494.931644:0:27707:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4658
00000100:00080000:0.0:1787829494.931646:0:27707:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829494.931648:0:27707:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829494.931651:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787829494.931659:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9680 x1874670273237376/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829494.931665:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829494.931667:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787829494.931669:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1787829494.931673:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829494/real 1787829494]  req@ffff9ee0056e92c0 x1874670273236736/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829519 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829494.931675:0:27707:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4658
00000100:00080000:0.0:1787829494.931679:0:27707:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829494.931685:0:27707:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787829494.931697:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e92c0 x1874670273236736/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829519 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:0.0:1787829494.931701:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:3.0:1787829494.931711:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:0.0:1787829494.931718:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8780 x1874670273237504/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829494.931718:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829494.931726:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273236736:192.168.203.121@tcp:250:kworker.0
00000100:00100000:3.0:1787829494.931739:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273236864:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787829494.931759:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829494.931768:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829494/real 1787829494]  req@ffff9ee0056e8b40 x1874670273236864/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829519 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829494.931776:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8b40 x1874670273236864/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829519 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829494.931782:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829494.931784:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829494.931786:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273236864:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787829494.931803:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273236992:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829494.931815:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829494.931821:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829494/real 1787829494]  req@ffff9ee0056eb0c0 x1874670273236992/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829519 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829494.931829:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb0c0 x1874670273236992/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829519 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829494.931835:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829494.931837:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829494.931839:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273236992:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829494.931842:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273237120:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829494.931868:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829494.931876:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829494/real 1787829494]  req@ffff9ee0056e9a40 x1874670273237120/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829519 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829494.931884:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9a40 x1874670273237120/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829519 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829494.931890:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829494.931892:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829494.931894:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273237120:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829494.931898:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273237248:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787829494.931910:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829494.931916:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829494/real 1787829494]  req@ffff9ee0056ea580 x1874670273237248/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829519 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829494.931923:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ea580 x1874670273237248/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829519 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829494.931928:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829494.931930:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829494.931932:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273237248:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787829494.931935:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273237376:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829494.931945:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829494.931951:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829494/real 1787829494]  req@ffff9ee0056e9680 x1874670273237376/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829519 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829494.931963:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9680 x1874670273237376/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829519 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829494.931968:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829494.931969:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829494.931971:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273237376:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829494.931974:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273237504:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829494.931984:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829494.931990:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829494/real 1787829494]  req@ffff9ee0056e8780 x1874670273237504/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829519 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829494.932001:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8780 x1874670273237504/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829519 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829494.932008:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829494.932011:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829494.932015:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273237504:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787829495.763457:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829495.955406:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829496.787473:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829496.979403:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829497.811494:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787829498.003454:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829498.835519:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787829499.027453:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829499.859503:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787829500.051399:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:1.0:1787829500.051404:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829500.051413:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1787829500.051417:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829500.051427:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4663
00000100:00080000:1.0:1787829500.051439:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829500.051447:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787829500.051482:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0780 x1874670273237632/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829500.051514:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829500.051519:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787829500.051521:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829500.051525:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4663
00000100:00080000:1.0:1787829500.051529:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829500.051535:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829500.051545:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787829500.051553:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273237632:192.168.203.121@tcp:250:kworker.0
00000100:00100000:1.0:1787829500.051562:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0000 x1874670273237760/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829500.051574:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829500.051578:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787829500.051580:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829500.051584:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4663
00000100:00080000:1.0:1787829500.051598:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829500.051607:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829500.051613:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:3.0:1787829500.051623:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829500.051627:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a2580 x1874670273237888/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829500.051640:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829500.051643:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787829500.051646:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829500.051650:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4663
00000100:00080000:1.0:1787829500.051655:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829500.051659:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829500.051664:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787829500.051675:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0b40 x1874670273238016/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787829500.051686:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829500/real 1787829500]  req@ffff9ee0056a0780 x1874670273237632/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829525 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829500.051687:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829500.051696:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787829500.051701:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829500.051711:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4663
00000100:00080000:1.0:1787829500.051715:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1787829500.051717:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0780 x1874670273237632/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829525 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829500.051723:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829500.051732:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00080000:3.0:1787829500.051737:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829500.051745:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829500.051750:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a30c0 x1874670273238144/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787829500.051753:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273237632:192.168.203.121@tcp:250:kworker.0
00000100:00080000:1.0:1787829500.051769:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829500.051773:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787829500.051774:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829500.051779:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4663
00000100:00100000:3.0:1787829500.051784:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273237760:192.168.203.121@tcp:38:kworker.0
00000100:00080000:1.0:1787829500.051785:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829500.051794:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829500.051801:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787829500.051829:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a3480 x1874670273238272/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1787829500.051829:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829500.051846:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829500/real 1787829500]  req@ffff9ee0056a0000 x1874670273237760/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829525 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829500.051851:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829500.051858:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:3.0:1787829500.051862:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0000 x1874670273237760/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829525 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829500.051863:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829500.051874:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4663
00000100:00080000:3.0:1787829500.051876:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829500.051880:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829500.051881:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829500.051888:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273237760:192.168.203.121@tcp:38:kworker.0
00000100:00080000:1.0:1787829500.051890:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787829500.051896:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273237888:192.168.203.121@tcp:8:kworker.0
00000008:00100000:1.0:1787829500.051899:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787829500.051916:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1e00 x1874670273238400/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1787829500.051923:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829500.051942:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829500/real 1787829500]  req@ffff9ee0056a2580 x1874670273237888/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829525 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829500.051957:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a2580 x1874670273237888/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829525 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829500.051973:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829500.051977:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829500.051981:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273237888:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829500.051985:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273238016:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829500.052001:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829500.052009:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829500/real 1787829500]  req@ffff9ee0056a0b40 x1874670273238016/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829525 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829500.052016:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0b40 x1874670273238016/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829525 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829500.052021:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829500.052023:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829500.052025:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273238016:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829500.052029:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273238144:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787829500.052039:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829500.052044:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829500/real 1787829500]  req@ffff9ee0056a30c0 x1874670273238144/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829525 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829500.052051:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a30c0 x1874670273238144/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829525 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829500.052056:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829500.052058:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829500.052060:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273238144:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787829500.052074:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273238272:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829500.052084:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829500.052090:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829500/real 1787829500]  req@ffff9ee0056a3480 x1874670273238272/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829525 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829500.052098:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a3480 x1874670273238272/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829525 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829500.052103:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829500.052104:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829500.052106:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273238272:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829500.052109:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273238400:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829500.052118:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829500.052124:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829500/real 1787829500]  req@ffff9ee0056a1e00 x1874670273238400/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829525 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829500.052131:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1e00 x1874670273238400/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829525 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829500.052136:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829500.052137:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829500.052139:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273238400:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787829500.883515:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787829501.075388:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829501.907533:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787829502.099396:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829502.931505:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787829503.123388:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829503.955477:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787829504.147422:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829504.979511:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1787829505.171415:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1787829505.171416:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:1.0:1787829505.171426:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1787829505.171431:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829505.171441:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4668
00000100:00080000:1.0:1787829505.171459:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829505.171467:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787829505.171502:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a03c0 x1874670273238528/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829505.171528:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829505.171532:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787829505.171534:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829505.171539:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4668
00000100:00080000:1.0:1787829505.171543:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829505.171549:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829505.171560:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787829505.171567:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273238528:192.168.203.121@tcp:250:kworker.0
00000100:00100000:1.0:1787829505.171576:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a2940 x1874670273238656/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829505.171590:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829505.171593:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787829505.171595:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829505.171600:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4668
00000100:00080000:1.0:1787829505.171605:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829505.171610:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829505.171615:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787829505.171629:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a21c0 x1874670273238784/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1787829505.171634:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:1.0:1787829505.171646:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829505.171650:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787829505.171652:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829505.171658:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4668
00000100:00080000:1.0:1787829505.171662:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829505.171666:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829505.171672:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829505.171681:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829505/real 1787829505]  req@ffff9ee0056a03c0 x1874670273238528/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829530 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829505.171687:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1680 x1874670273238912/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829505.171709:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829505.171715:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00100000:3.0:1787829505.171716:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a03c0 x1874670273238528/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829530 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829505.171718:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829505.171728:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4668
00000100:00080000:1.0:1787829505.171735:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829505.171736:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829505.171742:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00080000:3.0:1787829505.171747:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000008:00100000:1.0:1787829505.171750:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787829505.171754:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273238528:192.168.203.121@tcp:250:kworker.0
00000100:00100000:1.0:1787829505.171767:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0f00 x1874670273239040/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829505.171797:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829505.171802:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00100000:3.0:1787829505.171802:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273238656:192.168.203.121@tcp:38:kworker.0
00000100:00080000:1.0:1787829505.171804:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829505.171815:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4668
00000100:00080000:1.0:1787829505.171820:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829505.171824:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829505.171829:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:3.0:1787829505.171839:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829505.171845:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a3c00 x1874670273239168/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829505.171856:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1787829505.171857:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829505/real 1787829505]  req@ffff9ee0056a2940 x1874670273238656/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829530 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829505.171873:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a2940 x1874670273238656/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829530 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829505.171874:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787829505.171878:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829505.171888:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4668
00000100:00080000:3.0:1787829505.171892:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829505.171895:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829505.171901:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00080000:1.0:1787829505.171905:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787829505.171910:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273238656:192.168.203.121@tcp:38:kworker.0
00000008:00100000:1.0:1787829505.171913:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829505.171927:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273238784:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787829505.171933:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1a40 x1874670273239296/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1787829505.171959:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829505.171975:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829505/real 1787829505]  req@ffff9ee0056a21c0 x1874670273238784/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829530 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829505.171991:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a21c0 x1874670273238784/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829530 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829505.172000:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829505.172004:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829505.172008:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273238784:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829505.172017:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273238912:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829505.172041:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829505.172054:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829505/real 1787829505]  req@ffff9ee0056a1680 x1874670273238912/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829530 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829505.172069:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1680 x1874670273238912/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829530 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829505.172079:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829505.172083:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829505.172087:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273238912:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829505.172107:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273239040:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787829505.172139:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829505.172155:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829505/real 1787829505]  req@ffff9ee0056a0f00 x1874670273239040/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829530 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829505.172169:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0f00 x1874670273239040/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829530 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829505.172179:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829505.172183:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829505.172188:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273239040:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787829505.172277:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273239168:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829505.172483:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829505.172505:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829505/real 1787829505]  req@ffff9ee0056a3c00 x1874670273239168/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829530 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829505.172519:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a3c00 x1874670273239168/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829530 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829505.172528:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829505.172532:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829505.172535:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273239168:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829505.172543:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273239296:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829505.172564:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829505.172577:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829505/real 1787829505]  req@ffff9ee0056a1a40 x1874670273239296/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829530 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829505.172589:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1a40 x1874670273239296/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829530 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829505.172603:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829505.172607:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829505.172610:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273239296:192.168.203.121@tcp:8:kworker.0
00010000:00010000:3.0:1787829506.003459:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829506.195467:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829507.027475:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829507.219375:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829508.051457:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829508.243389:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829509.075513:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829509.267379:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829510.099515:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1787829510.291443:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1787829510.291445:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:2.0:1787829510.291452:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787829510.291463:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829510.291471:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4674
00000100:00080000:2.0:1787829510.291480:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829510.291486:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787829510.291517:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a580 x1874670273239424/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829510.291543:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829510.291547:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787829510.291548:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829510.291553:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4674
00000100:00080000:2.0:1787829510.291557:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829510.291562:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829510.291573:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787829510.291588:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728000 x1874670273239552/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829510.291600:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829510.291605:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787829510.291607:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1787829510.291608:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273239424:192.168.203.121@tcp:250:kworker.0
00000100:00080000:2.0:1787829510.291612:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4674
00000100:00080000:2.0:1787829510.291619:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829510.291625:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829510.291629:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787829510.291639:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057283c0 x1874670273239680/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829510.291650:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829510.291653:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787829510.291654:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829510.291656:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4674
00000100:00080000:2.0:1787829510.291659:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829510.291661:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829510.291665:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787829510.291671:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729e00 x1874670273239808/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829510.291676:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829510.291679:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787829510.291680:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829510.291683:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4674
00000100:00080000:2.0:1787829510.291686:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829510.291689:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829510.291691:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787829510.291698:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a940 x1874670273239936/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1787829510.291706:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:2.0:1787829510.291717:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829510.291720:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787829510.291721:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829510.291726:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4674
00000100:00080000:2.0:1787829510.291730:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829510.291735:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829510.291738:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787829510.291761:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057292c0 x1874670273240064/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829510.291768:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829510.291771:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787829510.291772:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829510.291776:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4674
00000100:00080000:2.0:1787829510.291779:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1787829510.291783:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829510/real 1787829510]  req@ffff9ee00572a580 x1874670273239424/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829535 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829510.291788:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829510.291800:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787829510.291817:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728780 x1874670273240192/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787829510.291818:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a580 x1874670273239424/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829535 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829510.291882:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829510.291887:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829510.291891:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273239424:192.168.203.121@tcp:250:kworker.0
00000100:00100000:3.0:1787829510.291916:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273239552:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787829510.291935:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829510.291944:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829510/real 1787829510]  req@ffff9ee005728000 x1874670273239552/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829535 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829510.291951:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728000 x1874670273239552/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829535 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829510.291961:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829510.291963:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829510.291965:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273239552:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787829510.291969:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273239680:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829510.291987:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829510.291997:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829510/real 1787829510]  req@ffff9ee0057283c0 x1874670273239680/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829535 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829510.292004:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057283c0 x1874670273239680/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829535 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829510.292009:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829510.292011:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829510.292013:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273239680:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829510.292017:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273239808:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829510.292026:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829510.292031:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829510/real 1787829510]  req@ffff9ee005729e00 x1874670273239808/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829535 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829510.292038:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729e00 x1874670273239808/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829535 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829510.292042:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829510.292044:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829510.292046:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273239808:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829510.292049:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273239936:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787829510.292059:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829510.292064:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829510/real 1787829510]  req@ffff9ee00572a940 x1874670273239936/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829535 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829510.292069:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a940 x1874670273239936/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829535 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829510.292073:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829510.292075:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829510.292077:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273239936:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787829510.292080:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057292c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273240064:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829510.292090:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829510.292095:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829510/real 1787829510]  req@ffff9ee0057292c0 x1874670273240064/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829535 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829510.292100:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057292c0 x1874670273240064/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829535 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829510.292104:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829510.292106:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829510.292107:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057292c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273240064:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829510.292110:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273240192:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829510.292119:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829510.292125:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829510/real 1787829510]  req@ffff9ee005728780 x1874670273240192/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829535 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829510.292131:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728780 x1874670273240192/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829535 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829510.292136:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829510.292138:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829510.292141:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273240192:192.168.203.121@tcp:8:kworker.0
00010000:00010000:3.0:1787829511.123500:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829511.315426:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829512.147514:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787829512.339465:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829513.171486:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787829513.363411:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829514.195505:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787829514.387412:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829515.219475:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787829515.411423:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:2.0:1787829515.411448:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829515.411458:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787829515.411465:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829515.411478:0:27707:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4679
00000100:00080000:2.0:1787829515.411491:0:27707:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829515.411500:0:27707:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787829515.411550:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572bc00 x1874670273240320/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829515.411582:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829515.411589:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787829515.411593:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829515.411598:0:27707:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4679
00000100:00080000:2.0:1787829515.411603:0:27707:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829515.411609:0:27707:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787829515.411617:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273240320:192.168.203.121@tcp:250:kworker.0
00000008:00100000:2.0:1787829515.411623:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787829515.411646:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a1c0 x1874670273240448/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829515.411658:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829515.411662:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787829515.411665:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829515.411670:0:27707:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4679
00000100:00080000:2.0:1787829515.411675:0:27707:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829515.411680:0:27707:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829515.411688:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787829515.411703:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729680 x1874670273240576/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829515.411728:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829515.411733:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787829515.411736:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829515.411742:0:27707:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4679
00000100:00080000:2.0:1787829515.411747:0:27707:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1787829515.411752:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273240448:192.168.203.121@tcp:38:kworker.0
00000100:00080000:2.0:1787829515.411759:0:27707:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829515.411770:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787829515.411788:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728780 x1874670273240704/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829515.411801:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1787829515.411804:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273240576:192.168.203.121@tcp:8:kworker.0
00000100:00080000:2.0:1787829515.411810:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787829515.411814:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829515.411823:0:27707:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4679
00000100:00080000:2.0:1787829515.411830:0:27707:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829515.411837:0:27707:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787829515.411841:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273240704:192.168.203.121@tcp:8:kworker.0
00000008:00100000:2.0:1787829515.411846:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787829515.411867:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057292c0 x1874670273240832/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829515.411887:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829515.411892:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787829515.411894:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829515.411899:0:27707:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4679
00000100:00080000:2.0:1787829515.411905:0:27707:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1787829515.411908:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057292c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273240832:192.168.203.121@tcp:38:kworker.0
00000100:00080000:2.0:1787829515.411915:0:27707:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829515.411923:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787829515.411940:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a940 x1874670273240960/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829515.411957:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829515.411961:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787829515.411964:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829515.411969:0:27707:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4679
00000100:00080000:2.0:1787829515.411975:0:27707:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829515.411980:0:27707:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787829515.411986:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273240960:192.168.203.121@tcp:8:kworker.0
00000008:00100000:2.0:1787829515.411989:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787829515.412011:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729e00 x1874670273241088/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787829515.412044:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273241088:192.168.203.121@tcp:8:kworker.0
00010000:00010000:3.0:1787829516.243485:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829516.435485:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829517.267443:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829517.459505:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829518.291511:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829518.483537:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000400:00000100:3.0:1787829518.483630:0:2354:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.203.121:988
00000400:00000100:3.0:1787829518.483679:0:2354:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.203.121@tcp at host 192.168.203.121 was unreachable: the network or that node may be down, or Lustre may be misconfigured.
00000800:00000100:3.0:1787829518.483709:0:2354:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:3.0:1787829518.483758:0:2354:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:3.0:1787829518.483767:0:2354:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:3.0:1787829518.483776:0:2354:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:3.0:1787829518.483783:0:2354:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:3.0:1787829518.483791:0:2354:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:3.0:1787829518.483798:0:2354:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000100:00100000:0.0:1787829518.483886:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829515/real 1787829518]  req@ffff9ee005729e00 x1874670273241088/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829540 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829518.483909:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729e00 x1874670273241088/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829540 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829518.483921:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829518.483926:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829518.483932:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273241088:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829518.483939:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829515/real 1787829518]  req@ffff9ee00572a940 x1874670273240960/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829540 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829518.483951:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a940 x1874670273240960/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829540 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829518.483958:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829518.483962:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829518.483965:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273240960:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829518.483971:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829515/real 1787829518]  req@ffff9ee0057292c0 x1874670273240832/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829540 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829518.483982:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057292c0 x1874670273240832/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829540 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829518.483990:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829518.483994:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829518.483997:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057292c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273240832:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787829518.484003:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829515/real 1787829518]  req@ffff9ee005728780 x1874670273240704/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829540 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829518.484015:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728780 x1874670273240704/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829540 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829518.484022:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829518.484025:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829518.484028:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273240704:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829518.484034:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829515/real 1787829518]  req@ffff9ee00572a1c0 x1874670273240448/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829540 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829518.484046:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a1c0 x1874670273240448/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829540 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829518.484054:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829518.484057:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829518.484061:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273240448:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787829518.484067:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829515/real 1787829518]  req@ffff9ee005729680 x1874670273240576/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829540 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829518.484078:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729680 x1874670273240576/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829540 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829518.484086:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829518.484089:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829518.484092:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273240576:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829518.484099:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829515/real 1787829518]  req@ffff9ee00572bc00 x1874670273240320/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829540 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829518.484112:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572bc00 x1874670273240320/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829540 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829518.484120:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829518.484124:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829518.484127:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273240320:192.168.203.121@tcp:250:kworker.0
00010000:00010000:0.0:1787829519.315503:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787829519.507436:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829520.339505:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787829520.531396:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:2.0:1787829520.531410:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829520.531415:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787829520.531418:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829520.531427:0:27707:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4684
00000100:00080000:2.0:1787829520.531435:0:27707:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829520.531441:0:27707:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787829520.531475:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057283c0 x1874670273241216/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829520.531496:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829520.531499:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787829520.531500:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829520.531503:0:27707:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4684
00000100:00080000:2.0:1787829520.531505:0:27707:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829520.531507:0:27707:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829520.531514:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787829520.531522:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728000 x1874670273241344/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829520.531536:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829520.531538:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787829520.531539:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1787829520.531545:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273241216:192.168.203.121@tcp:250:kworker.0
00000100:00080000:2.0:1787829520.531545:0:27707:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4684
00000100:00080000:2.0:1787829520.531550:0:27707:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829520.531554:0:27707:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829520.531557:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787829520.531564:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a580 x1874670273241472/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829520.531571:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829520.531573:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787829520.531574:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829520.531577:0:27707:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4684
00000100:00080000:2.0:1787829520.531580:0:27707:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829520.531584:0:27707:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829520.531588:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787829520.531599:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728b40 x1874670273241600/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829520.531610:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829520.531613:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787829520.531615:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829520.531620:0:27707:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4684
00000100:00080000:2.0:1787829520.531623:0:27707:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000800:00000100:0.0:1787829520.531628:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:2.0:1787829520.531631:0:27707:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829520.531637:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787829520.531655:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728f00 x1874670273241728/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829520.531665:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829520.531669:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787829520.531671:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829520.531689:0:27707:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4684
00000100:00080000:2.0:1787829520.531694:0:27707:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829520.531699:0:27707:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829520.531705:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787829520.531722:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b840 x1874670273241856/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829520.531733:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1787829520.531734:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829520/real 1787829520]  req@ffff9ee0057283c0 x1874670273241216/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829545 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829520.531738:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787829520.531741:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829520.531749:0:27707:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4684
00000100:00080000:2.0:1787829520.531758:0:27707:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829520.531762:0:27707:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787829520.531768:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057283c0 x1874670273241216/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829545 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:2.0:1787829520.531770:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:0.0:1787829520.531787:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:2.0:1787829520.531788:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729a40 x1874670273241984/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829520.531798:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829520.531807:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273241216:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787829520.531839:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273241344:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787829520.531865:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829520.531878:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829520/real 1787829520]  req@ffff9ee005728000 x1874670273241344/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829545 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829520.531892:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728000 x1874670273241344/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829545 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829520.531901:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829520.531904:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829520.531908:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273241344:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787829520.531916:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273241472:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829520.531939:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829520.531951:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829520/real 1787829520]  req@ffff9ee00572a580 x1874670273241472/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829545 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829520.531964:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a580 x1874670273241472/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829545 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829520.531972:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829520.531975:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829520.531978:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273241472:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829520.531985:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273241600:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829520.532005:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829520.532016:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829520/real 1787829520]  req@ffff9ee005728b40 x1874670273241600/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829545 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829520.532029:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728b40 x1874670273241600/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829545 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829520.532037:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829520.532040:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829520.532044:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273241600:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829520.532050:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273241728:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787829520.532068:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829520.532084:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829520/real 1787829520]  req@ffff9ee005728f00 x1874670273241728/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829545 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829520.532104:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728f00 x1874670273241728/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829545 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829520.532113:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829520.532116:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829520.532119:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273241728:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787829520.532131:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273241856:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829520.532150:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829520.532161:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829520/real 1787829520]  req@ffff9ee00572b840 x1874670273241856/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829545 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829520.532174:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b840 x1874670273241856/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829545 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829520.532182:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829520.532186:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829520.532189:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273241856:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829520.532195:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273241984:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829520.532222:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829520.532234:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829520/real 1787829520]  req@ffff9ee005729a40 x1874670273241984/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829545 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829520.532247:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729a40 x1874670273241984/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829545 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829520.532262:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829520.532266:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829520.532270:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273241984:192.168.203.121@tcp:8:kworker.0
00010000:00010000:3.0:1787829521.363482:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787829521.555401:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829522.387475:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787829522.579463:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829523.411490:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787829523.603385:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829524.435503:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787829524.627409:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829525.459513:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787829525.651456:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:2.0:1787829525.651457:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829525.651469:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787829525.651474:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829525.651492:0:27707:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4689
00000100:00080000:2.0:1787829525.651503:0:27707:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829525.651509:0:27707:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787829525.651539:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572ad00 x1874670273242112/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829525.651560:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829525.651563:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787829525.651565:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829525.651567:0:27707:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4689
00000100:00080000:2.0:1787829525.651570:0:27707:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829525.651573:0:27707:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829525.651581:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787829525.651592:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b480 x1874670273242240/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829525.651604:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829525.651608:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787829525.651610:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1787829525.651614:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273242112:192.168.203.121@tcp:250:kworker.0
00000100:00080000:2.0:1787829525.651619:0:27707:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4689
00000100:00080000:2.0:1787829525.651625:0:27707:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829525.651629:0:27707:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829525.651647:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787829525.651661:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b0c0 x1874670273242368/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829525.651669:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829525.651671:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787829525.651673:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829525.651676:0:27707:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4689
00000100:00080000:2.0:1787829525.651679:0:27707:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829525.651682:0:27707:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000800:00000100:0.0:1787829525.651686:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000008:00100000:2.0:1787829525.651688:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787829525.651700:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729a40 x1874670273242496/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829525.651707:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829525.651709:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787829525.651711:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829525.651715:0:27707:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4689
00000100:00080000:2.0:1787829525.651718:0:27707:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829525.651721:0:27707:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829525.651724:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787829525.651726:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829525/real 1787829525]  req@ffff9ee00572ad00 x1874670273242112/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829550 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829525.651734:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b840 x1874670273242624/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829525.651742:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829525.651746:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00100000:0.0:1787829525.651749:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572ad00 x1874670273242112/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829550 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829525.651749:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829525.651757:0:27707:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4689
00000100:00080000:2.0:1787829525.651761:0:27707:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829525.651766:0:27707:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829525.651771:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:0.0:1787829525.651774:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:2.0:1787829525.651780:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728f00 x1874670273242752/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829525.651784:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:2.0:1787829525.651791:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1787829525.651794:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273242112:192.168.203.121@tcp:250:kworker.0
00000100:00080000:2.0:1787829525.651795:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787829525.651800:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829525.651805:0:27707:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4689
00000100:00100000:0.0:1787829525.651807:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273242240:192.168.203.121@tcp:38:kworker.0
00000100:00080000:2.0:1787829525.651809:0:27707:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829525.651816:0:27707:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829525.651818:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787829525.651826:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728b40 x1874670273242880/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1787829525.651837:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829525.651848:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829525/real 1787829525]  req@ffff9ee00572b480 x1874670273242240/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829550 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829525.651859:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b480 x1874670273242240/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829550 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829525.651868:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829525.651872:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829525.651875:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273242240:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787829525.651901:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273242368:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829525.651921:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829525.651929:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829525/real 1787829525]  req@ffff9ee00572b0c0 x1874670273242368/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829550 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829525.651937:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b0c0 x1874670273242368/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829550 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829525.651943:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829525.651945:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829525.651948:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273242368:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829525.651951:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273242496:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829525.651964:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829525.651974:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829525/real 1787829525]  req@ffff9ee005729a40 x1874670273242496/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829550 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829525.651986:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729a40 x1874670273242496/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829550 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829525.651995:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829525.651998:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829525.652002:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273242496:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829525.652008:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273242624:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787829525.652029:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829525.652041:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829525/real 1787829525]  req@ffff9ee00572b840 x1874670273242624/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829550 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829525.652049:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b840 x1874670273242624/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829550 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829525.652055:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829525.652057:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829525.652059:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273242624:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787829525.652063:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273242752:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829525.652076:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829525.652082:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829525/real 1787829525]  req@ffff9ee005728f00 x1874670273242752/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829550 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829525.652089:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728f00 x1874670273242752/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829550 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829525.652094:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829525.652095:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829525.652097:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273242752:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829525.652101:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273242880:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829525.652110:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829525.652116:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829525/real 1787829525]  req@ffff9ee005728b40 x1874670273242880/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829550 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829525.652128:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728b40 x1874670273242880/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829550 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829525.652133:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829525.652134:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829525.652136:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273242880:192.168.203.121@tcp:8:kworker.0
00010000:00010000:3.0:1787829526.483481:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829526.675427:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829527.507479:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829527.699448:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829528.531515:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829528.723399:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829529.555462:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829529.747454:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829530.579495:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1787829530.771424:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1787829530.771426:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:2.0:1787829530.771434:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787829530.771438:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829530.771446:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4694
00000100:00080000:2.0:1787829530.771455:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829530.771461:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787829530.771492:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a580 x1874670273243008/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829530.771519:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829530.771522:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787829530.771524:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829530.771526:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4694
00000100:00080000:2.0:1787829530.771528:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829530.771531:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829530.771538:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787829530.771546:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728000 x1874670273243136/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829530.771552:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829530.771555:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787829530.771557:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829530.771559:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4694
00000100:00080000:2.0:1787829530.771561:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829530.771564:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829530.771568:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787829530.771575:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057283c0 x1874670273243264/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829530.771580:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829530.771583:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787829530.771584:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829530.771586:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4694
00000100:00080000:2.0:1787829530.771589:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829530.771592:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829530.771595:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787829530.771614:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572bc00 x1874670273243392/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787829530.771627:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273243008:192.168.203.121@tcp:250:kworker.0
00000100:00080000:2.0:1787829530.771628:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829530.771637:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787829530.771640:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829530.771648:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4694
00000100:00080000:2.0:1787829530.771651:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829530.771654:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829530.771657:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787829530.771669:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729680 x1874670273243520/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829530.771676:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829530.771678:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787829530.771679:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829530.771682:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4694
00000100:00080000:2.0:1787829530.771684:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829530.771687:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829530.771690:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787829530.771696:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a1c0 x1874670273243648/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829530.771707:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829530.771710:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787829530.771712:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829530.771714:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4694
00000100:00080000:2.0:1787829530.771716:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829530.771718:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829530.771722:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:0.0:1787829530.771729:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829530.771730:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728780 x1874670273243776/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787829530.771787:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829530/real 1787829530]  req@ffff9ee00572a580 x1874670273243008/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829555 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829530.771807:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a580 x1874670273243008/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829555 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829530.771818:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829530.771823:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829530.771827:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273243008:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787829530.771834:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273243136:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787829530.771856:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829530.771865:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829530/real 1787829530]  req@ffff9ee005728000 x1874670273243136/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829555 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829530.771873:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728000 x1874670273243136/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829555 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829530.771880:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829530.771884:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829530.771887:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273243136:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787829530.771894:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273243264:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829530.771914:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829530.771924:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829530/real 1787829530]  req@ffff9ee0057283c0 x1874670273243264/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829555 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829530.771936:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057283c0 x1874670273243264/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829555 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829530.771943:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829530.771947:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829530.771950:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273243264:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829530.771984:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273243392:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829530.772004:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829530.772016:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829530/real 1787829530]  req@ffff9ee00572bc00 x1874670273243392/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829555 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829530.772028:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572bc00 x1874670273243392/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829555 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829530.772035:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829530.772038:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829530.772042:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273243392:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829530.772048:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273243520:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787829530.772067:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829530.772078:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829530/real 1787829530]  req@ffff9ee005729680 x1874670273243520/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829555 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829530.772090:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729680 x1874670273243520/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829555 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829530.772098:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829530.772101:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829530.772104:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273243520:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787829530.772110:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273243648:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829530.772127:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829530.772136:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829530/real 1787829530]  req@ffff9ee00572a1c0 x1874670273243648/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829555 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829530.772146:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a1c0 x1874670273243648/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829555 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829530.772154:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829530.772157:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829530.772160:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273243648:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829530.772166:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273243776:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829530.772181:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829530.772192:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829530/real 1787829530]  req@ffff9ee005728780 x1874670273243776/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829555 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829530.772204:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728780 x1874670273243776/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829555 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829530.772211:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829530.772223:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829530.772226:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273243776:192.168.203.121@tcp:8:kworker.0
00010000:00010000:3.0:1787829531.603532:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829531.795447:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829532.627520:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829532.819421:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829533.651510:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829533.843428:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829534.675450:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829534.867410:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829535.699503:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829535.891435:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787829535.891436:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829535.891446:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787829535.891451:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829535.891462:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4699
00000100:00080000:3.0:1787829535.891473:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829535.891479:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787829535.891511:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057061c0 x1874670273243904/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829535.891530:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829535.891533:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787829535.891534:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829535.891537:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4699
00000100:00080000:3.0:1787829535.891539:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829535.891542:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829535.891549:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787829535.891557:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707c00 x1874670273244032/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829535.891580:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829535.891583:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787829535.891586:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1787829535.891588:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273243904:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787829535.891592:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4699
00000100:00080000:3.0:1787829535.891597:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829535.891600:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829535.891604:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829535.891616:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057052c0 x1874670273244160/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829535.891628:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829535.891631:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787829535.891632:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829535.891635:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4699
00000100:00080000:3.0:1787829535.891638:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829535.891640:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829535.891643:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829535.891651:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057070c0 x1874670273244288/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1787829535.891652:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787829535.891661:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829535.891664:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787829535.891666:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829535.891669:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4699
00000100:00080000:3.0:1787829535.891671:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829535.891674:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829535.891677:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787829535.891684:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707480 x1874670273244416/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787829535.891691:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829535/real 1787829535]  req@ffff9ee0057061c0 x1874670273243904/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829560 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829535.891692:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829535.891700:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787829535.891704:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829535.891712:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4699
00000100:00080000:3.0:1787829535.891716:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1787829535.891718:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057061c0 x1874670273243904/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829560 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829535.891722:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829535.891727:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:0.0:1787829535.891734:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:3.0:1787829535.891738:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704000 x1874670273244544/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829535.891739:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829535.891747:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273243904:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787829535.891755:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1787829535.891759:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273244032:192.168.203.121@tcp:38:kworker.0
00000100:00080000:3.0:1787829535.891760:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787829535.891764:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829535.891769:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4699
00000100:00080000:3.0:1787829535.891772:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829535.891774:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829535.891778:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:0.0:1787829535.891783:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829535.891789:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706940 x1874670273244672/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787829535.891795:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829535/real 1787829535]  req@ffff9ee005707c00 x1874670273244032/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829560 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829535.891813:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707c00 x1874670273244032/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829560 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829535.891819:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829535.891821:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829535.891824:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273244032:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787829535.891842:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273244160:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829535.891854:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829535.891861:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829535/real 1787829535]  req@ffff9ee0057052c0 x1874670273244160/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829560 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829535.891868:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057052c0 x1874670273244160/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829560 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829535.891873:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829535.891876:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829535.891878:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273244160:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829535.891881:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273244288:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829535.891890:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829535.891895:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829535/real 1787829535]  req@ffff9ee0057070c0 x1874670273244288/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829560 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829535.891902:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057070c0 x1874670273244288/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829560 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829535.891911:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829535.891913:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829535.891915:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273244288:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829535.891918:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273244416:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787829535.891927:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829535.891932:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829535/real 1787829535]  req@ffff9ee005707480 x1874670273244416/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829560 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829535.891939:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707480 x1874670273244416/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829560 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829535.891943:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829535.891945:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829535.891947:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273244416:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787829535.891951:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273244544:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829535.891960:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829535.891965:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829535/real 1787829535]  req@ffff9ee005704000 x1874670273244544/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829560 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829535.891971:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704000 x1874670273244544/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829560 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829535.891976:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829535.891978:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829535.891980:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273244544:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829535.891983:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273244672:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829535.891993:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829535.891998:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829535/real 1787829535]  req@ffff9ee005706940 x1874670273244672/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829560 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829535.892004:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706940 x1874670273244672/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829560 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829535.892009:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829535.892011:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829535.892013:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273244672:192.168.203.121@tcp:8:kworker.0
00010000:00010000:3.0:1787829536.723511:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829536.915413:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829537.747498:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829537.939413:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829538.771496:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829538.963384:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829539.795513:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829539.987433:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829540.819474:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1787829541.011399:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1787829541.011400:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787829541.011408:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787829541.011413:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829541.011422:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4704
00000100:00080000:3.0:1787829541.011431:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829541.011438:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787829541.011469:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707840 x1874670273244800/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829541.011494:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829541.011497:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787829541.011498:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829541.011501:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4704
00000100:00080000:3.0:1787829541.011503:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829541.011505:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829541.011513:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787829541.011521:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705680 x1874670273244928/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829541.011529:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829541.011545:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787829541.011547:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829541.011553:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4704
00000100:00100000:0.0:1787829541.011555:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273244800:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787829541.011556:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829541.011563:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829541.011568:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829541.011580:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704780 x1874670273245056/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829541.011588:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829541.011591:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787829541.011592:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829541.011595:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4704
00000100:00080000:3.0:1787829541.011598:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829541.011601:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829541.011604:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:0.0:1787829541.011611:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829541.011615:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057043c0 x1874670273245184/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829541.011623:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829541.011626:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787829541.011628:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829541.011631:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4704
00000100:00080000:3.0:1787829541.011632:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829541.011635:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829541.011638:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787829541.011647:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705a40 x1874670273245312/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829541.011654:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1787829541.011655:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829541/real 1787829541]  req@ffff9ee005707840 x1874670273244800/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829566 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829541.011657:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787829541.011659:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829541.011666:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4704
00000100:00080000:3.0:1787829541.011671:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829541.011677:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829541.011681:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787829541.011697:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707840 x1874670273244800/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829566 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829541.011697:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704b40 x1874670273245440/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829541.011729:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829541.011729:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829541.011737:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787829541.011738:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829541.011741:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:3.0:1787829541.011743:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4704
00000100:00080000:3.0:1787829541.011749:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1787829541.011753:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273244800:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787829541.011754:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829541.011759:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787829541.011769:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273244928:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787829541.011770:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706580 x1874670273245568/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1787829541.011805:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829541.011822:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829541/real 1787829541]  req@ffff9ee005705680 x1874670273244928/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829566 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829541.011838:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705680 x1874670273244928/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829566 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829541.011849:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829541.011853:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829541.011858:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273244928:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787829541.011898:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273245056:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829541.011937:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829541.011955:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829541/real 1787829541]  req@ffff9ee005704780 x1874670273245056/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829566 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829541.011974:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704780 x1874670273245056/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829566 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829541.011985:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829541.011995:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829541.011998:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273245056:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829541.012004:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273245184:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829541.012022:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829541.012032:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829541/real 1787829541]  req@ffff9ee0057043c0 x1874670273245184/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829566 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829541.012049:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057043c0 x1874670273245184/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829566 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829541.012055:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829541.012057:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829541.012059:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273245184:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829541.012062:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273245312:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787829541.012073:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829541.012079:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829541/real 1787829541]  req@ffff9ee005705a40 x1874670273245312/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829566 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829541.012086:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705a40 x1874670273245312/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829566 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829541.012091:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829541.012092:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829541.012094:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273245312:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787829541.012097:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273245440:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829541.012107:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829541.012112:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829541/real 1787829541]  req@ffff9ee005704b40 x1874670273245440/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829566 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829541.012124:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704b40 x1874670273245440/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829566 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829541.012138:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829541.012142:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829541.012145:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273245440:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829541.012152:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273245568:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829541.012173:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829541.012186:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829541/real 1787829541]  req@ffff9ee005706580 x1874670273245568/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829566 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829541.012199:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706580 x1874670273245568/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829566 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829541.012207:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829541.012211:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829541.012215:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273245568:192.168.203.121@tcp:8:kworker.0
00010000:00010000:3.0:1787829541.843575:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829542.035409:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829542.867513:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829543.059414:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829543.891535:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829544.083392:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829544.915467:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829545.107419:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829545.939520:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829546.131393:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:2.0:1787829546.131438:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829546.131443:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787829546.131447:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829546.131454:0:27707:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4709
00000100:00080000:2.0:1787829546.131463:0:27707:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829546.131469:0:27707:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787829546.131516:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057292c0 x1874670273245696/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829546.131539:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829546.131543:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787829546.131545:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829546.131549:0:27707:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4709
00000100:00080000:2.0:1787829546.131553:0:27707:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829546.131557:0:27707:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829546.131568:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787829546.131581:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a940 x1874670273245824/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787829546.131590:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057292c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273245696:192.168.203.121@tcp:250:kworker.0
00000100:00080000:2.0:1787829546.131591:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829546.131595:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787829546.131596:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829546.131599:0:27707:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4709
00000100:00080000:2.0:1787829546.131603:0:27707:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829546.131606:0:27707:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829546.131611:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787829546.131619:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729e00 x1874670273245952/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829546.131627:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829546.131630:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787829546.131631:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829546.131634:0:27707:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4709
00000100:00080000:2.0:1787829546.131637:0:27707:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829546.131640:0:27707:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829546.131644:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:0.0:1787829546.131649:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829546.131654:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728780 x1874670273246080/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829546.131662:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829546.131664:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787829546.131666:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829546.131670:0:27707:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4709
00000100:00080000:2.0:1787829546.131672:0:27707:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829546.131675:0:27707:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829546.131679:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787829546.131687:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829546/real 1787829546]  req@ffff9ee0057292c0 x1874670273245696/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829571 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829546.131688:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a1c0 x1874670273246208/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829546.131697:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829546.131700:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787829546.131702:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829546.131706:0:27707:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4709
00000100:00080000:2.0:1787829546.131709:0:27707:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829546.131712:0:27707:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829546.131717:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787829546.131720:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057292c0 x1874670273245696/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829571 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829546.131727:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729680 x1874670273246336/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829546.131731:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829546.131734:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829546.131736:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:2.0:1787829546.131738:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787829546.131740:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1787829546.131741:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057292c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273245696:192.168.203.121@tcp:250:kworker.0
00000100:00080000:2.0:1787829546.131743:0:27707:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4709
00000100:00080000:2.0:1787829546.131746:0:27707:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829546.131749:0:27707:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829546.131753:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787829546.131762:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273245824:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787829546.131762:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572bc00 x1874670273246464/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1787829546.131786:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829546.131800:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829546/real 1787829546]  req@ffff9ee00572a940 x1874670273245824/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829571 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829546.131813:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a940 x1874670273245824/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829571 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829546.131819:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829546.131821:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829546.131824:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273245824:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787829546.131828:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273245952:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829546.131845:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829546.131852:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829546/real 1787829546]  req@ffff9ee005729e00 x1874670273245952/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829571 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829546.131860:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729e00 x1874670273245952/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829571 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829546.131864:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829546.131866:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829546.131868:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273245952:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829546.131872:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273246080:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829546.131882:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829546.131887:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829546/real 1787829546]  req@ffff9ee005728780 x1874670273246080/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829571 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829546.131894:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728780 x1874670273246080/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829571 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829546.131899:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829546.131901:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829546.131903:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273246080:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829546.131906:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273246208:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787829546.131915:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829546.131920:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829546/real 1787829546]  req@ffff9ee00572a1c0 x1874670273246208/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829571 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829546.131926:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a1c0 x1874670273246208/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829571 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829546.131931:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829546.131933:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829546.131935:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273246208:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787829546.131945:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273246336:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829546.131956:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829546.131962:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829546/real 1787829546]  req@ffff9ee005729680 x1874670273246336/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829571 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829546.131974:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729680 x1874670273246336/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829571 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829546.131978:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829546.131980:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829546.131982:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273246336:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829546.131996:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273246464:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829546.132007:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829546.132013:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829546/real 1787829546]  req@ffff9ee00572bc00 x1874670273246464/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829571 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829546.132020:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572bc00 x1874670273246464/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829571 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829546.132025:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829546.132027:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829546.132028:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273246464:192.168.203.121@tcp:8:kworker.0
00010000:00010000:3.0:1787829546.963472:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829547.155442:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829547.987524:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787829548.179505:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829549.011544:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787829549.203445:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829550.035495:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787829550.227396:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829551.059585:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1787829551.251397:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1787829551.251398:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:2.0:1787829551.251405:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787829551.251409:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829551.251418:0:27707:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4714
00000100:00080000:2.0:1787829551.251428:0:27707:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829551.251435:0:27707:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787829551.251481:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057283c0 x1874670273246592/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829551.251502:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829551.251506:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787829551.251508:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829551.251512:0:27707:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4714
00000100:00080000:2.0:1787829551.251517:0:27707:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829551.251521:0:27707:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829551.251531:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787829551.251535:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273246592:192.168.203.121@tcp:250:kworker.0
00000100:00100000:2.0:1787829551.251544:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728000 x1874670273246720/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829551.251554:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829551.251557:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787829551.251559:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829551.251562:0:27707:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4714
00000100:00080000:2.0:1787829551.251566:0:27707:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829551.251569:0:27707:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829551.251574:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787829551.251583:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a580 x1874670273246848/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1787829551.251592:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:2.0:1787829551.251592:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829551.251595:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787829551.251597:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829551.251601:0:27707:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4714
00000100:00080000:2.0:1787829551.251603:0:27707:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829551.251606:0:27707:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829551.251611:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787829551.251620:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728b40 x1874670273246976/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787829551.251628:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829551/real 1787829551]  req@ffff9ee0057283c0 x1874670273246592/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829576 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829551.251629:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829551.251633:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787829551.251635:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829551.251639:0:27707:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4714
00000100:00080000:2.0:1787829551.251642:0:27707:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1787829551.251645:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057283c0 x1874670273246592/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829576 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829551.251646:0:27707:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829551.251650:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00080000:0.0:1787829551.251655:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:2.0:1787829551.251659:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728f00 x1874670273247104/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829551.251660:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829551.251664:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273246592:192.168.203.121@tcp:250:kworker.0
00000100:00080000:2.0:1787829551.251668:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829551.251672:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787829551.251673:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829551.251677:0:27707:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4714
00000100:00080000:2.0:1787829551.251680:0:27707:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829551.251683:0:27707:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787829551.251685:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273246720:192.168.203.121@tcp:38:kworker.0
00000008:00100000:2.0:1787829551.251687:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787829551.251697:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b840 x1874670273247232/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1787829551.251707:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:2.0:1787829551.251707:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829551.251710:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787829551.251712:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829551.251716:0:27707:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4714
00000100:00100000:0.0:1787829551.251718:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829551/real 1787829551]  req@ffff9ee005728000 x1874670273246720/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829576 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829551.251719:0:27707:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829551.251723:0:27707:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829551.251727:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787829551.251731:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728000 x1874670273246720/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829576 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829551.251736:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729a40 x1874670273247360/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829551.251741:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829551.251744:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829551.251747:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273246720:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787829551.251753:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273246848:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829551.251774:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829551.251787:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829551/real 1787829551]  req@ffff9ee00572a580 x1874670273246848/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829576 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829551.251798:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a580 x1874670273246848/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829576 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829551.251808:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829551.251811:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829551.251813:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273246848:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829551.251817:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273246976:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829551.251832:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829551.251839:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829551/real 1787829551]  req@ffff9ee005728b40 x1874670273246976/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829576 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829551.251846:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728b40 x1874670273246976/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829576 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829551.251851:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829551.251854:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829551.251857:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273246976:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829551.251863:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273247104:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787829551.251882:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829551.251893:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829551/real 1787829551]  req@ffff9ee005728f00 x1874670273247104/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829576 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829551.251906:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728f00 x1874670273247104/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829576 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829551.251914:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829551.251918:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829551.251921:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273247104:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787829551.251937:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273247232:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829551.251952:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829551.251959:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829551/real 1787829551]  req@ffff9ee00572b840 x1874670273247232/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829576 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829551.251967:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b840 x1874670273247232/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829576 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829551.251972:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829551.251975:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829551.251978:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273247232:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829551.251984:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273247360:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829551.252002:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829551.252013:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829551/real 1787829551]  req@ffff9ee005729a40 x1874670273247360/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829576 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829551.252026:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729a40 x1874670273247360/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829576 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829551.252033:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829551.252036:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829551.252039:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273247360:192.168.203.121@tcp:8:kworker.0
00010000:00010000:3.0:1787829552.083515:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787829552.275398:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829553.107523:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787829553.300361:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829554.131462:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787829554.323404:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829555.155506:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787829555.347420:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829556.179433:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1787829556.371404:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1787829556.371407:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:2.0:1787829556.371417:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787829556.371421:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829556.371442:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4720
00000100:00080000:2.0:1787829556.371452:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829556.371458:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787829556.371487:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b0c0 x1874670273247488/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829556.371508:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829556.371511:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787829556.371512:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829556.371514:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4720
00000100:00080000:2.0:1787829556.371517:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829556.371519:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829556.371527:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787829556.371537:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273247488:192.168.203.121@tcp:250:kworker.0
00000100:00100000:2.0:1787829556.371538:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b480 x1874670273247616/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829556.371552:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829556.371554:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787829556.371555:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829556.371559:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4720
00000100:00080000:2.0:1787829556.371561:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829556.371563:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829556.371567:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787829556.371575:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572ad00 x1874670273247744/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829556.371581:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829556.371583:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787829556.371585:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829556.371588:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4720
00000100:00080000:2.0:1787829556.371591:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829556.371593:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829556.371596:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:0.0:1787829556.371597:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829556.371610:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729a40 x1874670273247872/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829556.371617:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829556.371619:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787829556.371621:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829556.371623:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4720
00000100:00080000:2.0:1787829556.371626:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829556.371629:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829556.371632:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787829556.371636:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829556/real 1787829556]  req@ffff9ee00572b0c0 x1874670273247488/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829581 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829556.371644:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b840 x1874670273248000/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829556.371653:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1787829556.371656:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b0c0 x1874670273247488/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829581 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829556.371658:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787829556.371661:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829556.371668:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4720
00000100:00080000:2.0:1787829556.371672:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829556.371674:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829556.371676:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00080000:0.0:1787829556.371680:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000008:00100000:2.0:1787829556.371681:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787829556.371686:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273247488:192.168.203.121@tcp:250:kworker.0
00000100:00100000:2.0:1787829556.371691:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728f00 x1874670273248128/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829556.371702:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829556.371704:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787829556.371706:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1787829556.371709:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273247616:192.168.203.121@tcp:38:kworker.0
00000100:00080000:2.0:1787829556.371712:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4720
00000100:00080000:2.0:1787829556.371718:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829556.371720:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829556.371723:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787829556.371733:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728b40 x1874670273248256/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1787829556.371739:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829556.371756:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829556/real 1787829556]  req@ffff9ee00572b480 x1874670273247616/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829581 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829556.371766:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b480 x1874670273247616/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829581 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829556.371772:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829556.371774:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829556.371776:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273247616:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787829556.371782:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273247744:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829556.371794:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829556.371800:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829556/real 1787829556]  req@ffff9ee00572ad00 x1874670273247744/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829581 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829556.371807:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572ad00 x1874670273247744/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829581 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829556.371812:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829556.371814:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829556.371816:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273247744:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829556.371820:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273247872:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829556.371829:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829556.371835:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829556/real 1787829556]  req@ffff9ee005729a40 x1874670273247872/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829581 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829556.371842:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729a40 x1874670273247872/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829581 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829556.371846:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829556.371848:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829556.371850:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273247872:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829556.371853:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273248000:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787829556.371863:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829556.371868:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829556/real 1787829556]  req@ffff9ee00572b840 x1874670273248000/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829581 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829556.371875:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b840 x1874670273248000/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829581 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829556.371880:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829556.371882:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829556.371884:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273248000:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787829556.371887:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273248128:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829556.371896:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829556.371902:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829556/real 1787829556]  req@ffff9ee005728f00 x1874670273248128/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829581 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829556.371913:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728f00 x1874670273248128/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829581 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829556.371921:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829556.371924:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829556.371927:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273248128:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829556.371949:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273248256:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829556.371969:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829556.371978:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829556/real 1787829556]  req@ffff9ee005728b40 x1874670273248256/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829581 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829556.371985:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728b40 x1874670273248256/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829581 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829556.371995:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829556.371997:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829556.371999:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273248256:192.168.203.121@tcp:8:kworker.0
00010000:00010000:3.0:1787829557.203533:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787829557.395467:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829558.227497:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787829558.419440:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829559.251456:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787829559.443417:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829560.275502:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787829560.467434:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829561.299560:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787829561.491460:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787829561.491482:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829561.491489:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787829561.491508:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829561.491519:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4725
00000100:00080000:3.0:1787829561.491544:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829561.491552:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787829561.491611:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706d00 x1874670273248384/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829561.491636:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829561.491639:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787829561.491640:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829561.491643:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4725
00000100:00080000:3.0:1787829561.491647:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829561.491650:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829561.491660:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787829561.491668:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273248384:192.168.203.121@tcp:250:kworker.0
00000100:00100000:3.0:1787829561.491677:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705e00 x1874670273248512/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829561.491686:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829561.491689:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787829561.491690:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829561.491693:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4725
00000100:00080000:3.0:1787829561.491696:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829561.491698:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829561.491702:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829561.491712:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706580 x1874670273248640/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829561.491718:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829561.491721:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787829561.491722:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829561.491725:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4725
00000100:00080000:3.0:1787829561.491728:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829561.491731:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829561.491734:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829561.491740:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704b40 x1874670273248768/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1787829561.491747:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787829561.491753:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829561.491756:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787829561.491758:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829561.491762:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4725
00000100:00080000:3.0:1787829561.491764:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829561.491767:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829561.491770:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787829561.491777:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705a40 x1874670273248896/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829561.491784:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829561.491786:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787829561.491787:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829561.491789:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4725
00000100:00080000:3.0:1787829561.491791:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829561.491794:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829561.491797:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787829561.491804:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829561/real 1787829561]  req@ffff9ee005706d00 x1874670273248384/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829586 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829561.491808:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057043c0 x1874670273249024/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829561.491835:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1787829561.491840:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706d00 x1874670273248384/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829586 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829561.491840:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787829561.491844:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829561.491851:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4725
00000100:00080000:3.0:1787829561.491856:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829561.491862:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829561.491866:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:0.0:1787829561.491869:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:3.0:1787829561.491875:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704780 x1874670273249152/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829561.491879:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829561.491890:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273248384:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787829561.491917:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273248512:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787829561.491938:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829561.491948:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829561/real 1787829561]  req@ffff9ee005705e00 x1874670273248512/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829586 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829561.491963:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705e00 x1874670273248512/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829586 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829561.491969:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829561.491971:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829561.491974:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273248512:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787829561.491978:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273248640:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829561.491991:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829561.491997:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829561/real 1787829561]  req@ffff9ee005706580 x1874670273248640/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829586 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829561.492005:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706580 x1874670273248640/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829586 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829561.492010:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829561.492012:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829561.492014:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273248640:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829561.492017:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273248768:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829561.492027:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829561.492033:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829561/real 1787829561]  req@ffff9ee005704b40 x1874670273248768/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829586 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829561.492040:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704b40 x1874670273248768/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829586 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829561.492049:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829561.492052:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829561.492054:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273248768:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829561.492057:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273248896:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787829561.492067:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829561.492072:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829561/real 1787829561]  req@ffff9ee005705a40 x1874670273248896/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829586 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829561.492079:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705a40 x1874670273248896/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829586 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829561.492083:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829561.492086:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829561.492088:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273248896:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787829561.492092:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273249024:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829561.492101:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829561.492106:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829561/real 1787829561]  req@ffff9ee0057043c0 x1874670273249024/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829586 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829561.492112:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057043c0 x1874670273249024/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829586 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829561.492117:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829561.492119:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829561.492122:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273249024:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829561.492126:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273249152:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829561.492136:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829561.492142:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829561/real 1787829561]  req@ffff9ee005704780 x1874670273249152/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829586 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829561.492148:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704780 x1874670273249152/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829586 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829561.492153:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829561.492155:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829561.492157:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273249152:192.168.203.121@tcp:8:kworker.0
00010000:00010000:3.0:1787829562.323512:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829562.515460:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829563.347638:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829563.539421:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829564.371463:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829564.563441:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829565.395507:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829565.587434:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829566.419510:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829566.611427:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787829566.611428:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829566.611438:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787829566.611443:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829566.611454:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4730
00000100:00080000:3.0:1787829566.611465:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829566.611474:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787829566.611512:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705680 x1874670273249280/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829566.611542:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829566.611546:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787829566.611549:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829566.611553:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4730
00000100:00080000:3.0:1787829566.611557:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829566.611562:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829566.611572:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787829566.611589:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707840 x1874670273249408/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829566.611602:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829566.611605:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787829566.611608:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829566.611613:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4730
00000100:00080000:3.0:1787829566.611617:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829566.611624:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787829566.611629:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273249280:192.168.203.121@tcp:250:kworker.0
00000008:00100000:3.0:1787829566.611633:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829566.611659:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706940 x1874670273249536/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829566.611684:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829566.611689:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787829566.611691:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829566.611696:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4730
00000100:00080000:3.0:1787829566.611700:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829566.611705:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829566.611710:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829566.611727:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704000 x1874670273249664/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1787829566.611741:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787829566.611752:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829566.611758:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787829566.611760:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829566.611767:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4730
00000100:00080000:3.0:1787829566.611772:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829566.611778:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829566.611783:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787829566.611799:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707480 x1874670273249792/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829566.611811:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1787829566.611813:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829566/real 1787829566]  req@ffff9ee005705680 x1874670273249280/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829591 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829566.611824:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787829566.611834:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829566.611848:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4730
00000100:00080000:3.0:1787829566.611854:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1787829566.611858:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705680 x1874670273249280/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829591 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829566.611865:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829566.611885:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:0.0:1787829566.611889:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829566.611897:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829566.611902:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273249280:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787829566.611912:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273249408:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787829566.611917:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057070c0 x1874670273249920/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829566.611934:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829566.611938:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787829566.611942:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829566.611950:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4730
00000800:00000100:0.0:1787829566.611952:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787829566.611961:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829566.611967:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829566.611975:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787829566.611978:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829566/real 1787829566]  req@ffff9ee005707840 x1874670273249408/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829591 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829566.611994:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057052c0 x1874670273250048/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787829566.612002:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707840 x1874670273249408/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829591 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829566.612037:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829566.612043:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829566.612050:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273249408:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787829566.612083:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273249536:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829566.612107:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829566.612119:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829566/real 1787829566]  req@ffff9ee005706940 x1874670273249536/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829591 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829566.612131:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706940 x1874670273249536/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829591 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829566.612141:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829566.612144:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829566.612148:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273249536:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829566.612154:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273249664:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829566.612173:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829566.612185:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829566/real 1787829566]  req@ffff9ee005704000 x1874670273249664/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829591 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829566.612214:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704000 x1874670273249664/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829591 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829566.612223:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829566.612227:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829566.612231:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273249664:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829566.612237:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273249792:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787829566.612256:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829566.612267:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829566/real 1787829566]  req@ffff9ee005707480 x1874670273249792/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829591 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829566.612279:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707480 x1874670273249792/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829591 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829566.612288:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829566.612291:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829566.612294:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273249792:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787829566.612300:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273249920:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829566.612390:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829566.612406:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829566/real 1787829566]  req@ffff9ee0057070c0 x1874670273249920/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829591 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829566.612419:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057070c0 x1874670273249920/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829591 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829566.612434:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829566.612438:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829566.612442:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273249920:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829566.612449:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273250048:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829566.612472:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829566.612485:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829566/real 1787829566]  req@ffff9ee0057052c0 x1874670273250048/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829591 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829566.612497:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057052c0 x1874670273250048/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829591 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829566.612506:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829566.612510:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829566.612514:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273250048:192.168.203.121@tcp:8:kworker.0
00010000:00010000:3.0:1787829567.443514:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829567.635414:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829568.467465:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829568.659430:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829569.491446:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829569.683443:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829570.515498:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829570.707459:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829571.539445:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1787829571.731427:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1787829571.731431:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787829571.731440:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787829571.731445:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829571.731455:0:27707:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4735
00000100:00080000:3.0:1787829571.731467:0:27707:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829571.731474:0:27707:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787829571.731511:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707c00 x1874670273250176/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829571.731540:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829571.731550:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787829571.731552:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829571.731557:0:27707:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4735
00000100:00080000:3.0:1787829571.731562:0:27707:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829571.731567:0:27707:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829571.731577:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787829571.731597:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273250176:192.168.203.121@tcp:250:kworker.0
00000100:00100000:3.0:1787829571.731597:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057061c0 x1874670273250304/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829571.731617:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829571.731620:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787829571.731622:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829571.731627:0:27707:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4735
00000100:00080000:3.0:1787829571.731631:0:27707:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829571.731636:0:27707:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829571.731642:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829571.731656:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057052c0 x1874670273250432/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829571.731668:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829571.731674:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000800:00000100:0.0:1787829571.731675:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787829571.731679:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829571.731686:0:27707:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4735
00000100:00080000:3.0:1787829571.731691:0:27707:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829571.731696:0:27707:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829571.731702:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829571.731715:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057070c0 x1874670273250560/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787829571.731723:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829571/real 1787829571]  req@ffff9ee005707c00 x1874670273250176/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829596 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829571.731729:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829571.731738:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787829571.731741:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829571.731749:0:27707:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4735
00000100:00100000:0.0:1787829571.731755:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707c00 x1874670273250176/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829596 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829571.731764:0:27707:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829571.731768:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829571.731773:0:27707:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00080000:0.0:1787829571.731778:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000008:00100000:3.0:1787829571.731783:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787829571.731786:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273250176:192.168.203.121@tcp:250:kworker.0
00000100:00100000:3.0:1787829571.731801:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707480 x1874670273250688/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787829571.731813:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273250304:192.168.203.121@tcp:38:kworker.0
00000100:00080000:3.0:1787829571.731815:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829571.731823:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787829571.731826:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829571.731831:0:27707:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4735
00000100:00080000:3.0:1787829571.731836:0:27707:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829571.731841:0:27707:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829571.731847:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:0.0:1787829571.731850:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829571.731865:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704000 x1874670273250816/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787829571.731871:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829571/real 1787829571]  req@ffff9ee0057061c0 x1874670273250304/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829596 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829571.731884:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829571.731891:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787829571.731894:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1787829571.731898:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057061c0 x1874670273250304/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829596 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829571.731902:0:27707:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4735
00000100:00080000:3.0:1787829571.731911:0:27707:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829571.731915:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829571.731918:0:27707:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00080000:0.0:1787829571.731923:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000008:00100000:3.0:1787829571.731928:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787829571.731931:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273250304:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787829571.731942:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273250432:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829571.731945:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706940 x1874670273250944/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1787829571.731971:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829571.731987:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829571/real 1787829571]  req@ffff9ee0057052c0 x1874670273250432/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829596 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829571.732000:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057052c0 x1874670273250432/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829596 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829571.732009:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829571.732013:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829571.732017:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273250432:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829571.732023:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273250560:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829571.732054:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829571.732066:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829571/real 1787829571]  req@ffff9ee0057070c0 x1874670273250560/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829596 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829571.732079:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057070c0 x1874670273250560/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829596 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829571.732088:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829571.732092:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829571.732096:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273250560:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829571.732112:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273250688:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787829571.732133:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829571.732144:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829571/real 1787829571]  req@ffff9ee005707480 x1874670273250688/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829596 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829571.732157:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707480 x1874670273250688/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829596 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829571.732164:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829571.732168:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829571.732172:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273250688:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787829571.732178:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273250816:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829571.732196:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829571.732208:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829571/real 1787829571]  req@ffff9ee005704000 x1874670273250816/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829596 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829571.732228:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704000 x1874670273250816/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829596 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829571.732251:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829571.732254:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829571.732258:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273250816:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829571.732265:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273250944:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829571.732285:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829571.732297:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829571/real 1787829571]  req@ffff9ee005706940 x1874670273250944/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829596 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829571.732309:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706940 x1874670273250944/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829596 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829571.732361:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829571.732365:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829571.732368:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273250944:192.168.203.121@tcp:8:kworker.0
00010000:00010000:3.0:1787829572.563497:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829572.755415:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829573.587455:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829573.779419:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829574.611547:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829574.803466:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829575.635494:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829575.827417:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829576.659463:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1787829576.851417:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829576.851425:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787829576.851429:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829576.851438:0:27707:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4740
00000100:00080000:3.0:1787829576.851448:0:27707:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1787829576.851450:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787829576.851457:0:27707:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787829576.851488:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707840 x1874670273251072/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829576.851509:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829576.851512:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787829576.851513:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829576.851516:0:27707:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4740
00000100:00080000:3.0:1787829576.851519:0:27707:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829576.851522:0:27707:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829576.851530:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787829576.851542:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273251072:192.168.203.121@tcp:250:kworker.0
00000100:00100000:3.0:1787829576.851543:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705680 x1874670273251200/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829576.851559:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829576.851562:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787829576.851564:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829576.851568:0:27707:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4740
00000100:00080000:3.0:1787829576.851571:0:27707:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829576.851574:0:27707:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829576.851580:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829576.851588:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704780 x1874670273251328/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829576.851597:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829576.851601:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787829576.851603:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829576.851607:0:27707:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4740
00000100:00080000:3.0:1787829576.851612:0:27707:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829576.851616:0:27707:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000800:00000100:0.0:1787829576.851622:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000008:00100000:3.0:1787829576.851624:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829576.851641:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057043c0 x1874670273251456/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829576.851652:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829576.851656:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787829576.851658:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1787829576.851663:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829576/real 1787829576]  req@ffff9ee005707840 x1874670273251072/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829601 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829576.851663:0:27707:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4740
00000100:00080000:3.0:1787829576.851670:0:27707:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829576.851677:0:27707:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829576.851684:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787829576.851695:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707840 x1874670273251072/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829601 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829576.851706:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829576.851710:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829576.851714:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273251072:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787829576.851733:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273251200:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787829576.851750:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829576.851759:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829576/real 1787829576]  req@ffff9ee005705680 x1874670273251200/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829601 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829576.851766:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705a40 x1874670273251584/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787829576.851773:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705680 x1874670273251200/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829601 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829576.851779:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829576.851785:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787829576.851788:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829576.851795:0:27707:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4740
00000100:00080000:0.0:1787829576.851796:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829576.851798:0:27707:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829576.851806:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00080000:3.0:1787829576.851806:0:27707:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829576.851813:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787829576.851817:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273251200:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787829576.851828:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273251328:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829576.851828:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704b40 x1874670273251712/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829576.851841:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829576.851844:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787829576.851847:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:0.0:1787829576.851850:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787829576.851854:0:27707:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4740
00000100:00080000:3.0:1787829576.851861:0:27707:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1787829576.851863:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829576/real 1787829576]  req@ffff9ee005704780 x1874670273251328/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829601 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829576.851869:0:27707:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787829576.851876:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704780 x1874670273251328/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829601 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829576.851886:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829576.851888:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829576.851891:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273251328:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829576.851894:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273251456:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829576.851906:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829576.851912:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829576/real 1787829576]  req@ffff9ee0057043c0 x1874670273251456/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829601 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829576.851919:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057043c0 x1874670273251456/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829601 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829576.851924:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829576.851926:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829576.851928:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273251456:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829576.851941:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273251584:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787829576.851954:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829576.851961:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829576/real 1787829576]  req@ffff9ee005705a40 x1874670273251584/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829601 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829576.851970:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705a40 x1874670273251584/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829601 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829576.851979:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000008:00100000:3.0:1787829576.851979:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:0.0:1787829576.851985:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829576.851988:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273251584:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787829576.851996:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273251712:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829576.851996:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706580 x1874670273251840/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1787829576.852015:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829576.852024:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829576/real 1787829576]  req@ffff9ee005704b40 x1874670273251712/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829601 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829576.852034:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704b40 x1874670273251712/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829601 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829576.852042:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829576.852046:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829576.852050:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273251712:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829576.852060:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273251840:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829576.852083:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829576.852098:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829576/real 1787829576]  req@ffff9ee005706580 x1874670273251840/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829601 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829576.852110:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706580 x1874670273251840/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829601 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829576.852117:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829576.852120:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829576.852123:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273251840:192.168.203.121@tcp:8:kworker.0
00010000:00010000:3.0:1787829577.683514:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787829577.875393:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829578.707500:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787829578.899421:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829579.731478:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787829579.923395:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829580.755505:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787829580.947401:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829581.779545:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1787829581.971398:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829581.971405:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787829581.971409:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829581.971418:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4745
00000100:00100000:0.0:1787829581.971422:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:2.0:1787829581.971427:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829581.971435:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787829581.971466:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a580 x1874670273251968/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829581.971487:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829581.971490:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787829581.971492:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829581.971495:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4745
00000100:00080000:2.0:1787829581.971498:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829581.971502:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829581.971510:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787829581.971519:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273251968:192.168.203.121@tcp:250:kworker.0
00000100:00100000:2.0:1787829581.971522:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728000 x1874670273252096/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829581.971532:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829581.971534:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787829581.971535:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829581.971543:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4745
00000100:00080000:2.0:1787829581.971545:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829581.971549:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829581.971553:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787829581.971561:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057283c0 x1874670273252224/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829581.971568:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829581.971570:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787829581.971571:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829581.971574:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4745
00000100:00080000:2.0:1787829581.971576:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829581.971579:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829581.971582:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787829581.971593:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572bc00 x1874670273252352/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829581.971601:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829581.971604:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787829581.971606:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829581.971609:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4745
00000100:00080000:2.0:1787829581.971612:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1787829581.971615:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273252096:192.168.203.121@tcp:38:kworker.0
00000100:00080000:2.0:1787829581.971617:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829581.971624:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787829581.971635:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729680 x1874670273252480/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829581.971643:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829581.971645:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787829581.971647:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829581.971650:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4745
00000100:00080000:2.0:1787829581.971653:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1787829581.971654:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273252224:192.168.203.121@tcp:8:kworker.0
00000100:00080000:2.0:1787829581.971659:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829581.971664:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787829581.971674:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a1c0 x1874670273252608/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787829581.971681:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273252352:192.168.203.121@tcp:8:kworker.0
00000100:00080000:2.0:1787829581.971683:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829581.971689:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787829581.971690:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829581.971693:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4745
00000100:00080000:2.0:1787829581.971698:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829581.971700:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787829581.971707:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273252480:192.168.203.121@tcp:38:kworker.0
00000008:00100000:2.0:1787829581.971712:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787829581.971723:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728780 x1874670273252736/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787829581.971731:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273252608:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829581.971751:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273252736:192.168.203.121@tcp:8:kworker.0
00010000:00010000:3.0:1787829582.803453:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787829582.995410:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829583.827478:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787829584.019640:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829584.851488:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787829585.043416:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000400:00000100:3.0:1787829585.043547:0:2352:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.203.121:988
00000400:00000100:3.0:1787829585.043593:0:2352:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.203.121@tcp at host 192.168.203.121 was unreachable: the network or that node may be down, or Lustre may be misconfigured.
00000800:00000100:3.0:1787829585.043611:0:2352:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:3.0:1787829585.043655:0:2352:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:3.0:1787829585.043666:0:2352:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:3.0:1787829585.043676:0:2352:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:3.0:1787829585.043683:0:2352:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:3.0:1787829585.043690:0:2352:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:3.0:1787829585.043697:0:2352:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000100:00100000:0.0:1787829585.043702:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829581/real 1787829585]  req@ffff9ee005729680 x1874670273252480/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829606 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829585.043730:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729680 x1874670273252480/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829606 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829585.043743:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829585.043748:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829585.043753:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273252480:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787829585.043762:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829581/real 1787829585]  req@ffff9ee00572a1c0 x1874670273252608/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829606 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829585.043775:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a1c0 x1874670273252608/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829606 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829585.043783:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829585.043787:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829585.043791:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273252608:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829585.043798:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829581/real 1787829585]  req@ffff9ee005728000 x1874670273252096/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829606 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829585.043811:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728000 x1874670273252096/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829606 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829585.043820:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829585.043823:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829585.043827:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273252096:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787829585.043834:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829581/real 1787829585]  req@ffff9ee0057283c0 x1874670273252224/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829606 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829585.043843:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057283c0 x1874670273252224/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829606 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829585.043852:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829585.043856:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829585.043859:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273252224:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829585.043867:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829581/real 1787829585]  req@ffff9ee00572bc00 x1874670273252352/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829606 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829585.043880:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572bc00 x1874670273252352/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829606 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829585.043889:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829585.043892:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829585.043895:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273252352:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829585.043902:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829581/real 1787829585]  req@ffff9ee00572a580 x1874670273251968/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829606 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829585.043915:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a580 x1874670273251968/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829606 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829585.043923:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829585.043926:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829585.043929:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273251968:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787829585.043958:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829581/real 1787829585]  req@ffff9ee005728780 x1874670273252736/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829606 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829585.043969:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728780 x1874670273252736/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829606 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829585.043992:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829585.043996:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829585.044000:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273252736:192.168.203.121@tcp:8:kworker.0
00010000:00010000:0.0:1787829585.875444:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787829586.067503:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829586.899465:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1787829587.091397:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829587.091406:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787829587.091409:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829587.091418:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4750
00000100:00080000:2.0:1787829587.091427:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829587.091434:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787829587.091455:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00100000:2.0:1787829587.091470:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729e00 x1874670273252864/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829587.091489:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829587.091492:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787829587.091494:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829587.091497:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4750
00000100:00080000:2.0:1787829587.091500:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829587.091503:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829587.091510:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787829587.091517:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273252864:192.168.203.121@tcp:250:kworker.0
00000100:00100000:2.0:1787829587.091522:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a940 x1874670273252992/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829587.091532:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829587.091535:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787829587.091536:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829587.091539:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4750
00000100:00080000:2.0:1787829587.091541:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829587.091545:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829587.091549:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787829587.091558:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057292c0 x1874670273253120/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829587.091567:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829587.091571:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787829587.091574:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829587.091577:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4750
00000800:00000100:0.0:1787829587.091583:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:2.0:1787829587.091583:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829587.091591:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829587.091597:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787829587.091612:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728780 x1874670273253248/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787829587.091620:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829587/real 1787829587]  req@ffff9ee005729e00 x1874670273252864/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829612 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829587.091628:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829587.091634:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787829587.091636:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1787829587.091640:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729e00 x1874670273252864/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829612 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829587.091646:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4750
00000100:00080000:0.0:1787829587.091653:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829587.091654:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829587.091660:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829587.091665:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273252864:192.168.203.121@tcp:250:kworker.0
00000100:00080000:2.0:1787829587.091665:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829587.091675:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787829587.091697:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273252992:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787829587.091703:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a580 x1874670273253376/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829587.091718:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829587.091723:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787829587.091726:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:0.0:1787829587.091730:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:2.0:1787829587.091735:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4750
00000100:00080000:2.0:1787829587.091742:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829587.091747:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787829587.091752:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829587/real 1787829587]  req@ffff9ee00572a940 x1874670273252992/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829612 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:2.0:1787829587.091752:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787829587.091766:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572bc00 x1874670273253504/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787829587.091773:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a940 x1874670273252992/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829612 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829587.091783:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829587.091791:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787829587.091793:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829587.091794:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829587.091800:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4750
00000100:00080000:0.0:1787829587.091804:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00080000:2.0:1787829587.091807:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1787829587.091813:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273252992:192.168.203.121@tcp:38:kworker.0
00000100:00080000:2.0:1787829587.091816:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829587.091826:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787829587.091830:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057292c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273253120:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787829587.091842:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057283c0 x1874670273253632/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1787829587.091862:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829587.091878:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829587/real 1787829587]  req@ffff9ee0057292c0 x1874670273253120/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829612 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829587.091889:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057292c0 x1874670273253120/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829612 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829587.091896:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829587.091899:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829587.091902:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057292c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273253120:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829587.091908:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273253248:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829587.091946:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829587.091958:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829587/real 1787829587]  req@ffff9ee005728780 x1874670273253248/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829612 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829587.091970:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728780 x1874670273253248/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829612 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829587.091979:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829587.091982:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829587.091991:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273253248:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829587.092010:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273253376:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787829587.092030:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829587.092041:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829587/real 1787829587]  req@ffff9ee00572a580 x1874670273253376/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829612 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829587.092058:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a580 x1874670273253376/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829612 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829587.092066:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829587.092068:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829587.092071:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273253376:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787829587.092076:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273253504:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829587.092093:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829587.092103:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829587/real 1787829587]  req@ffff9ee00572bc00 x1874670273253504/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829612 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829587.092115:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572bc00 x1874670273253504/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829612 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829587.092122:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829587.092125:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829587.092128:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273253504:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829587.092134:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273253632:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829587.092153:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829587.092165:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829587/real 1787829587]  req@ffff9ee0057283c0 x1874670273253632/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829612 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829587.092178:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057283c0 x1874670273253632/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829612 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829587.092191:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829587.092195:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829587.092198:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273253632:192.168.203.121@tcp:8:kworker.0
00010000:00010000:3.0:1787829587.923471:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787829588.115521:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829588.947499:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787829589.139408:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829589.971546:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787829590.163449:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829590.995525:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787829591.187445:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829592.019502:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1787829592.211399:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1787829592.211406:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:2.0:1787829592.211408:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787829592.211414:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829592.211423:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4755
00000100:00080000:2.0:1787829592.211437:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829592.211444:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787829592.211474:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728000 x1874670273253760/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829592.211494:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829592.211497:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787829592.211498:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829592.211501:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4755
00000100:00080000:2.0:1787829592.211504:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829592.211506:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829592.211514:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787829592.211522:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a1c0 x1874670273253888/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829592.211531:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1787829592.211535:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273253760:192.168.203.121@tcp:250:kworker.0
00000100:00080000:2.0:1787829592.211536:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787829592.211538:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829592.211544:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4755
00000100:00080000:2.0:1787829592.211547:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829592.211549:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829592.211553:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787829592.211561:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729680 x1874670273254016/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829592.211568:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829592.211570:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787829592.211572:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829592.211574:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4755
00000100:00080000:2.0:1787829592.211577:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829592.211580:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829592.211583:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787829592.211591:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728b40 x1874670273254144/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829592.211601:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829592.211605:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787829592.211609:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829592.211615:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4755
00000800:00000100:0.0:1787829592.211618:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:2.0:1787829592.211625:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829592.211632:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829592.211638:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787829592.211651:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728f00 x1874670273254272/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829592.211661:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1787829592.211667:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829592/real 1787829592]  req@ffff9ee005728000 x1874670273253760/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829617 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829592.211667:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787829592.211671:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829592.211680:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4755
00000100:00080000:2.0:1787829592.211688:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829592.211694:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787829592.211699:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728000 x1874670273253760/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829617 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:2.0:1787829592.211700:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:0.0:1787829592.211715:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:2.0:1787829592.211715:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b840 x1874670273254400/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829592.211726:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829592.211735:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273253760:192.168.203.121@tcp:250:kworker.0
00000100:00080000:2.0:1787829592.211737:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829592.211744:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787829592.211746:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829592.211749:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4755
00000100:00080000:2.0:1787829592.211752:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829592.211754:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829592.211757:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787829592.211765:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273253888:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787829592.211766:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729a40 x1874670273254528/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1787829592.211800:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829592.211814:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829592/real 1787829592]  req@ffff9ee00572a1c0 x1874670273253888/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829617 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829592.211834:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a1c0 x1874670273253888/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829617 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829592.211843:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829592.211846:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829592.211850:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273253888:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787829592.211857:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273254016:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829592.211878:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829592.211890:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829592/real 1787829592]  req@ffff9ee005729680 x1874670273254016/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829617 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829592.211903:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729680 x1874670273254016/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829617 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829592.211911:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829592.211925:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829592.211930:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273254016:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829592.211937:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273254144:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829592.211958:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829592.211970:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829592/real 1787829592]  req@ffff9ee005728b40 x1874670273254144/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829617 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829592.211983:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728b40 x1874670273254144/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829617 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829592.212000:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829592.212003:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829592.212007:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273254144:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829592.212013:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273254272:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787829592.212032:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829592.212043:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829592/real 1787829592]  req@ffff9ee005728f00 x1874670273254272/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829617 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829592.212057:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728f00 x1874670273254272/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829617 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829592.212066:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829592.212069:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829592.212073:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273254272:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787829592.212079:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273254400:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829592.212098:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829592.212109:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829592/real 1787829592]  req@ffff9ee00572b840 x1874670273254400/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829617 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829592.212122:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b840 x1874670273254400/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829617 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829592.212132:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829592.212136:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829592.212140:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273254400:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829592.212161:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273254528:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829592.212197:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829592.212210:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829592/real 1787829592]  req@ffff9ee005729a40 x1874670273254528/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829617 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829592.212224:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729a40 x1874670273254528/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829617 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829592.212233:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829592.212245:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829592.212249:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273254528:192.168.203.121@tcp:8:kworker.0
00010000:00010000:3.0:1787829593.043456:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787829593.235418:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829594.067507:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787829594.259401:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829595.091444:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787829595.283436:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829596.115530:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787829596.307420:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829597.139532:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787829597.331415:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787829597.331461:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829597.331474:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787829597.331478:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829597.331492:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4761
00000100:00080000:3.0:1787829597.331506:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829597.331515:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787829597.331564:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705e00 x1874670273254656/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829597.331606:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829597.331610:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787829597.331612:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829597.331618:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4761
00000100:00080000:3.0:1787829597.331622:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829597.331627:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829597.331640:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787829597.331656:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273254656:192.168.203.121@tcp:250:kworker.0
00000100:00100000:3.0:1787829597.331656:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706d00 x1874670273254784/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829597.331681:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829597.331684:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787829597.331686:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829597.331692:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4761
00000100:00080000:3.0:1787829597.331696:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829597.331701:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829597.331706:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829597.331719:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706580 x1874670273254912/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1787829597.331732:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787829597.331734:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829597.331740:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787829597.331742:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829597.331749:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4761
00000100:00080000:3.0:1787829597.331756:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829597.331761:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829597.331766:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787829597.331794:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829597/real 1787829597]  req@ffff9ee005705e00 x1874670273254656/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829622 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829597.331794:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704b40 x1874670273255040/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829597.331858:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829597.331862:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787829597.331865:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1787829597.331872:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705e00 x1874670273254656/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829622 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829597.331878:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4761
00000100:00080000:3.0:1787829597.331883:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829597.331888:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829597.331900:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00080000:0.0:1787829597.331914:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:3.0:1787829597.331923:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705a40 x1874670273255168/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829597.331924:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829597.331936:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273254656:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787829597.331956:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829597.331960:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787829597.331963:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829597.331968:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4761
00000100:00080000:3.0:1787829597.331972:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1787829597.331978:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273254784:192.168.203.121@tcp:38:kworker.0
00000100:00080000:3.0:1787829597.331978:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829597.331988:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829597.332003:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057043c0 x1874670273255296/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829597.332013:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:0.0:1787829597.332023:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787829597.332023:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787829597.332030:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829597.332038:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4761
00000100:00080000:3.0:1787829597.332041:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829597.332047:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787829597.332052:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829597/real 1787829597]  req@ffff9ee005706d00 x1874670273254784/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829622 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:3.0:1787829597.332054:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829597.332071:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704780 x1874670273255424/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787829597.332078:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706d00 x1874670273254784/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829622 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829597.332100:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829597.332103:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829597.332106:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273254784:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787829597.332114:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273254912:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829597.332130:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829597.332155:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829597/real 1787829597]  req@ffff9ee005706580 x1874670273254912/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829622 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829597.332169:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706580 x1874670273254912/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829622 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829597.332178:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829597.332182:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829597.332186:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273254912:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829597.332193:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273255040:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829597.332215:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829597.332226:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829597/real 1787829597]  req@ffff9ee005704b40 x1874670273255040/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829622 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829597.332234:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704b40 x1874670273255040/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829622 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829597.332240:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829597.332243:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829597.332247:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273255040:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829597.332254:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273255168:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787829597.332275:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829597.332286:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829597/real 1787829597]  req@ffff9ee005705a40 x1874670273255168/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829622 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829597.332299:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705a40 x1874670273255168/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829622 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829597.332305:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829597.332307:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829597.332310:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273255168:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787829597.332343:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273255296:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829597.332359:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829597.332367:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829597/real 1787829597]  req@ffff9ee0057043c0 x1874670273255296/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829622 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829597.332379:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057043c0 x1874670273255296/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829622 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829597.332384:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829597.332386:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829597.332388:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273255296:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829597.332392:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273255424:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829597.332402:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829597.332408:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829597/real 1787829597]  req@ffff9ee005704780 x1874670273255424/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829622 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829597.332415:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704780 x1874670273255424/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829622 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829597.332419:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829597.332421:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829597.332423:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273255424:192.168.203.121@tcp:8:kworker.0
00010000:00010000:3.0:1787829598.163506:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787829598.355410:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829599.187528:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787829599.379437:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829600.211474:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787829600.403447:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829601.235472:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787829601.427388:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829602.259464:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787829602.451403:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:1.0:1787829602.451404:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829602.451412:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1787829602.451416:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829602.451423:0:27707:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4766
00000100:00080000:1.0:1787829602.451433:0:27707:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829602.451438:0:27707:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787829602.451472:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a12c0 x1874670273255552/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829602.451494:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829602.451497:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787829602.451498:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829602.451501:0:27707:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4766
00000100:00080000:1.0:1787829602.451503:0:27707:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829602.451507:0:27707:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829602.451515:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787829602.451522:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273255552:192.168.203.121@tcp:250:kworker.0
00000100:00100000:1.0:1787829602.451526:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1a40 x1874670273255680/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829602.451538:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829602.451540:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787829602.451541:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829602.451544:0:27707:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4766
00000100:00080000:1.0:1787829602.451547:0:27707:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829602.451555:0:27707:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829602.451559:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787829602.451567:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a3c00 x1874670273255808/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829602.451574:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829602.451576:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787829602.451578:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829602.451580:0:27707:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4766
00000100:00080000:1.0:1787829602.451582:0:27707:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829602.451584:0:27707:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829602.451588:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:0.0:1787829602.451589:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829602.451597:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0f00 x1874670273255936/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829602.451608:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829602.451611:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787829602.451612:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829602.451615:0:27707:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4766
00000100:00080000:1.0:1787829602.451617:0:27707:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829602.451620:0:27707:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829602.451624:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787829602.451631:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829602/real 1787829602]  req@ffff9ee0056a12c0 x1874670273255552/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829627 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829602.451639:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1680 x1874670273256064/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829602.451649:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1787829602.451653:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a12c0 x1874670273255552/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829627 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829602.451653:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787829602.451657:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829602.451664:0:27707:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4766
00000100:00080000:1.0:1787829602.451669:0:27707:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829602.451673:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829602.451673:0:27707:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829602.451680:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:0.0:1787829602.451681:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829602.451688:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273255552:192.168.203.121@tcp:250:kworker.0
00000100:00100000:1.0:1787829602.451693:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a21c0 x1874670273256192/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829602.451700:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829602.451702:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787829602.451704:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829602.451707:0:27707:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4766
00000100:00080000:1.0:1787829602.451709:0:27707:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1787829602.451711:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273255680:192.168.203.121@tcp:38:kworker.0
00000100:00080000:1.0:1787829602.451715:0:27707:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829602.451720:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787829602.451730:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a2940 x1874670273256320/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1787829602.451739:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829602.451751:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829602/real 1787829602]  req@ffff9ee0056a1a40 x1874670273255680/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829627 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829602.451760:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1a40 x1874670273255680/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829627 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829602.451766:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829602.451768:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829602.451771:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273255680:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787829602.451775:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273255808:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829602.451786:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829602.451793:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829602/real 1787829602]  req@ffff9ee0056a3c00 x1874670273255808/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829627 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829602.451805:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a3c00 x1874670273255808/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829627 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829602.451810:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829602.451812:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829602.451814:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273255808:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829602.451817:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273255936:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829602.451844:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829602.451857:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829602/real 1787829602]  req@ffff9ee0056a0f00 x1874670273255936/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829627 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829602.451869:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0f00 x1874670273255936/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829627 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829602.451878:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829602.451880:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829602.451883:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273255936:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829602.451887:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273256064:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787829602.451902:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829602.451917:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829602/real 1787829602]  req@ffff9ee0056a1680 x1874670273256064/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829627 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829602.451928:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1680 x1874670273256064/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829627 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829602.451938:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829602.451940:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829602.451942:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273256064:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787829602.451946:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273256192:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829602.451956:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829602.451963:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829602/real 1787829602]  req@ffff9ee0056a21c0 x1874670273256192/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829627 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829602.451970:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a21c0 x1874670273256192/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829627 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829602.451975:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829602.451976:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829602.451978:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273256192:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829602.451992:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273256320:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829602.452002:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829602.452008:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829602/real 1787829602]  req@ffff9ee0056a2940 x1874670273256320/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829627 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829602.452015:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a2940 x1874670273256320/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829627 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829602.452020:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829602.452022:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829602.452024:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273256320:192.168.203.121@tcp:8:kworker.0
00010000:00010000:3.0:1787829603.283485:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787829603.475464:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829604.307477:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787829604.499399:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829605.331470:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787829605.523433:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829606.355534:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787829606.547407:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829607.379476:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787829607.571465:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:1.0:1787829607.571465:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829607.571480:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1787829607.571486:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829607.571500:0:27707:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4771
00000100:00080000:1.0:1787829607.571526:0:27707:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829607.571537:0:27707:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787829607.571589:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a03c0 x1874670273256448/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829607.571623:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829607.571628:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787829607.571632:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829607.571638:0:27707:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4771
00000100:00080000:1.0:1787829607.571644:0:27707:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829607.571649:0:27707:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787829607.571658:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273256448:192.168.203.121@tcp:250:kworker.0
00000008:00100000:1.0:1787829607.571662:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787829607.571684:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1e00 x1874670273256576/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829607.571699:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829607.571703:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787829607.571705:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829607.571710:0:27707:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4771
00000100:00080000:1.0:1787829607.571716:0:27707:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000800:00000100:0.0:1787829607.571722:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:1.0:1787829607.571727:0:27707:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829607.571735:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787829607.571754:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a3480 x1874670273256704/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787829607.571766:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829607/real 1787829607]  req@ffff9ee0056a03c0 x1874670273256448/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829632 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829607.571768:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829607.571789:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787829607.571795:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829607.571806:0:27707:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4771
00000100:00100000:0.0:1787829607.571807:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a03c0 x1874670273256448/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829632 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829607.571817:0:27707:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829607.571822:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829607.571828:0:27707:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00080000:0.0:1787829607.571832:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829607.571842:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273256448:192.168.203.121@tcp:250:kworker.0
00000008:00100000:1.0:1787829607.571844:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787829607.571865:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a30c0 x1874670273256832/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787829607.571868:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273256576:192.168.203.121@tcp:38:kworker.0
00000100:00080000:1.0:1787829607.571897:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829607.571902:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000800:00000100:0.0:1787829607.571904:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:1.0:1787829607.571909:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829607.571918:0:27707:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4771
00000100:00080000:1.0:1787829607.571927:0:27707:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1787829607.571931:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829607/real 1787829607]  req@ffff9ee0056a1e00 x1874670273256576/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829632 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829607.571938:0:27707:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787829607.571951:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1e00 x1874670273256576/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829632 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:1.0:1787829607.571952:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00080000:0.0:1787829607.571971:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829607.571974:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829607.571979:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273256576:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787829607.571984:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0b40 x1874670273256960/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787829607.571988:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273256704:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829607.572017:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:1.0:1787829607.572032:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1787829607.572036:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829607/real 1787829607]  req@ffff9ee0056a3480 x1874670273256704/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829632 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829607.572041:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787829607.572047:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1787829607.572057:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a3480 x1874670273256704/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829632 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829607.572062:0:27707:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4771
00000100:00080000:1.0:1787829607.572091:0:27707:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829607.572092:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829607.572100:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00080000:1.0:1787829607.572105:0:27707:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787829607.572109:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273256704:192.168.203.121@tcp:8:kworker.0
00000008:00100000:1.0:1787829607.572119:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787829607.572128:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273256832:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787829607.572140:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a2580 x1874670273257088/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1787829607.572154:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829607.572167:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829607/real 1787829607]  req@ffff9ee0056a30c0 x1874670273256832/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829632 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829607.572168:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829607.572190:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787829607.572197:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1787829607.572202:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a30c0 x1874670273256832/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829632 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829607.572207:0:27707:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4771
00000100:00080000:1.0:1787829607.572217:0:27707:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829607.572222:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829607.572226:0:27707:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00080000:0.0:1787829607.572234:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000008:00100000:1.0:1787829607.572240:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787829607.572242:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273256832:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829607.572255:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273256960:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787829607.572262:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0000 x1874670273257216/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1787829607.572277:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829607.572289:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829607/real 1787829607]  req@ffff9ee0056a0b40 x1874670273256960/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829632 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829607.572299:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0b40 x1874670273256960/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829632 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829607.572307:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829607.572310:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829607.572312:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273256960:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787829607.572343:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273257088:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829607.572356:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829607.572363:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829607/real 1787829607]  req@ffff9ee0056a2580 x1874670273257088/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829632 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829607.572371:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a2580 x1874670273257088/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829632 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829607.572376:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829607.572378:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829607.572381:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273257088:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829607.572384:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273257216:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829607.572394:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829607.572400:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829607/real 1787829607]  req@ffff9ee0056a0000 x1874670273257216/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829632 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829607.572411:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0000 x1874670273257216/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829632 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829607.572416:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829607.572419:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829607.572423:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273257216:192.168.203.121@tcp:8:kworker.0
00010000:00010000:3.0:1787829608.403458:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787829608.595408:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829609.427485:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787829609.619478:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829610.451505:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787829610.643416:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829611.475507:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787829611.667460:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829612.499475:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787829612.691422:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:1.0:1787829612.691430:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829612.691438:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1787829612.691442:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829612.691452:0:27707:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4776
00000100:00080000:1.0:1787829612.691464:0:27707:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829612.691474:0:27707:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787829612.691510:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0780 x1874670273257344/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829612.691536:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829612.691540:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787829612.691542:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829612.691547:0:27707:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4776
00000100:00080000:1.0:1787829612.691551:0:27707:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829612.691557:0:27707:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829612.691567:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787829612.691570:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273257344:192.168.203.121@tcp:250:kworker.0
00000100:00100000:1.0:1787829612.691586:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0000 x1874670273257472/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829612.691599:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829612.691603:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787829612.691605:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829612.691609:0:27707:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4776
00000100:00080000:1.0:1787829612.691622:0:27707:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829612.691627:0:27707:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000800:00000100:0.0:1787829612.691632:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000008:00100000:1.0:1787829612.691637:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787829612.691653:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a2580 x1874670273257600/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829612.691664:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1787829612.691669:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829612/real 1787829612]  req@ffff9ee0056a0780 x1874670273257344/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829637 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829612.691670:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787829612.691674:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829612.691684:0:27707:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4776
00000100:00080000:1.0:1787829612.691690:0:27707:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1787829612.691691:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0780 x1874670273257344/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829637 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829612.691698:0:27707:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00080000:0.0:1787829612.691703:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000008:00100000:1.0:1787829612.691706:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:0.0:1787829612.691716:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829612.691722:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0b40 x1874670273257728/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787829612.691723:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273257344:192.168.203.121@tcp:250:kworker.0
00000100:00080000:1.0:1787829612.691738:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829612.691742:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787829612.691744:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1787829612.691748:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273257472:192.168.203.121@tcp:38:kworker.0
00000100:00080000:1.0:1787829612.691753:0:27707:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4776
00000100:00080000:1.0:1787829612.691761:0:27707:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829612.691766:0:27707:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829612.691772:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000800:00000100:0.0:1787829612.691773:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829612.691785:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829612/real 1787829612]  req@ffff9ee0056a0000 x1874670273257472/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829637 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829612.691791:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a30c0 x1874670273257856/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787829612.691799:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0000 x1874670273257472/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829637 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829612.691810:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829612.691811:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829612.691818:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00080000:1.0:1787829612.691818:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787829612.691823:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1787829612.691826:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273257472:192.168.203.121@tcp:38:kworker.0
00000100:00080000:1.0:1787829612.691831:0:27707:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4776
00000100:00080000:1.0:1787829612.691837:0:27707:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1787829612.691841:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273257600:192.168.203.121@tcp:8:kworker.0
00000100:00080000:1.0:1787829612.691845:0:27707:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829612.691853:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787829612.691865:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a3480 x1874670273257984/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1787829612.691876:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:1.0:1787829612.691876:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829612.691881:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787829612.691884:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1787829612.691890:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829612/real 1787829612]  req@ffff9ee0056a2580 x1874670273257600/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829637 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829612.691890:0:27707:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4776
00000100:00080000:1.0:1787829612.691893:0:27707:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829612.691900:0:27707:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829612.691906:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787829612.691908:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a2580 x1874670273257600/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829637 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829612.691916:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:1.0:1787829612.691920:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1e00 x1874670273258112/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829612.691921:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829612.691927:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273257600:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829612.691937:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273257728:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829612.691956:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829612.691963:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829612/real 1787829612]  req@ffff9ee0056a0b40 x1874670273257728/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829637 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829612.691976:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0b40 x1874670273257728/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829637 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829612.691981:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829612.691983:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829612.691985:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273257728:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829612.691999:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273257856:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787829612.692013:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829612.692019:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829612/real 1787829612]  req@ffff9ee0056a30c0 x1874670273257856/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829637 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829612.692043:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a30c0 x1874670273257856/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829637 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829612.692050:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829612.692053:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829612.692056:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273257856:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787829612.692061:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273257984:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829612.692078:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829612.692086:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829612/real 1787829612]  req@ffff9ee0056a3480 x1874670273257984/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829637 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829612.692095:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a3480 x1874670273257984/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829637 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829612.692104:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829612.692106:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829612.692108:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273257984:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829612.692112:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273258112:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829612.692125:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829612.692137:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829612/real 1787829612]  req@ffff9ee0056a1e00 x1874670273258112/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829637 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829612.692145:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1e00 x1874670273258112/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829637 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829612.692151:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829612.692154:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829612.692157:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273258112:192.168.203.121@tcp:8:kworker.0
00010000:00010000:3.0:1787829613.523499:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787829613.715439:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829614.547450:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787829614.739400:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829615.571465:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787829615.763405:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829616.595503:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787829616.787397:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829617.619519:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1787829617.811384:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829617.811394:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00100000:0.0:1787829617.811397:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787829617.811399:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829617.811412:0:27707:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4781
00000100:00080000:3.0:1787829617.811424:0:27707:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829617.811432:0:27707:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787829617.811463:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705680 x1874670273258240/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829617.811485:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829617.811489:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787829617.811492:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829617.811497:0:27707:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4781
00000100:00080000:3.0:1787829617.811502:0:27707:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829617.811507:0:27707:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787829617.811512:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273258240:192.168.203.121@tcp:250:kworker.0
00000008:00100000:3.0:1787829617.811520:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787829617.811538:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707840 x1874670273258368/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829617.811548:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829617.811551:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787829617.811552:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829617.811555:0:27707:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4781
00000100:00080000:3.0:1787829617.811558:0:27707:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829617.811561:0:27707:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829617.811565:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829617.811575:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706940 x1874670273258496/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1787829617.811578:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787829617.811587:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829617.811590:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787829617.811592:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829617.811596:0:27707:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4781
00000100:00080000:3.0:1787829617.811598:0:27707:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829617.811600:0:27707:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829617.811610:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787829617.811617:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829617/real 1787829617]  req@ffff9ee005705680 x1874670273258240/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829642 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829617.811624:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704000 x1874670273258624/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829617.811643:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829617.811650:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787829617.811653:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829617.811661:0:27707:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4781
00000100:00080000:3.0:1787829617.811664:0:27707:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829617.811667:0:27707:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829617.811671:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787829617.811672:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705680 x1874670273258240/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829642 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829617.811682:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707480 x1874670273258752/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829617.811684:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829617.811693:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:3.0:1787829617.811698:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1787829617.811700:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273258240:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787829617.811702:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787829617.811706:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829617.811711:0:27707:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4781
00000100:00080000:3.0:1787829617.811713:0:27707:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829617.811717:0:27707:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829617.811720:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787829617.811729:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273258368:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787829617.811730:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057070c0 x1874670273258880/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829617.811743:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829617.811746:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787829617.811747:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829617.811751:0:27707:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4781
00000100:00080000:3.0:1787829617.811754:0:27707:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829617.811757:0:27707:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829617.811760:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:0.0:1787829617.811767:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829617.811770:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057052c0 x1874670273259008/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787829617.811783:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829617/real 1787829617]  req@ffff9ee005707840 x1874670273258368/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829642 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829617.811794:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707840 x1874670273258368/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829642 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829617.811800:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829617.811803:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829617.811805:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273258368:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787829617.811810:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273258496:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829617.811825:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829617.811831:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829617/real 1787829617]  req@ffff9ee005706940 x1874670273258496/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829642 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829617.811839:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706940 x1874670273258496/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829642 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829617.811848:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829617.811850:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829617.811853:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273258496:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829617.811856:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273258624:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829617.811866:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829617.811871:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829617/real 1787829617]  req@ffff9ee005704000 x1874670273258624/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829642 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829617.811878:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704000 x1874670273258624/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829642 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829617.811883:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829617.811885:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829617.811887:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273258624:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829617.811891:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273258752:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787829617.811900:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829617.811905:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829617/real 1787829617]  req@ffff9ee005707480 x1874670273258752/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829642 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829617.811911:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707480 x1874670273258752/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829642 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829617.811917:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829617.811919:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829617.811921:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273258752:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787829617.811932:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273258880:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829617.811943:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829617.811949:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829617/real 1787829617]  req@ffff9ee0057070c0 x1874670273258880/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829642 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829617.811956:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057070c0 x1874670273258880/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829642 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829617.811960:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829617.811962:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829617.811964:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273258880:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829617.811967:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273259008:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829617.811988:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829617.812006:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829617/real 1787829617]  req@ffff9ee0057052c0 x1874670273259008/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829642 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829617.812016:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057052c0 x1874670273259008/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829642 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829617.812021:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829617.812024:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829617.812026:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273259008:192.168.203.121@tcp:8:kworker.0
00010000:00010000:3.0:1787829618.643454:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787829618.835412:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829619.667463:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787829619.859384:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829620.691518:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787829620.883458:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829621.715489:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787829621.907462:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829622.739485:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1787829622.931473:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1787829622.931479:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:2.0:1787829622.931484:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787829622.931490:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829622.931502:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4786
00000100:00080000:2.0:1787829622.931516:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829622.931524:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787829622.931569:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572ad00 x1874670273259136/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829622.931601:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829622.931604:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787829622.931606:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829622.931608:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4786
00000100:00080000:2.0:1787829622.931611:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829622.931613:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829622.931624:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787829622.931633:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b480 x1874670273259264/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829622.931642:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829622.931645:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787829622.931647:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829622.931654:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4786
00000100:00100000:0.0:1787829622.931657:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273259136:192.168.203.121@tcp:250:kworker.0
00000100:00080000:2.0:1787829622.931658:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829622.931668:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829622.931674:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787829622.931689:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b0c0 x1874670273259392/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829622.931696:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829622.931699:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787829622.931701:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829622.931704:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4786
00000100:00080000:2.0:1787829622.931707:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829622.931709:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829622.931713:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787829622.931738:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729a40 x1874670273259520/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829622.931745:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829622.931747:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787829622.931750:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829622.931753:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4786
00000100:00080000:2.0:1787829622.931756:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829622.931759:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829622.931764:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000800:00000100:0.0:1787829622.931766:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829622.931776:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b840 x1874670273259648/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829622.931783:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829622.931786:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787829622.931789:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829622.931794:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4786
00000100:00080000:2.0:1787829622.931796:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829622.931798:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829622.931802:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787829622.931813:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728f00 x1874670273259776/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787829622.931838:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829622/real 1787829622]  req@ffff9ee00572ad00 x1874670273259136/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829647 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829622.931844:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829622.931858:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787829622.931865:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829622.931872:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4786
00000100:00080000:2.0:1787829622.931876:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829622.931880:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829622.931885:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787829622.931908:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572ad00 x1874670273259136/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829647 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829622.931915:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728b40 x1874670273259904/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829622.931977:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829622.931986:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829622.931991:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273259136:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787829622.932032:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273259264:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787829622.932061:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829622.932075:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829622/real 1787829622]  req@ffff9ee00572b480 x1874670273259264/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829647 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829622.932101:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b480 x1874670273259264/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829647 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829622.932112:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829622.932123:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829622.932127:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273259264:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787829622.932135:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273259392:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829622.932157:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829622.932169:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829622/real 1787829622]  req@ffff9ee00572b0c0 x1874670273259392/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829647 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829622.932183:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b0c0 x1874670273259392/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829647 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829622.932200:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829622.932204:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829622.932211:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273259392:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829622.932218:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273259520:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829622.932237:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829622.932246:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829622/real 1787829622]  req@ffff9ee005729a40 x1874670273259520/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829647 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829622.932269:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729a40 x1874670273259520/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829647 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829622.932277:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829622.932281:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829622.932284:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273259520:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829622.932290:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273259648:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787829622.932305:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829622.932337:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829622/real 1787829622]  req@ffff9ee00572b840 x1874670273259648/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829647 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829622.932353:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b840 x1874670273259648/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829647 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829622.932358:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829622.932360:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829622.932363:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273259648:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787829622.932367:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273259776:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829622.932386:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829622.932407:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829622/real 1787829622]  req@ffff9ee005728f00 x1874670273259776/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829647 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829622.932419:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728f00 x1874670273259776/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829647 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829622.932428:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829622.932431:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829622.932434:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273259776:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829622.932439:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273259904:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829622.932454:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829622.932461:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829622/real 1787829622]  req@ffff9ee005728b40 x1874670273259904/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829647 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829622.932468:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728b40 x1874670273259904/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829647 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829622.932477:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829622.932479:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829622.932481:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273259904:192.168.203.121@tcp:8:kworker.0
00010000:00010000:3.0:1787829623.763461:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787829623.955385:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829624.787451:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787829624.979414:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829625.811464:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787829626.003384:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829626.835684:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829627.027439:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829627.859469:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829628.051373:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787829628.051415:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829628.051422:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787829628.051427:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829628.051436:0:27707:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4791
00000100:00080000:3.0:1787829628.051446:0:27707:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829628.051454:0:27707:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787829628.051488:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057061c0 x1874670273260032/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829628.051519:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829628.051523:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787829628.051526:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829628.051530:0:27707:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4791
00000100:00080000:3.0:1787829628.051534:0:27707:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829628.051538:0:27707:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829628.051547:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787829628.051561:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707c00 x1874670273260160/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787829628.051573:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273260032:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787829628.051574:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829628.051582:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787829628.051584:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829628.051588:0:27707:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4791
00000100:00080000:3.0:1787829628.051593:0:27707:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829628.051597:0:27707:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829628.051603:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829628.051616:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057052c0 x1874670273260288/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829628.051626:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829628.051629:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000800:00000100:0.0:1787829628.051632:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787829628.051633:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829628.051641:0:27707:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4791
00000100:00080000:3.0:1787829628.051645:0:27707:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829628.051649:0:27707:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829628.051654:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829628.051667:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057070c0 x1874670273260416/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829628.051677:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1787829628.051678:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829628/real 1787829628]  req@ffff9ee0057061c0 x1874670273260032/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829653 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829628.051684:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787829628.051688:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829628.051698:0:27707:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4791
00000100:00080000:3.0:1787829628.051703:0:27707:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1787829628.051708:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057061c0 x1874670273260032/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829653 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829628.051710:0:27707:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829628.051720:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00080000:0.0:1787829628.051732:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:3.0:1787829628.051732:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707480 x1874670273260544/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829628.051740:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829628.051747:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273260032:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787829628.051754:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829628.051759:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787829628.051761:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829628.051767:0:27707:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4791
00000100:00100000:0.0:1787829628.051771:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273260160:192.168.203.121@tcp:38:kworker.0
00000100:00080000:3.0:1787829628.051771:0:27707:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829628.051780:0:27707:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829628.051787:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:0.0:1787829628.051796:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829628.051803:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704000 x1874670273260672/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787829628.051809:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829628/real 1787829628]  req@ffff9ee005707c00 x1874670273260160/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829653 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829628.051832:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1787829628.051833:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707c00 x1874670273260160/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829653 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829628.051842:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787829628.051848:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829628.051849:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829628.051856:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829628.051860:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273260160:192.168.203.121@tcp:38:kworker.0
00000100:00080000:3.0:1787829628.051860:0:27707:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4791
00000100:00080000:3.0:1787829628.051869:0:27707:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1787829628.051870:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273260288:192.168.203.121@tcp:8:kworker.0
00000100:00080000:3.0:1787829628.051879:0:27707:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829628.051885:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:0.0:1787829628.051890:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829628.051902:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829628/real 1787829628]  req@ffff9ee0057052c0 x1874670273260288/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829653 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829628.051903:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706940 x1874670273260800/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787829628.051938:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057052c0 x1874670273260288/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829653 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829628.051950:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829628.051953:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829628.051956:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273260288:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829628.051961:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273260416:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829628.051977:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829628.051984:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829628/real 1787829628]  req@ffff9ee0057070c0 x1874670273260416/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829653 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829628.051991:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057070c0 x1874670273260416/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829653 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829628.051996:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829628.051998:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829628.052000:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273260416:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829628.052003:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273260544:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787829628.052014:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829628.052019:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829628/real 1787829628]  req@ffff9ee005707480 x1874670273260544/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829653 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829628.052026:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707480 x1874670273260544/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829653 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829628.052031:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829628.052033:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829628.052035:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273260544:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787829628.052045:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273260672:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829628.052055:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829628.052061:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829628/real 1787829628]  req@ffff9ee005704000 x1874670273260672/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829653 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829628.052067:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704000 x1874670273260672/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829653 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829628.052072:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829628.052074:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829628.052076:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273260672:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829628.052080:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273260800:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829628.052088:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829628.052094:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829628/real 1787829628]  req@ffff9ee005706940 x1874670273260800/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829653 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829628.052106:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706940 x1874670273260800/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829653 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829628.052110:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829628.052112:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829628.052114:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273260800:192.168.203.121@tcp:8:kworker.0
00010000:00010000:3.0:1787829628.883510:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829629.075420:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829629.907474:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829630.099406:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829630.931493:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829631.123442:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829631.955548:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829632.147469:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829632.979502:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829633.171392:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787829633.171400:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829633.171414:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787829633.171418:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829633.171427:0:27707:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4796
00000100:00080000:3.0:1787829633.171436:0:27707:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829633.171442:0:27707:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787829633.171493:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707840 x1874670273260928/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829633.171514:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829633.171517:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787829633.171519:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829633.171521:0:27707:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4796
00000100:00080000:3.0:1787829633.171523:0:27707:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829633.171526:0:27707:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829633.171548:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787829633.171559:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705680 x1874670273261056/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829633.171575:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829633.171578:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787829633.171579:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829633.171582:0:27707:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4796
00000100:00080000:3.0:1787829633.171585:0:27707:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829633.171588:0:27707:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829633.171593:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787829633.171627:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273260928:192.168.203.121@tcp:250:kworker.0
00000100:00100000:3.0:1787829633.171628:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704780 x1874670273261184/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829633.171654:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829633.171660:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787829633.171662:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829633.171669:0:27707:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4796
00000100:00080000:3.0:1787829633.171674:0:27707:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829633.171679:0:27707:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829633.171686:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829633.171702:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057043c0 x1874670273261312/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829633.171715:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829633.171719:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787829633.171722:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829633.171727:0:27707:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4796
00000100:00080000:3.0:1787829633.171732:0:27707:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829633.171736:0:27707:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829633.171743:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787829633.171758:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705a40 x1874670273261440/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1787829633.171773:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787829633.171775:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829633.171780:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787829633.171781:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829633.171801:0:27707:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4796
00000100:00080000:3.0:1787829633.171806:0:27707:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829633.171811:0:27707:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829633.171817:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829633.171829:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704b40 x1874670273261568/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829633.171839:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829633.171843:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787829633.171845:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829633.171850:0:27707:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4796
00000100:00080000:3.0:1787829633.171857:0:27707:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829633.171861:0:27707:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829633.171866:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787829633.171873:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829633/real 1787829633]  req@ffff9ee005707840 x1874670273260928/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829658 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829633.171881:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706580 x1874670273261696/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787829633.171991:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707840 x1874670273260928/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829658 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829633.172006:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829633.172010:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829633.172014:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273260928:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787829633.172023:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273261056:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787829633.172049:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829633.172061:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829633/real 1787829633]  req@ffff9ee005705680 x1874670273261056/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829658 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829633.172072:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705680 x1874670273261056/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829658 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829633.172090:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829633.172093:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829633.172096:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273261056:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787829633.172124:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273261184:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829633.172142:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829633.172160:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829633/real 1787829633]  req@ffff9ee005704780 x1874670273261184/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829658 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829633.172176:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704780 x1874670273261184/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829658 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829633.172187:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829633.172192:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829633.172196:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273261184:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829633.172205:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273261312:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829633.172233:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829633.172250:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829633/real 1787829633]  req@ffff9ee0057043c0 x1874670273261312/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829658 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829633.172267:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057043c0 x1874670273261312/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829658 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829633.172277:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829633.172280:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829633.172283:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273261312:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829633.172289:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273261440:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787829633.172310:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829633.172320:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829633/real 1787829633]  req@ffff9ee005705a40 x1874670273261440/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829658 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829633.172386:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705a40 x1874670273261440/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829658 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829633.172394:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829633.172398:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829633.172404:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273261440:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787829633.172455:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273261568:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829633.172487:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829633.172504:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829633/real 1787829633]  req@ffff9ee005704b40 x1874670273261568/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829658 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829633.172522:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704b40 x1874670273261568/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829658 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829633.172533:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829633.172538:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829633.172542:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273261568:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829633.172551:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273261696:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829633.172573:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829633.172584:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829633/real 1787829633]  req@ffff9ee005706580 x1874670273261696/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829658 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829633.172594:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706580 x1874670273261696/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829658 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829633.172602:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829633.172604:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829633.172607:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273261696:192.168.203.121@tcp:8:kworker.0
00010000:00010000:3.0:1787829634.003463:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829634.195426:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829635.027508:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829635.219425:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829636.051477:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829636.243369:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829637.075535:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829637.267442:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829638.099527:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1787829638.291382:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1787829638.291384:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787829638.291392:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787829638.291396:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829638.291404:0:27707:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4802
00000100:00080000:3.0:1787829638.291414:0:27707:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829638.291420:0:27707:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787829638.291451:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706d00 x1874670273261824/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829638.291473:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829638.291476:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787829638.291477:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829638.291480:0:27707:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4802
00000100:00080000:3.0:1787829638.291482:0:27707:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829638.291484:0:27707:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829638.291492:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787829638.291499:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705e00 x1874670273261952/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829638.291507:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829638.291509:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787829638.291510:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829638.291513:0:27707:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4802
00000100:00080000:3.0:1787829638.291515:0:27707:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829638.291517:0:27707:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829638.291520:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829638.291527:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706580 x1874670273262080/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829638.291534:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829638.291536:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787829638.291538:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829638.291540:0:27707:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4802
00000100:00080000:3.0:1787829638.291543:0:27707:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829638.291545:0:27707:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829638.291548:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829638.291553:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704b40 x1874670273262208/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829638.291561:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1787829638.291563:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273261824:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787829638.291563:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787829638.291566:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829638.291573:0:27707:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4802
00000100:00080000:3.0:1787829638.291576:0:27707:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829638.291578:0:27707:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829638.291580:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787829638.291587:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705a40 x1874670273262336/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829638.291594:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829638.291597:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787829638.291598:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829638.291600:0:27707:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4802
00000100:00080000:3.0:1787829638.291603:0:27707:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829638.291605:0:27707:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829638.291608:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829638.291614:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057043c0 x1874670273262464/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829638.291620:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829638.291622:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787829638.291624:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829638.291626:0:27707:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4802
00000100:00080000:3.0:1787829638.291628:0:27707:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829638.291630:0:27707:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829638.291633:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:0.0:1787829638.291639:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829638.291642:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704780 x1874670273262592/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787829638.291685:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829638/real 1787829638]  req@ffff9ee005706d00 x1874670273261824/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829663 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829638.291703:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706d00 x1874670273261824/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829663 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829638.291714:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829638.291719:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829638.291723:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273261824:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787829638.291731:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273261952:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787829638.291750:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829638.291760:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829638/real 1787829638]  req@ffff9ee005705e00 x1874670273261952/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829663 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829638.291772:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705e00 x1874670273261952/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829663 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829638.291778:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829638.291780:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829638.291782:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273261952:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787829638.291786:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273262080:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829638.291797:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829638.291802:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829638/real 1787829638]  req@ffff9ee005706580 x1874670273262080/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829663 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829638.291809:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706580 x1874670273262080/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829663 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829638.291814:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829638.291816:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829638.291817:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273262080:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829638.291835:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273262208:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829638.291844:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829638.291850:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829638/real 1787829638]  req@ffff9ee005704b40 x1874670273262208/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829663 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829638.291876:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704b40 x1874670273262208/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829663 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829638.291885:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829638.291887:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829638.291889:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273262208:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829638.291894:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273262336:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787829638.291906:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829638.291912:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829638/real 1787829638]  req@ffff9ee005705a40 x1874670273262336/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829663 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829638.291919:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705a40 x1874670273262336/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829663 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829638.291924:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829638.291926:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829638.291928:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273262336:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787829638.291931:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273262464:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829638.291941:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829638.291947:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829638/real 1787829638]  req@ffff9ee0057043c0 x1874670273262464/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829663 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829638.291954:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057043c0 x1874670273262464/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829663 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829638.291958:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829638.291960:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829638.291963:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273262464:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829638.291966:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273262592:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829638.291976:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829638.291981:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829638/real 1787829638]  req@ffff9ee005704780 x1874670273262592/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829663 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829638.291988:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704780 x1874670273262592/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829663 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829638.291993:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829638.291995:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829638.291996:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273262592:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787829639.123503:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829639.315423:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829640.147459:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829640.339389:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829641.171488:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829641.363443:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829642.195461:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829642.387370:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829643.219447:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829643.411410:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:2.0:1787829643.411426:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829643.411432:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787829643.411435:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829643.411444:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4807
00000100:00080000:2.0:1787829643.411453:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829643.411459:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787829643.411493:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729680 x1874670273262720/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829643.411521:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829643.411525:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787829643.411527:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829643.411532:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4807
00000100:00080000:2.0:1787829643.411536:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829643.411541:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829643.411550:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787829643.411561:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a1c0 x1874670273262848/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787829643.411569:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273262720:192.168.203.121@tcp:250:kworker.0
00000100:00080000:2.0:1787829643.411572:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829643.411576:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787829643.411578:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829643.411581:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4807
00000100:00080000:2.0:1787829643.411584:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829643.411587:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829643.411591:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787829643.411599:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728000 x1874670273262976/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829643.411606:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829643.411610:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787829643.411612:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829643.411616:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4807
00000100:00080000:2.0:1787829643.411619:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829643.411624:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829643.411629:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:0.0:1787829643.411637:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829643.411643:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057283c0 x1874670273263104/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829643.411654:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829643.411658:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787829643.411660:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829643.411663:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4807
00000100:00080000:2.0:1787829643.411666:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829643.411670:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829643.411674:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787829643.411681:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829643/real 1787829643]  req@ffff9ee005729680 x1874670273262720/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829668 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829643.411686:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572bc00 x1874670273263232/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829643.411715:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829643.411718:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787829643.411722:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1787829643.411723:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729680 x1874670273262720/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829668 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829643.411727:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4807
00000100:00080000:2.0:1787829643.411731:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829643.411737:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829643.411744:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:0.0:1787829643.411747:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:2.0:1787829643.411752:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a580 x1874670273263360/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829643.411757:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:2.0:1787829643.411763:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1787829643.411766:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273262720:192.168.203.121@tcp:250:kworker.0
00000100:00080000:2.0:1787829643.411768:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787829643.411771:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829643.411776:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4807
00000100:00080000:2.0:1787829643.411778:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829643.411780:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829643.411783:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787829643.411790:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728780 x1874670273263488/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787829643.411794:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273262848:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787829643.411837:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829643.411848:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829643/real 1787829643]  req@ffff9ee00572a1c0 x1874670273262848/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829668 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829643.411857:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a1c0 x1874670273262848/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829668 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829643.411863:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829643.411865:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829643.411868:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273262848:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787829643.411872:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273262976:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829643.411886:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829643.411893:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829643/real 1787829643]  req@ffff9ee005728000 x1874670273262976/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829668 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829643.411900:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728000 x1874670273262976/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829668 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829643.411906:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829643.411908:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829643.411910:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273262976:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829643.411914:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273263104:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829643.411923:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829643.411928:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829643/real 1787829643]  req@ffff9ee0057283c0 x1874670273263104/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829668 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829643.411940:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057283c0 x1874670273263104/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829668 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829643.411945:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829643.411947:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829643.411949:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273263104:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829643.411952:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273263232:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787829643.411962:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829643.411967:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829643/real 1787829643]  req@ffff9ee00572bc00 x1874670273263232/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829668 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829643.411974:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572bc00 x1874670273263232/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829668 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829643.411978:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829643.411980:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829643.411982:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273263232:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787829643.411985:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273263360:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829643.411994:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829643.411999:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829643/real 1787829643]  req@ffff9ee00572a580 x1874670273263360/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829668 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829643.412005:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a580 x1874670273263360/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829668 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829643.412014:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829643.412016:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829643.412018:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273263360:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829643.412032:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273263488:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829643.412042:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829643.412047:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829643/real 1787829643]  req@ffff9ee005728780 x1874670273263488/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829668 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829643.412054:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728780 x1874670273263488/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829668 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829643.412060:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829643.412062:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829643.412064:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273263488:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787829644.243452:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829644.435448:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829645.267536:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829645.459393:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829646.291465:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829646.483442:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829647.315457:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829647.507405:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829648.339433:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1787829648.531474:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1787829648.531481:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:1.0:1787829648.531488:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1787829648.531495:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829648.531508:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4812
00000100:00080000:1.0:1787829648.531520:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829648.531530:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787829648.531578:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a03c0 x1874670273263616/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829648.531615:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829648.531620:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787829648.531623:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829648.531628:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4812
00000100:00080000:1.0:1787829648.531633:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829648.531638:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787829648.531650:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273263616:192.168.203.121@tcp:250:kworker.0
00000008:00100000:1.0:1787829648.531650:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787829648.531676:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a2940 x1874670273263744/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829648.531689:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829648.531694:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787829648.531697:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829648.531704:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4812
00000100:00080000:1.0:1787829648.531712:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829648.531717:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829648.531723:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787829648.531734:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a21c0 x1874670273263872/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829648.531743:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829648.531746:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787829648.531748:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829648.531750:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4812
00000100:00080000:1.0:1787829648.531760:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829648.531763:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829648.531766:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787829648.531773:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1680 x1874670273264000/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829648.531779:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829648.531793:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787829648.531796:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829648.531801:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4812
00000100:00080000:1.0:1787829648.531804:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829648.531810:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829648.531817:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787829648.531834:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0f00 x1874670273264128/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787829648.531842:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273263744:192.168.203.121@tcp:38:kworker.0
00000100:00080000:1.0:1787829648.531851:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829648.531856:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787829648.531861:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829648.531868:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4812
00000100:00080000:1.0:1787829648.531871:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829648.531874:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829648.531881:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787829648.531893:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273263872:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787829648.531900:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a3c00 x1874670273264256/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829648.531914:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829648.531920:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787829648.531923:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1787829648.531925:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273264000:192.168.203.121@tcp:8:kworker.0
00000100:00080000:1.0:1787829648.531933:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4812
00000100:00080000:1.0:1787829648.531941:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829648.531948:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829648.531956:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787829648.531969:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273264128:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787829648.531975:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1a40 x1874670273264384/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787829648.532009:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273264256:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829648.532052:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273264384:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787829649.363498:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787829649.555532:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829650.387535:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787829650.579404:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829651.411525:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787829651.603412:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000400:00000100:2.0:1787829651.603553:0:2355:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.203.121:988
00000400:00000100:2.0:1787829651.603583:0:2355:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.203.121@tcp at host 192.168.203.121 was unreachable: the network or that node may be down, or Lustre may be misconfigured.
00000800:00000100:2.0:1787829651.603597:0:2355:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:2.0:1787829651.603632:0:2355:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:2.0:1787829651.603642:0:2355:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:2.0:1787829651.603651:0:2355:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:2.0:1787829651.603660:0:2355:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:2.0:1787829651.603670:0:2355:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:2.0:1787829651.603681:0:2355:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000100:00100000:0.0:1787829651.603696:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829648/real 1787829651]  req@ffff9ee0056a0f00 x1874670273264128/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829673 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829651.603723:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0f00 x1874670273264128/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829673 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829651.603736:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829651.603741:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829651.603744:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273264128:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787829651.603750:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829648/real 1787829651]  req@ffff9ee0056a3c00 x1874670273264256/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829673 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829651.603774:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a3c00 x1874670273264256/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829673 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829651.603784:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829651.603789:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829651.603793:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273264256:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829651.603799:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829648/real 1787829651]  req@ffff9ee0056a2940 x1874670273263744/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829673 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829651.603813:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a2940 x1874670273263744/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829673 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829651.603822:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829651.603826:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829651.603829:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273263744:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787829651.603836:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829648/real 1787829651]  req@ffff9ee0056a21c0 x1874670273263872/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829673 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829651.603849:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a21c0 x1874670273263872/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829673 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829651.603857:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829651.603860:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829651.603864:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273263872:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829651.603870:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829648/real 1787829651]  req@ffff9ee0056a1680 x1874670273264000/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829673 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829651.603882:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1680 x1874670273264000/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829673 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829651.603890:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829651.603893:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829651.603897:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273264000:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829651.603903:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829648/real 1787829651]  req@ffff9ee0056a03c0 x1874670273263616/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829673 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829651.603916:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a03c0 x1874670273263616/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829673 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829651.603925:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829651.603928:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829651.603932:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273263616:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787829651.603964:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829648/real 1787829651]  req@ffff9ee0056a1a40 x1874670273264384/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829673 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829651.603978:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1a40 x1874670273264384/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829673 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829651.603986:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829651.603989:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829651.603992:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273264384:192.168.203.121@tcp:8:kworker.0
00010000:00010000:0.0:1787829652.435539:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787829652.627419:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829653.459466:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787829653.651423:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:2.0:1787829653.651469:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829653.651475:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787829653.651479:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829653.651487:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4817
00000100:00080000:2.0:1787829653.651496:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829653.651502:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787829653.651530:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057292c0 x1874670273264512/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829653.651552:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829653.651555:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787829653.651557:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829653.651561:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4817
00000100:00080000:2.0:1787829653.651564:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829653.651569:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829653.651579:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787829653.651593:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a940 x1874670273264640/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829653.651606:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829653.651612:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00100000:0.0:1787829653.651614:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057292c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273264512:192.168.203.121@tcp:250:kworker.0
00000100:00080000:2.0:1787829653.651615:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829653.651624:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4817
00000100:00080000:2.0:1787829653.651629:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829653.651634:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829653.651640:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787829653.651654:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729e00 x1874670273264768/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829653.651665:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829653.651668:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787829653.651671:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829653.651675:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4817
00000100:00080000:2.0:1787829653.651680:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829653.651684:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000800:00000100:0.0:1787829653.651691:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000008:00100000:2.0:1787829653.651693:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787829653.651710:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728780 x1874670273264896/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829653.651720:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829653.651724:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787829653.651726:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829653.651730:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4817
00000100:00080000:2.0:1787829653.651734:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829653.651738:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829653.651744:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787829653.651765:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829653/real 1787829653]  req@ffff9ee0057292c0 x1874670273264512/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829678 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829653.651776:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a580 x1874670273265024/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787829653.651790:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057292c0 x1874670273264512/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829678 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829653.651790:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829653.651800:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787829653.651805:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829653.651814:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4817
00000100:00080000:0.0:1787829653.651815:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829653.651819:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829653.651824:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:2.0:1787829653.651829:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787829653.651833:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057292c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273264512:192.168.203.121@tcp:250:kworker.0
00000008:00100000:2.0:1787829653.651838:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787829653.651853:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572bc00 x1874670273265152/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829653.651863:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1787829653.651864:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273264640:192.168.203.121@tcp:38:kworker.0
00000100:00080000:2.0:1787829653.651869:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787829653.651874:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829653.651879:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4817
00000100:00080000:2.0:1787829653.651883:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829653.651888:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829653.651894:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:0.0:1787829653.651900:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829653.651909:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057283c0 x1874670273265280/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787829653.651919:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829653/real 1787829653]  req@ffff9ee00572a940 x1874670273264640/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829678 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829653.651934:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a940 x1874670273264640/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829678 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829653.651942:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829653.651947:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829653.651950:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273264640:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787829653.651957:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273264768:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829653.651978:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829653.651989:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829653/real 1787829653]  req@ffff9ee005729e00 x1874670273264768/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829678 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829653.652000:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729e00 x1874670273264768/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829678 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829653.652007:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829653.652011:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829653.652014:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273264768:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829653.652019:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273264896:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829653.652037:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829653.652046:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829653/real 1787829653]  req@ffff9ee005728780 x1874670273264896/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829678 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829653.652063:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728780 x1874670273264896/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829678 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829653.652077:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829653.652093:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829653.652096:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273264896:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829653.652102:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273265024:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787829653.652122:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829653.652134:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829653/real 1787829653]  req@ffff9ee00572a580 x1874670273265024/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829678 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829653.652147:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a580 x1874670273265024/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829678 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829653.652155:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829653.652158:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829653.652161:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273265024:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787829653.652181:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273265152:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829653.652210:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829653.652222:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829653/real 1787829653]  req@ffff9ee00572bc00 x1874670273265152/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829678 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829653.652235:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572bc00 x1874670273265152/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829678 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829653.652250:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829653.652253:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829653.652257:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273265152:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829653.652263:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273265280:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829653.652283:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829653.652295:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829653/real 1787829653]  req@ffff9ee0057283c0 x1874670273265280/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829678 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829653.652308:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057283c0 x1874670273265280/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829678 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829653.652349:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829653.652354:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829653.652359:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273265280:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787829654.483480:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787829654.675384:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829655.507490:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787829655.699397:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829656.531504:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787829656.723408:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829657.555496:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787829657.747381:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829658.579533:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787829658.771456:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:1.0:1787829658.771463:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829658.771473:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1787829658.771478:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829658.771493:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4822
00000100:00080000:1.0:1787829658.771506:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829658.771521:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787829658.771564:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a12c0 x1874670273265408/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829658.771596:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829658.771601:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787829658.771603:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829658.771608:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4822
00000100:00080000:1.0:1787829658.771613:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829658.771618:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829658.771629:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787829658.771645:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1a40 x1874670273265536/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787829658.771656:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273265408:192.168.203.121@tcp:250:kworker.0
00000100:00080000:1.0:1787829658.771659:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829658.771674:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787829658.771677:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829658.771681:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4822
00000100:00080000:1.0:1787829658.771684:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829658.771689:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829658.771694:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787829658.771703:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a03c0 x1874670273265664/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829658.771730:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829658.771734:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787829658.771736:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829658.771742:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4822
00000100:00080000:1.0:1787829658.771755:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829658.771760:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000800:00000100:0.0:1787829658.771768:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000008:00100000:1.0:1787829658.771768:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787829658.771787:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1680 x1874670273265792/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829658.771795:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829658.771798:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787829658.771800:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829658.771806:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4822
00000100:00080000:1.0:1787829658.771810:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829658.771817:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787829658.771819:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829658/real 1787829658]  req@ffff9ee0056a12c0 x1874670273265408/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829683 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:1.0:1787829658.771823:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787829658.771845:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a21c0 x1874670273265920/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787829658.771848:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a12c0 x1874670273265408/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829683 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829658.771913:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829658.771917:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829658.771920:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:1.0:1787829658.771930:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00100000:0.0:1787829658.771931:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273265408:192.168.203.121@tcp:250:kworker.0
00000100:00080000:1.0:1787829658.771938:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829658.771947:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4822
00000100:00080000:1.0:1787829658.771953:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1787829658.771960:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273265536:192.168.203.121@tcp:38:kworker.0
00000100:00080000:1.0:1787829658.771961:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829658.771977:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:0.0:1787829658.771991:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829658.771999:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a2940 x1874670273266048/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787829658.772004:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829658/real 1787829658]  req@ffff9ee0056a1a40 x1874670273265536/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829683 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829658.772046:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1787829658.772053:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1a40 x1874670273265536/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829683 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829658.772054:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787829658.772059:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829658.772068:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4822
00000100:00080000:1.0:1787829658.772076:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829658.772081:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00080000:0.0:1787829658.772085:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000008:00100000:1.0:1787829658.772087:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:0.0:1787829658.772097:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829658.772111:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273265536:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787829658.772111:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a3c00 x1874670273266176/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787829658.772131:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273265664:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829658.772163:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829658.772177:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829658/real 1787829658]  req@ffff9ee0056a03c0 x1874670273265664/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829683 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829658.772186:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a03c0 x1874670273265664/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829683 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829658.772192:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829658.772194:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829658.772196:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273265664:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829658.772200:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273265792:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829658.772212:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829658.772221:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829658/real 1787829658]  req@ffff9ee0056a1680 x1874670273265792/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829683 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829658.772232:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1680 x1874670273265792/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829683 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829658.772240:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829658.772244:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829658.772248:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273265792:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829658.772255:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273265920:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787829658.772275:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829658.772283:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829658/real 1787829658]  req@ffff9ee0056a21c0 x1874670273265920/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829683 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829658.772290:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a21c0 x1874670273265920/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829683 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829658.772296:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829658.772298:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829658.772300:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273265920:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787829658.772351:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273266048:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829658.772402:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829658.772417:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829658/real 1787829658]  req@ffff9ee0056a2940 x1874670273266048/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829683 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829658.772432:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a2940 x1874670273266048/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829683 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829658.772441:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829658.772445:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829658.772448:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273266048:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829658.772454:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273266176:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829658.772474:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829658.772486:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829658/real 1787829658]  req@ffff9ee0056a3c00 x1874670273266176/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829683 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829658.772499:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a3c00 x1874670273266176/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829683 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829658.772508:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829658.772511:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829658.772513:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273266176:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787829659.603531:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787829659.795415:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829660.627540:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787829660.819396:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829661.651502:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787829661.843419:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829662.675528:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787829662.867377:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829663.699464:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787829663.891424:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:2.0:1787829663.891429:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829663.891435:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787829663.891439:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829663.891446:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4827
00000100:00080000:2.0:1787829663.891456:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829663.891463:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787829663.891491:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728000 x1874670273266304/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829663.891512:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829663.891515:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787829663.891516:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829663.891519:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4827
00000100:00080000:2.0:1787829663.891521:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829663.891523:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829663.891530:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787829663.891549:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a1c0 x1874670273266432/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829663.891557:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829663.891559:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787829663.891560:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829663.891566:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4827
00000100:00100000:0.0:1787829663.891568:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273266304:192.168.203.121@tcp:250:kworker.0
00000100:00080000:2.0:1787829663.891568:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829663.891574:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829663.891579:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787829663.891588:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729680 x1874670273266560/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829663.891595:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829663.891598:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787829663.891599:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829663.891601:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4827
00000100:00080000:2.0:1787829663.891603:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829663.891607:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829663.891610:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787829663.891627:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728b40 x1874670273266688/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829663.891633:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829663.891636:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787829663.891637:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:0.0:1787829663.891641:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:2.0:1787829663.891644:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4827
00000100:00080000:2.0:1787829663.891648:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829663.891651:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829663.891654:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787829663.891663:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728f00 x1874670273266816/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829663.891669:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829663.891672:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787829663.891673:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829663.891691:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4827
00000100:00100000:0.0:1787829663.891696:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829663/real 1787829663]  req@ffff9ee005728000 x1874670273266304/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829688 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829663.891696:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829663.891704:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829663.891708:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787829663.891718:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b840 x1874670273266944/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829663.891729:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829663.891734:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787829663.891735:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829663.891738:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4827
00000100:00080000:2.0:1787829663.891741:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829663.891747:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787829663.891749:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728000 x1874670273266304/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829688 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:2.0:1787829663.891750:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787829663.891760:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729a40 x1874670273267072/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829663.891771:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829663.891780:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829663.891784:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273266304:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787829663.891791:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273266432:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787829663.891812:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829663.891822:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829663/real 1787829663]  req@ffff9ee00572a1c0 x1874670273266432/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829688 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829663.891831:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a1c0 x1874670273266432/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829688 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829663.891837:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829663.891839:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829663.891841:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273266432:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787829663.891860:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273266560:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829663.891872:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829663.891879:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829663/real 1787829663]  req@ffff9ee005729680 x1874670273266560/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829688 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829663.891887:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729680 x1874670273266560/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829688 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829663.891892:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829663.891894:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829663.891896:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273266560:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829663.891900:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273266688:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829663.891909:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829663.891915:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829663/real 1787829663]  req@ffff9ee005728b40 x1874670273266688/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829688 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829663.891922:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728b40 x1874670273266688/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829688 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829663.891927:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829663.891929:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829663.891931:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273266688:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829663.891934:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273266816:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787829663.891947:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829663.891957:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829663/real 1787829663]  req@ffff9ee005728f00 x1874670273266816/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829688 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829663.891968:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728f00 x1874670273266816/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829688 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829663.891977:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829663.891980:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829663.891984:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273266816:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787829663.891990:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273266944:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829663.892009:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829663.892018:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829663/real 1787829663]  req@ffff9ee00572b840 x1874670273266944/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829688 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829663.892026:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b840 x1874670273266944/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829688 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829663.892039:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829663.892041:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829663.892043:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273266944:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829663.892047:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273267072:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829663.892059:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829663.892065:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829663/real 1787829663]  req@ffff9ee005729a40 x1874670273267072/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829688 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829663.892072:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729a40 x1874670273267072/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829688 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829663.892077:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829663.892079:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829663.892081:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273267072:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787829664.723476:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787829664.915405:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829665.747523:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787829665.939416:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829666.771454:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787829666.963373:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829667.795564:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787829667.987454:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829668.819486:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787829669.011434:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:1.0:1787829669.011439:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829669.011447:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1787829669.011453:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829669.011464:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4832
00000100:00080000:1.0:1787829669.011477:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829669.011484:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787829669.011525:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0f00 x1874670273267200/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829669.011550:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829669.011555:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787829669.011557:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829669.011560:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4832
00000100:00080000:1.0:1787829669.011563:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829669.011565:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829669.011574:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787829669.011583:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1e00 x1874670273267328/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829669.011591:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829669.011594:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787829669.011596:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829669.011599:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4832
00000100:00080000:1.0:1787829669.011601:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829669.011603:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829669.011607:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787829669.011613:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a3480 x1874670273267456/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829669.011623:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829669.011629:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787829669.011632:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1787829669.011634:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273267200:192.168.203.121@tcp:250:kworker.0
00000100:00080000:1.0:1787829669.011652:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4832
00000100:00080000:1.0:1787829669.011659:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829669.011665:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829669.011674:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787829669.011704:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a30c0 x1874670273267584/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829669.011718:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829669.011722:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787829669.011724:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829669.011730:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4832
00000100:00080000:1.0:1787829669.011734:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829669.011744:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000800:00000100:0.0:1787829669.011746:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000008:00100000:1.0:1787829669.011756:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787829669.011779:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0b40 x1874670273267712/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829669.011791:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829669.011796:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787829669.011798:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829669.011803:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4832
00000100:00080000:1.0:1787829669.011809:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1787829669.011810:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829669/real 1787829669]  req@ffff9ee0056a0f00 x1874670273267200/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829694 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829669.011824:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829669.011836:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787829669.011839:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0f00 x1874670273267200/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829694 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829669.011854:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:1.0:1787829669.011861:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a2580 x1874670273267840/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829669.011863:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829669.011871:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273267200:192.168.203.121@tcp:250:kworker.0
00000100:00080000:1.0:1787829669.011908:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1787829669.011909:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273267328:192.168.203.121@tcp:38:kworker.0
00000100:00080000:1.0:1787829669.011922:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787829669.011927:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829669.011934:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4832
00000100:00080000:1.0:1787829669.011940:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000800:00000100:0.0:1787829669.011941:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:1.0:1787829669.011952:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787829669.011957:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829669/real 1787829669]  req@ffff9ee0056a1e00 x1874670273267328/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829694 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:1.0:1787829669.011961:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787829669.011973:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1e00 x1874670273267328/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829694 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829669.011980:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829669.011990:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829669.011992:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0000 x1874670273267968/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787829669.011995:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273267328:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787829669.012032:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273267456:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829669.012049:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829669.012055:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829669/real 1787829669]  req@ffff9ee0056a3480 x1874670273267456/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829694 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829669.012063:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a3480 x1874670273267456/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829694 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829669.012068:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829669.012069:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829669.012071:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273267456:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829669.012075:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273267584:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829669.012085:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829669.012090:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829669/real 1787829669]  req@ffff9ee0056a30c0 x1874670273267584/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829694 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829669.012097:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a30c0 x1874670273267584/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829694 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829669.012102:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829669.012104:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829669.012106:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273267584:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829669.012109:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273267712:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787829669.012119:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829669.012124:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829669/real 1787829669]  req@ffff9ee0056a0b40 x1874670273267712/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829694 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829669.012131:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0b40 x1874670273267712/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829694 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829669.012135:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829669.012137:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829669.012139:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273267712:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787829669.012143:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273267840:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829669.012152:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829669.012157:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829669/real 1787829669]  req@ffff9ee0056a2580 x1874670273267840/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829694 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829669.012165:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a2580 x1874670273267840/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829694 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829669.012169:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829669.012171:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829669.012173:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273267840:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829669.012176:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273267968:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829669.012186:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829669.012191:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829669/real 1787829669]  req@ffff9ee0056a0000 x1874670273267968/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829694 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829669.012197:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0000 x1874670273267968/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829694 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829669.012202:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829669.012204:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829669.012206:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273267968:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787829669.843542:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787829670.035427:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829670.867490:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787829671.059456:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829671.891540:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787829672.083413:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829672.915469:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787829673.107463:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829673.939564:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787829674.131418:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:1.0:1787829674.131442:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829674.131451:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1787829674.131456:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829674.131470:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4837
00000100:00080000:1.0:1787829674.131484:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829674.131494:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787829674.131548:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0780 x1874670273268096/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829674.131575:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829674.131579:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787829674.131580:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829674.131584:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4837
00000100:00080000:1.0:1787829674.131587:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829674.131590:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829674.131601:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787829674.131630:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273268096:192.168.203.121@tcp:250:kworker.0
00000100:00100000:1.0:1787829674.131631:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0000 x1874670273268224/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829674.131656:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829674.131660:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787829674.131662:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829674.131665:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4837
00000100:00080000:1.0:1787829674.131669:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829674.131673:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829674.131678:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787829674.131689:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a2580 x1874670273268352/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829674.131696:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829674.131698:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787829674.131699:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829674.131702:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4837
00000100:00080000:1.0:1787829674.131704:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829674.131706:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829674.131709:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:0.0:1787829674.131713:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829674.131721:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0b40 x1874670273268480/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829674.131728:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829674.131731:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787829674.131732:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829674.131735:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4837
00000100:00080000:1.0:1787829674.131740:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829674.131743:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829674.131746:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787829674.131753:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a30c0 x1874670273268608/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829674.131761:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829674.131764:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00100000:0.0:1787829674.131767:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829674/real 1787829674]  req@ffff9ee0056a0780 x1874670273268096/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829699 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829674.131768:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829674.131777:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4837
00000100:00080000:1.0:1787829674.131782:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829674.131787:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829674.131791:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787829674.131795:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0780 x1874670273268096/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829699 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829674.131802:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a3480 x1874670273268736/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829674.131810:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829674.131817:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787829674.131819:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829674.131822:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829674.131822:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4837
00000100:00080000:1.0:1787829674.131828:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829674.131833:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:1.0:1787829674.131834:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829674.131839:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787829674.131844:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273268096:192.168.203.121@tcp:250:kworker.0
00000100:00100000:1.0:1787829674.131849:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1e00 x1874670273268864/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787829674.131880:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273268224:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787829674.131910:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829674.131924:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829674/real 1787829674]  req@ffff9ee0056a0000 x1874670273268224/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829699 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829674.131934:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0000 x1874670273268224/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829699 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829674.131940:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829674.131943:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829674.131945:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273268224:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787829674.131950:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273268352:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829674.131965:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829674.131972:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829674/real 1787829674]  req@ffff9ee0056a2580 x1874670273268352/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829699 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829674.131979:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a2580 x1874670273268352/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829699 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829674.131985:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829674.131986:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829674.131988:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273268352:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829674.131993:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273268480:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829674.132004:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829674.132010:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829674/real 1787829674]  req@ffff9ee0056a0b40 x1874670273268480/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829699 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829674.132017:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0b40 x1874670273268480/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829699 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829674.132022:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829674.132024:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829674.132026:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273268480:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829674.132029:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273268608:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787829674.132039:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829674.132045:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829674/real 1787829674]  req@ffff9ee0056a30c0 x1874670273268608/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829699 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829674.132057:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a30c0 x1874670273268608/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829699 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829674.132065:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829674.132068:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829674.132072:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273268608:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787829674.132079:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273268736:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829674.132100:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829674.132109:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829674/real 1787829674]  req@ffff9ee0056a3480 x1874670273268736/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829699 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829674.132122:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a3480 x1874670273268736/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829699 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829674.132131:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829674.132134:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829674.132138:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273268736:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829674.132144:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273268864:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829674.132165:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829674.132175:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829674/real 1787829674]  req@ffff9ee0056a1e00 x1874670273268864/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829699 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829674.132183:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1e00 x1874670273268864/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829699 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829674.132189:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829674.132191:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829674.132193:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273268864:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787829674.963525:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787829675.155419:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829675.987514:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787829676.179456:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829677.011446:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787829677.203393:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829678.035494:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787829678.227450:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829679.059453:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1787829679.251385:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829679.251394:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00100000:3.0:1787829679.251397:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:2.0:1787829679.251398:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829679.251409:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4842
00000100:00080000:2.0:1787829679.251419:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829679.251425:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787829679.251457:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b0c0 x1874670273268992/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829679.251479:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829679.251482:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787829679.251487:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829679.251490:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4842
00000100:00080000:2.0:1787829679.251493:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829679.251495:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829679.251503:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787829679.251511:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b480 x1874670273269120/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829679.251519:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829679.251523:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787829679.251524:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829679.251529:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4842
00000100:00100000:0.0:1787829679.251530:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273268992:192.168.203.121@tcp:250:kworker.0
00000100:00080000:2.0:1787829679.251531:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829679.251538:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829679.251542:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787829679.251551:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572ad00 x1874670273269248/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829679.251558:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829679.251561:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787829679.251562:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829679.251565:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4842
00000100:00080000:2.0:1787829679.251582:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829679.251586:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829679.251590:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787829679.251601:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729a40 x1874670273269376/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1787829679.251606:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:2.0:1787829679.251614:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829679.251617:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787829679.251618:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829679.251623:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4842
00000100:00080000:2.0:1787829679.251626:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829679.251629:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829679.251632:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787829679.251640:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b840 x1874670273269504/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829679.251647:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1787829679.251649:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829679/real 1787829679]  req@ffff9ee00572b0c0 x1874670273268992/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829704 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829679.251650:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787829679.251654:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829679.251661:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4842
00000100:00080000:2.0:1787829679.251666:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829679.251669:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829679.251673:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787829679.251680:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b0c0 x1874670273268992/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829704 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829679.251682:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728f00 x1874670273269632/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829679.251694:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829679.251702:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787829679.251706:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829679.251712:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4842
00000100:00080000:2.0:1787829679.251715:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829679.251717:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829679.251718:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829679.251727:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:0.0:1787829679.251730:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829679.251735:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728b40 x1874670273269760/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787829679.251740:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273268992:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787829679.251756:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273269120:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787829679.251784:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829679.251797:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829679/real 1787829679]  req@ffff9ee00572b480 x1874670273269120/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829704 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829679.251811:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b480 x1874670273269120/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829704 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829679.251819:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829679.251832:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829679.251836:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273269120:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787829679.251862:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273269248:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829679.251887:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829679.251899:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829679/real 1787829679]  req@ffff9ee00572ad00 x1874670273269248/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829704 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829679.251911:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572ad00 x1874670273269248/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829704 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829679.251920:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829679.251924:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829679.251927:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273269248:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829679.251934:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273269376:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829679.251956:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829679.251968:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829679/real 1787829679]  req@ffff9ee005729a40 x1874670273269376/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829704 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829679.251984:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729a40 x1874670273269376/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829704 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829679.251990:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829679.251992:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829679.251994:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273269376:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829679.251998:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273269504:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787829679.252012:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829679.252019:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829679/real 1787829679]  req@ffff9ee00572b840 x1874670273269504/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829704 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829679.252026:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b840 x1874670273269504/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829704 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829679.252032:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829679.252034:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829679.252035:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273269504:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787829679.252039:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273269632:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829679.252066:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829679.252078:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829679/real 1787829679]  req@ffff9ee005728f00 x1874670273269632/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829704 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829679.252092:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728f00 x1874670273269632/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829704 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829679.252101:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829679.252104:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829679.252108:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273269632:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829679.252114:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273269760:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829679.252133:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829679.252145:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829679/real 1787829679]  req@ffff9ee005728b40 x1874670273269760/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829704 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829679.252157:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728b40 x1874670273269760/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829704 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829679.252166:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829679.252169:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829679.252172:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273269760:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787829680.083527:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787829680.275389:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829681.107478:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787829681.299370:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829682.131476:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787829682.323383:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829683.155461:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787829683.347370:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829684.179489:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787829684.371359:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:1.0:1787829684.371395:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829684.371401:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1787829684.371405:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829684.371413:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4848
00000100:00080000:1.0:1787829684.371423:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829684.371430:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787829684.371481:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0f00 x1874670273269888/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829684.371513:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829684.371518:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787829684.371520:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829684.371525:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4848
00000100:00080000:1.0:1787829684.371529:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829684.371545:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829684.371555:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787829684.371557:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273269888:192.168.203.121@tcp:250:kworker.0
00000100:00100000:1.0:1787829684.371592:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a3c00 x1874670273270016/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829684.371607:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829684.371611:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787829684.371614:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829684.371618:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4848
00000100:00080000:1.0:1787829684.371627:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829684.371630:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000800:00000100:2.0:1787829684.371636:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000008:00100000:1.0:1787829684.371638:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787829684.371651:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a2940 x1874670273270144/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829684.371659:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829684.371661:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787829684.371663:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829684.371665:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4848
00000100:00080000:1.0:1787829684.371669:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829684.371671:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829684.371675:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787829684.371683:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a21c0 x1874670273270272/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829684.371690:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829684.371693:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787829684.371695:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829684.371698:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4848
00000100:00080000:1.0:1787829684.371700:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829684.371703:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829684.371706:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787829684.371712:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1680 x1874670273270400/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829684.371718:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829684.371720:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787829684.371721:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829684.371724:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4848
00000100:00080000:1.0:1787829684.371726:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829684.371728:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829684.371730:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787829684.371736:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a03c0 x1874670273270528/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829684.371742:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829684.371744:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787829684.371746:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829684.371749:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4848
00000100:00080000:1.0:1787829684.371752:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1787829684.371753:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829684/real 1787829684]  req@ffff9ee0056a0f00 x1874670273269888/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829709 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829684.371757:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829684.371763:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787829684.371775:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1a40 x1874670273270656/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787829684.371782:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0f00 x1874670273269888/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829709 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829684.371792:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829684.371796:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829684.371799:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273269888:192.168.203.121@tcp:250:kworker.0
00000100:00100000:3.0:1787829684.371818:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273270016:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787829684.371860:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829684.371873:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829684/real 1787829684]  req@ffff9ee0056a3c00 x1874670273270016/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829709 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829684.371888:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a3c00 x1874670273270016/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829709 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829684.371895:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829684.371897:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829684.371900:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273270016:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787829684.371904:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273270144:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829684.372051:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829684.372070:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829684/real 1787829684]  req@ffff9ee0056a2940 x1874670273270144/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829709 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829684.372150:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a2940 x1874670273270144/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829709 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829684.372160:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829684.372165:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829684.372169:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273270144:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829684.372178:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273270272:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829684.372205:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829684.372217:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829684/real 1787829684]  req@ffff9ee0056a21c0 x1874670273270272/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829709 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829684.372226:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a21c0 x1874670273270272/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829709 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829684.372236:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829684.372238:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829684.372240:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273270272:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829684.372245:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273270400:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787829684.372258:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829684.372264:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829684/real 1787829684]  req@ffff9ee0056a1680 x1874670273270400/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829709 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829684.372271:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1680 x1874670273270400/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829709 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829684.372276:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829684.372278:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829684.372280:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273270400:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787829684.372284:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273270528:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829684.372293:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829684.372298:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829684/real 1787829684]  req@ffff9ee0056a03c0 x1874670273270528/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829709 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829684.372305:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a03c0 x1874670273270528/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829709 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829684.372310:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829684.372312:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829684.372337:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273270528:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829684.372345:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273270656:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829684.372366:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829684.372377:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829684/real 1787829684]  req@ffff9ee0056a1a40 x1874670273270656/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829709 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829684.372389:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1a40 x1874670273270656/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829709 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829684.372398:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829684.372401:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829684.372404:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273270656:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787829685.203425:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787829685.395375:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829686.227458:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787829686.419358:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829687.251527:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787829687.443428:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829688.275582:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787829688.467424:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829689.299582:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1787829689.491470:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1787829689.491472:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:1.0:1787829689.491482:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1787829689.491489:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829689.491520:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4853
00000100:00080000:1.0:1787829689.491533:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829689.491542:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787829689.491599:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a12c0 x1874670273270784/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829689.491629:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829689.491632:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787829689.491634:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829689.491637:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4853
00000100:00080000:1.0:1787829689.491639:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829689.491642:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829689.491652:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787829689.491665:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273270784:192.168.203.121@tcp:250:kworker.0
00000100:00100000:1.0:1787829689.491666:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1a40 x1874670273270912/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829689.491680:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829689.491682:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787829689.491683:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829689.491686:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4853
00000100:00080000:1.0:1787829689.491687:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829689.491691:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829689.491694:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787829689.491702:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a03c0 x1874670273271040/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829689.491708:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829689.491711:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787829689.491712:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829689.491715:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4853
00000100:00080000:1.0:1787829689.491718:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829689.491720:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829689.491724:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787829689.491731:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1680 x1874670273271168/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829689.491752:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829689.491755:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787829689.491757:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829689.491760:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4853
00000100:00080000:1.0:1787829689.491764:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829689.491766:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829689.491769:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787829689.491778:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a21c0 x1874670273271296/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1787829689.491786:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:1.0:1787829689.491788:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829689.491793:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787829689.491795:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829689.491799:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4853
00000100:00080000:1.0:1787829689.491803:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829689.491806:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829689.491809:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787829689.491816:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a2940 x1874670273271424/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829689.491826:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829689.491829:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787829689.491830:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829689.491833:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4853
00000100:00080000:1.0:1787829689.491836:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829689.491839:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829689.491843:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829689.491849:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829689/real 1787829689]  req@ffff9ee0056a12c0 x1874670273270784/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829714 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829689.491854:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a3c00 x1874670273271552/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787829689.491896:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a12c0 x1874670273270784/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829714 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829689.491908:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829689.491913:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829689.491917:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273270784:192.168.203.121@tcp:250:kworker.0
00000100:00100000:3.0:1787829689.491950:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273270912:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787829689.491972:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829689.491983:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829689/real 1787829689]  req@ffff9ee0056a1a40 x1874670273270912/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829714 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829689.491993:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1a40 x1874670273270912/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829714 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829689.492000:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829689.492002:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829689.492005:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273270912:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787829689.492015:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273271040:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829689.492031:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829689.492038:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829689/real 1787829689]  req@ffff9ee0056a03c0 x1874670273271040/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829714 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829689.492058:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a03c0 x1874670273271040/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829714 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829689.492064:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829689.492065:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829689.492068:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273271040:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829689.492072:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273271168:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829689.492084:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829689.492090:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829689/real 1787829689]  req@ffff9ee0056a1680 x1874670273271168/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829714 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829689.492099:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1680 x1874670273271168/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829714 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829689.492104:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829689.492106:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829689.492108:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273271168:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829689.492112:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273271296:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787829689.492133:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829689.492146:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829689/real 1787829689]  req@ffff9ee0056a21c0 x1874670273271296/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829714 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829689.492154:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a21c0 x1874670273271296/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829714 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829689.492160:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829689.492163:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829689.492165:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273271296:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787829689.492168:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273271424:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829689.492180:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829689.492186:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829689/real 1787829689]  req@ffff9ee0056a2940 x1874670273271424/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829714 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829689.492205:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a2940 x1874670273271424/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829714 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829689.492211:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829689.492213:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829689.492215:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273271424:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829689.492219:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273271552:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829689.492230:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829689.492237:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829689/real 1787829689]  req@ffff9ee0056a3c00 x1874670273271552/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829714 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829689.492245:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a3c00 x1874670273271552/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829714 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829689.492250:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829689.492252:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829689.492254:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273271552:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787829690.323578:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787829690.515397:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829691.347466:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787829691.539394:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829692.371546:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787829692.563404:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829693.395523:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787829693.587419:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829694.419507:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787829694.611403:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:1.0:1787829694.611404:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829694.611414:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1787829694.611418:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829694.611428:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4858
00000100:00080000:1.0:1787829694.611439:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829694.611447:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787829694.611497:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0f00 x1874670273271680/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829694.611534:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829694.611538:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787829694.611540:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829694.611545:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4858
00000100:00080000:1.0:1787829694.611550:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829694.611555:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787829694.611563:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273271680:192.168.203.121@tcp:250:kworker.0
00000008:00100000:1.0:1787829694.611572:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787829694.611590:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1e00 x1874670273271808/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829694.611603:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829694.611606:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787829694.611608:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829694.611613:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4858
00000100:00080000:1.0:1787829694.611617:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829694.611622:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829694.611628:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:3.0:1787829694.611630:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829694.611644:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a3480 x1874670273271936/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829694.611656:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829694.611660:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787829694.611662:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829694.611666:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4858
00000100:00080000:1.0:1787829694.611670:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829694.611675:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829694.611681:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829694.611681:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829694/real 1787829694]  req@ffff9ee0056a0f00 x1874670273271680/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829719 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829694.611701:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a30c0 x1874670273272064/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787829694.611704:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0f00 x1874670273271680/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829719 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829694.611730:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829694.611730:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829694.611737:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:1.0:1787829694.611738:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00100000:3.0:1787829694.611742:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273271680:192.168.203.121@tcp:250:kworker.0
00000100:00080000:1.0:1787829694.611744:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829694.611752:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4858
00000100:00080000:1.0:1787829694.611756:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829694.611761:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787829694.611765:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273271808:192.168.203.121@tcp:38:kworker.0
00000008:00100000:1.0:1787829694.611768:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787829694.611785:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0b40 x1874670273272192/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1787829694.611792:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829694.611804:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829694/real 1787829694]  req@ffff9ee0056a1e00 x1874670273271808/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829719 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829694.611813:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1787829694.611817:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1e00 x1874670273271808/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829719 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829694.611819:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787829694.611824:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829694.611827:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829694.611831:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4858
00000100:00080000:3.0:1787829694.611832:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829694.611839:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273271808:192.168.203.121@tcp:38:kworker.0
00000100:00080000:1.0:1787829694.611840:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1787829694.611845:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273271936:192.168.203.121@tcp:8:kworker.0
00000100:00080000:1.0:1787829694.611849:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829694.611857:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:3.0:1787829694.611864:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829694.611873:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a2580 x1874670273272320/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787829694.611875:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829694/real 1787829694]  req@ffff9ee0056a3480 x1874670273271936/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829719 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829694.611908:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829694.611914:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:3.0:1787829694.611915:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a3480 x1874670273271936/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829719 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829694.611917:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829694.611928:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4858
00000100:00080000:3.0:1787829694.611928:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829694.611935:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00080000:1.0:1787829694.611936:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1787829694.611939:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273271936:192.168.203.121@tcp:8:kworker.0
00000100:00080000:1.0:1787829694.611944:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787829694.611948:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273272064:192.168.203.121@tcp:8:kworker.0
00000008:00100000:1.0:1787829694.611953:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:3.0:1787829694.611963:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829694.611972:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0000 x1874670273272448/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787829694.611974:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829694/real 1787829694]  req@ffff9ee0056a30c0 x1874670273272064/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829719 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829694.612010:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a30c0 x1874670273272064/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829719 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829694.612020:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829694.612025:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829694.612029:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273272064:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829694.612045:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273272192:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787829694.612061:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829694.612068:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829694/real 1787829694]  req@ffff9ee0056a0b40 x1874670273272192/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829719 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829694.612076:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0b40 x1874670273272192/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829719 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829694.612086:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829694.612088:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829694.612090:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273272192:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787829694.612093:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273272320:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829694.612103:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829694.612109:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829694/real 1787829694]  req@ffff9ee0056a2580 x1874670273272320/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829719 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829694.612116:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a2580 x1874670273272320/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829719 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829694.612121:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829694.612122:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829694.612124:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273272320:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829694.612127:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273272448:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829694.612136:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829694.612142:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829694/real 1787829694]  req@ffff9ee0056a0000 x1874670273272448/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829719 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829694.612149:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0000 x1874670273272448/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829719 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829694.612153:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829694.612155:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829694.612158:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273272448:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787829695.443496:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787829695.635480:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829696.467517:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787829696.659475:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829697.491540:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787829697.683435:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829698.515493:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787829698.707408:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829699.539525:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787829699.731393:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:1.0:1787829699.731400:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829699.731407:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1787829699.731411:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829699.731422:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4863
00000100:00080000:1.0:1787829699.731447:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829699.731456:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787829699.731497:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0780 x1874670273272576/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829699.731521:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829699.731524:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787829699.731526:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829699.731529:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4863
00000100:00080000:1.0:1787829699.731532:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829699.731535:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829699.731545:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787829699.731551:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273272576:192.168.203.121@tcp:250:kworker.0
00000100:00100000:1.0:1787829699.731560:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0000 x1874670273272704/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829699.731569:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829699.731572:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787829699.731573:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829699.731576:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4863
00000100:00080000:1.0:1787829699.731578:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829699.731582:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829699.731586:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787829699.731599:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a2580 x1874670273272832/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829699.731609:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829699.731614:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787829699.731616:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829699.731621:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4863
00000100:00080000:1.0:1787829699.731626:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000800:00000100:3.0:1787829699.731626:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:1.0:1787829699.731636:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829699.731651:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787829699.731662:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0b40 x1874670273272960/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829699.731670:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829699.731676:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00100000:3.0:1787829699.731678:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829699/real 1787829699]  req@ffff9ee0056a0780 x1874670273272576/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829724 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829699.731679:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829699.731689:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4863
00000100:00080000:1.0:1787829699.731696:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829699.731701:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829699.731706:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787829699.731706:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0780 x1874670273272576/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829724 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829699.731720:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a30c0 x1874670273273088/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829699.731720:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829699.731729:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829699.731737:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273272576:192.168.203.121@tcp:250:kworker.0
00000100:00080000:1.0:1787829699.731739:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829699.731744:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787829699.731746:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829699.731749:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4863
00000100:00080000:1.0:1787829699.731752:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829699.731754:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829699.731757:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829699.731765:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273272704:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787829699.731768:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a3480 x1874670273273216/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829699.731777:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829699.731781:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787829699.731783:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829699.731786:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4863
00000100:00080000:1.0:1787829699.731790:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000800:00000100:3.0:1787829699.731790:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:1.0:1787829699.731796:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829699.731800:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829699.731805:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829699/real 1787829699]  req@ffff9ee0056a0000 x1874670273272704/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829724 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829699.731811:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1e00 x1874670273273344/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787829699.731826:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0000 x1874670273272704/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829724 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829699.731834:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829699.731838:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829699.731841:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273272704:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787829699.731846:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273272832:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829699.731860:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829699.731866:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829699/real 1787829699]  req@ffff9ee0056a2580 x1874670273272832/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829724 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829699.731877:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a2580 x1874670273272832/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829724 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829699.731886:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829699.731889:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829699.731893:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273272832:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829699.731899:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273272960:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829699.731921:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829699.731933:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829699/real 1787829699]  req@ffff9ee0056a0b40 x1874670273272960/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829724 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829699.731942:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0b40 x1874670273272960/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829724 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829699.731948:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829699.731950:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829699.731952:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273272960:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829699.731956:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273273088:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787829699.731971:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829699.731978:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829699/real 1787829699]  req@ffff9ee0056a30c0 x1874670273273088/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829724 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829699.731986:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a30c0 x1874670273273088/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829724 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829699.731991:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829699.731993:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829699.731994:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273273088:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787829699.732007:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273273216:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829699.732018:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829699.732024:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829699/real 1787829699]  req@ffff9ee0056a3480 x1874670273273216/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829724 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829699.732032:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a3480 x1874670273273216/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829724 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829699.732054:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829699.732056:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829699.732058:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273273216:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829699.732062:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273273344:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829699.732074:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829699.732081:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829699/real 1787829699]  req@ffff9ee0056a1e00 x1874670273273344/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829724 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829699.732094:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1e00 x1874670273273344/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829724 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829699.732100:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829699.732101:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829699.732112:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273273344:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787829700.563530:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787829700.755385:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829701.587452:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787829701.779369:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829702.611552:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787829702.803395:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829703.635507:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787829703.827379:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829704.659444:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1787829704.851416:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1787829704.851420:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:1.0:1787829704.851425:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1787829704.851430:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829704.851439:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4868
00000100:00080000:1.0:1787829704.851448:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829704.851454:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787829704.851495:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0f00 x1874670273273472/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829704.851517:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829704.851519:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787829704.851521:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829704.851524:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4868
00000100:00080000:1.0:1787829704.851526:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829704.851528:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829704.851536:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787829704.851544:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a3c00 x1874670273273600/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829704.851552:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829704.851554:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787829704.851556:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829704.851558:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4868
00000100:00080000:1.0:1787829704.851561:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1787829704.851564:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273273472:192.168.203.121@tcp:250:kworker.0
00000100:00080000:1.0:1787829704.851567:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829704.851575:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787829704.851581:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a2940 x1874670273273728/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829704.851590:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829704.851594:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787829704.851596:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829704.851601:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4868
00000100:00080000:1.0:1787829704.851606:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829704.851610:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829704.851616:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:3.0:1787829704.851627:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829704.851631:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a21c0 x1874670273273856/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829704.851651:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829704.851654:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787829704.851656:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829704.851659:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4868
00000100:00080000:1.0:1787829704.851662:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829704.851666:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787829704.851672:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829704/real 1787829704]  req@ffff9ee0056a0f00 x1874670273273472/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829729 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:1.0:1787829704.851674:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787829704.851693:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1680 x1874670273273984/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787829704.851695:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0f00 x1874670273273472/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829729 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829704.851725:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829704.851725:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829704.851732:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:1.0:1787829704.851733:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787829704.851737:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1787829704.851741:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273273472:192.168.203.121@tcp:250:kworker.0
00000100:00080000:1.0:1787829704.851745:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4868
00000100:00100000:3.0:1787829704.851751:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273273600:192.168.203.121@tcp:38:kworker.0
00000100:00080000:1.0:1787829704.851752:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829704.851762:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829704.851769:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:3.0:1787829704.851777:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829704.851786:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a03c0 x1874670273274112/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787829704.851790:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829704/real 1787829704]  req@ffff9ee0056a3c00 x1874670273273600/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829729 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829704.851799:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a3c00 x1874670273273600/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829729 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829704.851826:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829704.851833:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00080000:1.0:1787829704.851835:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1787829704.851837:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273273600:192.168.203.121@tcp:38:kworker.0
00000100:00080000:1.0:1787829704.851839:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787829704.851844:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829704.851848:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4868
00000100:00080000:1.0:1787829704.851852:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829704.851855:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829704.851859:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829704.851866:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273273728:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787829704.851872:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1a40 x1874670273274240/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1787829704.851889:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829704.851900:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829704/real 1787829704]  req@ffff9ee0056a2940 x1874670273273728/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829729 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829704.851908:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a2940 x1874670273273728/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829729 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829704.851913:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829704.851915:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829704.851917:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273273728:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829704.851921:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273273856:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829704.851931:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829704.851936:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829704/real 1787829704]  req@ffff9ee0056a21c0 x1874670273273856/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829729 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829704.851948:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a21c0 x1874670273273856/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829729 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829704.851953:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829704.851955:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829704.851956:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273273856:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829704.851960:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273273984:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787829704.851969:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829704.851975:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829704/real 1787829704]  req@ffff9ee0056a1680 x1874670273273984/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829729 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829704.851982:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1680 x1874670273273984/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829729 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829704.851987:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829704.851988:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829704.851990:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273273984:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787829704.851993:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273274112:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829704.852002:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829704.852008:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829704/real 1787829704]  req@ffff9ee0056a03c0 x1874670273274112/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829729 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829704.852014:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a03c0 x1874670273274112/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829729 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829704.852023:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829704.852025:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829704.852027:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273274112:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829704.852037:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273274240:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829704.852047:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829704.852053:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829704/real 1787829704]  req@ffff9ee0056a1a40 x1874670273274240/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829729 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829704.852060:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1a40 x1874670273274240/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829729 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829704.852065:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829704.852067:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829704.852069:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273274240:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787829705.683498:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787829705.875381:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829706.707498:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787829706.899430:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829707.731514:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787829707.923437:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829708.755530:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787829708.947444:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829709.779453:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1787829709.971443:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1787829709.971446:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:1.0:1787829709.971452:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1787829709.971456:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829709.971472:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4873
00000100:00080000:1.0:1787829709.971486:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829709.971494:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787829709.971531:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a12c0 x1874670273274368/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829709.971554:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829709.971557:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787829709.971560:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829709.971563:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4873
00000100:00080000:1.0:1787829709.971568:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829709.971571:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829709.971582:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787829709.971589:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273274368:192.168.203.121@tcp:250:kworker.0
00000100:00100000:1.0:1787829709.971595:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1a40 x1874670273274496/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829709.971605:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829709.971608:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787829709.971609:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829709.971613:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4873
00000100:00080000:1.0:1787829709.971616:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829709.971619:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829709.971623:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787829709.971631:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a03c0 x1874670273274624/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829709.971639:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829709.971642:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787829709.971643:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829709.971647:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4873
00000800:00000100:3.0:1787829709.971648:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:1.0:1787829709.971650:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829709.971653:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829709.971657:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787829709.971665:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1680 x1874670273274752/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829709.971673:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829709.971676:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787829709.971678:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829709.971681:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4873
00000100:00080000:1.0:1787829709.971684:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829709.971688:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829709.971692:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787829709.971694:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829709/real 1787829709]  req@ffff9ee0056a12c0 x1874670273274368/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829734 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829709.971701:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a21c0 x1874670273274880/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829709.971711:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829709.971715:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787829709.971717:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829709.971720:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4873
00000100:00100000:3.0:1787829709.971720:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a12c0 x1874670273274368/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829734 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829709.971724:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829709.971727:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829709.971731:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:3.0:1787829709.971731:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829709.971735:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829709.971739:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a2940 x1874670273275008/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787829709.971740:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273274368:192.168.203.121@tcp:250:kworker.0
00000100:00080000:1.0:1787829709.971747:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829709.971750:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787829709.971751:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829709.971754:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4873
00000100:00080000:1.0:1787829709.971757:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829709.971760:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787829709.971761:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273274496:192.168.203.121@tcp:38:kworker.0
00000008:00100000:1.0:1787829709.971765:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787829709.971774:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a3c00 x1874670273275136/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1787829709.971781:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829709.971793:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829709/real 1787829709]  req@ffff9ee0056a1a40 x1874670273274496/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829734 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829709.971806:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1a40 x1874670273274496/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829734 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829709.971814:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829709.971817:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829709.971821:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273274496:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787829709.971827:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273274624:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829709.971844:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829709.971852:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829709/real 1787829709]  req@ffff9ee0056a03c0 x1874670273274624/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829734 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829709.971860:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a03c0 x1874670273274624/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829734 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829709.971869:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829709.971871:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829709.971873:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273274624:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829709.971876:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273274752:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829709.971885:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829709.971891:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829709/real 1787829709]  req@ffff9ee0056a1680 x1874670273274752/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829734 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829709.971898:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1680 x1874670273274752/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829734 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829709.971903:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829709.971905:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829709.971906:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273274752:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829709.971910:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273274880:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787829709.971919:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829709.971924:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829709/real 1787829709]  req@ffff9ee0056a21c0 x1874670273274880/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829734 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829709.971931:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a21c0 x1874670273274880/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829734 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829709.971936:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829709.971937:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829709.971940:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273274880:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787829709.971943:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273275008:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829709.971952:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829709.971957:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829709/real 1787829709]  req@ffff9ee0056a2940 x1874670273275008/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829734 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829709.971964:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a2940 x1874670273275008/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829734 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829709.971968:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829709.971970:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829709.971972:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273275008:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829709.971985:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273275136:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829709.971995:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829709.972001:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829709/real 1787829709]  req@ffff9ee0056a3c00 x1874670273275136/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829734 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829709.972008:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a3c00 x1874670273275136/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829734 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829709.972013:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829709.972014:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829709.972016:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273275136:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787829710.803501:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787829710.995429:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829711.827468:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787829712.019388:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829712.851545:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787829713.043399:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829713.875523:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787829714.067408:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829714.899532:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787829715.091408:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:1.0:1787829715.091409:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829715.091419:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1787829715.091423:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829715.091433:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4878
00000100:00080000:1.0:1787829715.091444:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829715.091452:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787829715.091487:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0f00 x1874670273275264/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829715.091509:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829715.091512:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787829715.091513:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829715.091516:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4878
00000100:00080000:1.0:1787829715.091520:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829715.091523:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829715.091531:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787829715.091542:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1e00 x1874670273275392/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787829715.091542:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273275264:192.168.203.121@tcp:250:kworker.0
00000100:00080000:1.0:1787829715.091557:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829715.091559:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787829715.091561:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829715.091563:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4878
00000100:00080000:1.0:1787829715.091565:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829715.091568:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829715.091572:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787829715.091578:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a3480 x1874670273275520/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829715.091585:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829715.091588:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787829715.091589:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829715.091593:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4878
00000100:00080000:1.0:1787829715.091597:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829715.091601:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829715.091606:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787829715.091617:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a30c0 x1874670273275648/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829715.091627:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829715.091630:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787829715.091633:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829715.091637:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4878
00000100:00080000:1.0:1787829715.091642:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829715.091647:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829715.091653:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787829715.091655:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273275392:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787829715.091672:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0b40 x1874670273275776/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829715.091685:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1787829715.091689:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273275520:192.168.203.121@tcp:8:kworker.0
00000100:00080000:1.0:1787829715.091691:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787829715.091697:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829715.091704:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4878
00000100:00080000:1.0:1787829715.091720:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1787829715.091722:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273275648:192.168.203.121@tcp:8:kworker.0
00000100:00080000:1.0:1787829715.091731:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829715.091739:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829715.091746:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273275776:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787829715.091754:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a2580 x1874670273275904/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829715.091764:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829715.091766:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787829715.091768:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1787829715.091770:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273275904:192.168.203.121@tcp:8:kworker.0
00000100:00080000:1.0:1787829715.091774:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4878
00000100:00080000:1.0:1787829715.091780:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829715.091782:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829715.091787:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787829715.091799:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0000 x1874670273276032/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787829715.091841:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273276032:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787829715.923473:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787829716.115394:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829716.947489:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787829717.139437:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829717.971508:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787829718.163389:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000400:00000100:2.0:1787829718.163574:0:2353:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.203.121:988
00000400:00000100:2.0:1787829718.163619:0:2353:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.203.121@tcp at host 192.168.203.121 was unreachable: the network or that node may be down, or Lustre may be misconfigured.
00000800:00000100:2.0:1787829718.163638:0:2353:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:2.0:1787829718.163685:0:2353:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:2.0:1787829718.163696:0:2353:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:2.0:1787829718.163705:0:2353:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:2.0:1787829718.163714:0:2353:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:2.0:1787829718.163722:0:2353:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:2.0:1787829718.163730:0:2353:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000100:00100000:3.0:1787829718.163835:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829715/real 1787829718]  req@ffff9ee0056a0000 x1874670273276032/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829740 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829718.163866:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0000 x1874670273276032/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829740 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829718.163879:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829718.163885:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829718.163891:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273276032:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829718.163901:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829715/real 1787829718]  req@ffff9ee0056a2580 x1874670273275904/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829740 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829718.163916:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a2580 x1874670273275904/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829740 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829718.163926:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829718.163930:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829718.163935:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273275904:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829718.163942:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829715/real 1787829718]  req@ffff9ee0056a0b40 x1874670273275776/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829740 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829718.163956:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0b40 x1874670273275776/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829740 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829718.163965:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829718.163969:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829718.163973:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273275776:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787829718.163981:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829715/real 1787829718]  req@ffff9ee0056a1e00 x1874670273275392/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829740 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829718.164001:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1e00 x1874670273275392/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829740 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829718.164011:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829718.164014:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829718.164017:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273275392:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787829718.164026:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829715/real 1787829718]  req@ffff9ee0056a3480 x1874670273275520/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829740 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829718.164122:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a3480 x1874670273275520/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829740 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829718.164219:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829718.164226:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829718.164232:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273275520:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829718.164242:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829715/real 1787829718]  req@ffff9ee0056a30c0 x1874670273275648/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829740 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829718.164257:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a30c0 x1874670273275648/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829740 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829718.164266:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829718.164270:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829718.164279:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273275648:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829718.164287:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829715/real 1787829718]  req@ffff9ee0056a0f00 x1874670273275264/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829740 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829718.164339:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0f00 x1874670273275264/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829740 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829718.164347:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829718.164350:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829718.164354:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273275264:192.168.203.121@tcp:250:kworker.0
00010000:00010000:0.0:1787829718.995502:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787829719.187440:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829720.019437:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1787829720.211406:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1787829720.211411:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:1.0:1787829720.211414:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1787829720.211420:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829720.211429:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4883
00000100:00080000:1.0:1787829720.211438:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829720.211444:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787829720.211489:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0780 x1874670273276160/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829720.211510:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829720.211514:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787829720.211517:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829720.211522:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4883
00000100:00080000:1.0:1787829720.211527:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829720.211532:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829720.211542:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787829720.211556:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273276160:192.168.203.121@tcp:250:kworker.0
00000100:00100000:1.0:1787829720.211562:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0f00 x1874670273276288/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829720.211576:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829720.211580:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787829720.211583:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829720.211587:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4883
00000100:00080000:1.0:1787829720.211592:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829720.211597:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829720.211604:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787829720.211619:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a30c0 x1874670273276416/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1787829720.211629:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:1.0:1787829720.211635:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829720.211639:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787829720.211641:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829720.211645:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4883
00000100:00080000:1.0:1787829720.211651:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829720.211656:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829720.211662:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787829720.211676:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829720/real 1787829720]  req@ffff9ee0056a0780 x1874670273276160/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829745 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829720.211680:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a3480 x1874670273276544/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829720.211710:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829720.211714:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00100000:2.0:1787829720.211718:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0780 x1874670273276160/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829745 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829720.211719:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829720.211730:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4883
00000100:00080000:1.0:1787829720.211739:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829720.211741:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829720.211747:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00080000:2.0:1787829720.211752:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000008:00100000:1.0:1787829720.211756:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787829720.211760:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273276160:192.168.203.121@tcp:250:kworker.0
00000100:00100000:1.0:1787829720.211782:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1e00 x1874670273276672/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787829720.211792:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273276288:192.168.203.121@tcp:38:kworker.0
00000100:00080000:1.0:1787829720.211798:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829720.211804:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787829720.211806:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829720.211811:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4883
00000100:00080000:1.0:1787829720.211817:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829720.211821:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000800:00000100:2.0:1787829720.211826:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000008:00100000:1.0:1787829720.211830:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787829720.211845:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829720/real 1787829720]  req@ffff9ee0056a0f00 x1874670273276288/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829745 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829720.211848:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0b40 x1874670273276800/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787829720.211881:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0f00 x1874670273276288/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829745 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829720.211883:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829720.211890:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787829720.211895:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829720.211903:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4883
00000100:00080000:2.0:1787829720.211905:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829720.211908:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829720.211914:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00080000:1.0:1787829720.211917:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787829720.211924:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273276288:192.168.203.121@tcp:38:kworker.0
00000008:00100000:1.0:1787829720.211925:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787829720.211938:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273276416:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787829720.211945:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a2580 x1874670273276928/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1787829720.211970:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829720.212003:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829720/real 1787829720]  req@ffff9ee0056a30c0 x1874670273276416/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829745 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829720.212016:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a30c0 x1874670273276416/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829745 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829720.212023:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829720.212027:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829720.212030:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273276416:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787829720.212037:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273276544:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787829720.212057:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829720.212068:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829720/real 1787829720]  req@ffff9ee0056a3480 x1874670273276544/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829745 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829720.212079:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a3480 x1874670273276544/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829745 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829720.212087:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829720.212090:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829720.212094:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273276544:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787829720.212114:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273276672:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787829720.212137:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829720.212149:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829720/real 1787829720]  req@ffff9ee0056a1e00 x1874670273276672/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829745 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829720.212168:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1e00 x1874670273276672/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829745 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829720.212177:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829720.212180:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829720.212184:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273276672:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787829720.212191:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273276800:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787829720.212218:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829720.212230:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829720/real 1787829720]  req@ffff9ee0056a0b40 x1874670273276800/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829745 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829720.212243:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0b40 x1874670273276800/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829745 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829720.212250:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829720.212253:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829720.212256:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273276800:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787829720.212263:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273276928:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787829720.212282:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829720.212309:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829720/real 1787829720]  req@ffff9ee0056a2580 x1874670273276928/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829745 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829720.212351:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a2580 x1874670273276928/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829745 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829720.212366:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829720.212370:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829720.212373:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273276928:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787829721.043506:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787829721.235397:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829722.067464:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787829722.259415:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829723.091493:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787829723.283396:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829724.115438:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787829724.307390:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829725.139447:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787829725.331386:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:2.0:1787829725.331419:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829725.331427:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787829725.331430:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829725.331437:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4889
00000100:00080000:2.0:1787829725.331445:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829725.331450:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787829725.331481:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729680 x1874670273277056/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829725.331505:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829725.331507:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787829725.331509:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829725.331511:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4889
00000100:00080000:2.0:1787829725.331514:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829725.331516:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829725.331523:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787829725.331532:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a1c0 x1874670273277184/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787829725.331540:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273277056:192.168.203.121@tcp:250:kworker.0
00000100:00080000:2.0:1787829725.331543:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829725.331548:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787829725.331550:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829725.331553:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4889
00000100:00080000:2.0:1787829725.331555:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829725.331557:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829725.331560:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787829725.331568:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728000 x1874670273277312/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829725.331574:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829725.331576:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787829725.331578:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829725.331581:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4889
00000100:00080000:2.0:1787829725.331591:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829725.331594:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829725.331597:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:3.0:1787829725.331602:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829725.331607:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057283c0 x1874670273277440/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829725.331615:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829725.331618:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787829725.331620:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829725.331622:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4889
00000100:00080000:2.0:1787829725.331625:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829725.331627:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829725.331631:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787829725.331639:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829725/real 1787829725]  req@ffff9ee005729680 x1874670273277056/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829750 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829725.331644:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572bc00 x1874670273277568/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829725.331668:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829725.331671:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787829725.331673:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1787829725.331677:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729680 x1874670273277056/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829750 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829725.331679:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4889
00000100:00080000:2.0:1787829725.331686:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829725.331692:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00080000:3.0:1787829725.331694:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000008:00100000:2.0:1787829725.331698:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:3.0:1787829725.331700:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829725.331705:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273277056:192.168.203.121@tcp:250:kworker.0
00000100:00100000:2.0:1787829725.331711:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a580 x1874670273277696/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829725.331719:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829725.331721:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787829725.331723:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829725.331725:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4889
00000100:00080000:2.0:1787829725.331730:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1787829725.331730:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273277184:192.168.203.121@tcp:38:kworker.0
00000100:00080000:2.0:1787829725.331735:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829725.331741:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787829725.331751:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728780 x1874670273277824/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1787829725.331769:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829725.331785:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829725/real 1787829725]  req@ffff9ee00572a1c0 x1874670273277184/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829750 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829725.331800:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a1c0 x1874670273277184/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829750 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829725.331813:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829725.331815:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829725.331818:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273277184:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787829725.331822:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273277312:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829725.331840:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829725.331847:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829725/real 1787829725]  req@ffff9ee005728000 x1874670273277312/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829750 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829725.331855:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728000 x1874670273277312/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829750 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829725.331860:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829725.331862:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829725.331864:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273277312:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829725.331867:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273277440:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829725.331877:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829725.331882:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829725/real 1787829725]  req@ffff9ee0057283c0 x1874670273277440/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829750 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829725.331889:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057283c0 x1874670273277440/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829750 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829725.331893:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829725.331895:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829725.331898:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273277440:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829725.331901:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273277568:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787829725.331911:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829725.331916:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829725/real 1787829725]  req@ffff9ee00572bc00 x1874670273277568/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829750 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829725.331923:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572bc00 x1874670273277568/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829750 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829725.331928:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829725.331929:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829725.331931:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273277568:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787829725.331934:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273277696:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829725.331943:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829725.331948:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829725/real 1787829725]  req@ffff9ee00572a580 x1874670273277696/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829750 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829725.331955:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a580 x1874670273277696/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829750 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829725.331959:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829725.331961:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829725.331963:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273277696:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829725.331977:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273277824:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829725.331987:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829725.331993:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829725/real 1787829725]  req@ffff9ee005728780 x1874670273277824/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829750 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829725.332000:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728780 x1874670273277824/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829750 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829725.332005:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829725.332007:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829725.332009:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273277824:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787829726.163480:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787829726.355397:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829727.187460:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787829727.379411:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829728.211484:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787829728.403409:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829729.235438:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787829729.427417:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829730.259544:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829730.451426:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787829730.451430:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829730.451438:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787829730.451443:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829730.451452:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4894
00000100:00080000:3.0:1787829730.451464:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829730.451472:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787829730.451509:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705680 x1874670273277952/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829730.451542:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829730.451546:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787829730.451548:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829730.451553:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4894
00000100:00080000:3.0:1787829730.451558:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829730.451562:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829730.451573:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787829730.451585:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707840 x1874670273278080/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787829730.451593:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273277952:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787829730.451597:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829730.451602:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787829730.451604:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829730.451614:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4894
00000100:00080000:3.0:1787829730.451617:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829730.451620:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829730.451624:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829730.451635:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706940 x1874670273278208/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829730.451642:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829730.451645:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787829730.451646:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829730.451649:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4894
00000100:00080000:3.0:1787829730.451651:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829730.451654:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000800:00000100:2.0:1787829730.451658:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000008:00100000:3.0:1787829730.451658:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829730.451669:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704000 x1874670273278336/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829730.451681:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829730.451684:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787829730.451685:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829730.451688:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4894
00000100:00080000:3.0:1787829730.451690:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829730.451692:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829730.451695:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787829730.451710:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707480 x1874670273278464/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787829730.451711:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829730/real 1787829730]  req@ffff9ee005705680 x1874670273277952/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829755 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829730.451725:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829730.451733:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787829730.451737:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829730.451741:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4894
00000100:00080000:3.0:1787829730.451744:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829730.451747:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787829730.451752:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705680 x1874670273277952/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829755 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:3.0:1787829730.451752:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829730.451765:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057070c0 x1874670273278592/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829730.451774:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829730.451781:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829730.451783:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:3.0:1787829730.451790:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:2.0:1787829730.451793:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273277952:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787829730.451794:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829730.451805:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4894
00000100:00080000:3.0:1787829730.451811:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829730.451815:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829730.451819:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787829730.451826:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273278080:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787829730.451835:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057052c0 x1874670273278720/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1787829730.451854:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829730.451867:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829730/real 1787829730]  req@ffff9ee005707840 x1874670273278080/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829755 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829730.451877:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707840 x1874670273278080/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829755 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829730.451883:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829730.451885:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829730.451888:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273278080:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787829730.451891:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273278208:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787829730.451903:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829730.451909:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829730/real 1787829730]  req@ffff9ee005706940 x1874670273278208/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829755 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829730.451921:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706940 x1874670273278208/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829755 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829730.451925:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829730.451927:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829730.451929:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273278208:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787829730.451932:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273278336:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787829730.451941:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829730.451947:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829730/real 1787829730]  req@ffff9ee005704000 x1874670273278336/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829755 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829730.451953:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704000 x1874670273278336/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829755 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829730.451958:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829730.451960:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829730.451962:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273278336:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787829730.451965:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273278464:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787829730.451974:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829730.451979:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829730/real 1787829730]  req@ffff9ee005707480 x1874670273278464/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829755 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829730.451986:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707480 x1874670273278464/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829755 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829730.451995:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829730.451997:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829730.451999:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273278464:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787829730.452002:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273278592:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787829730.452011:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829730.452017:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829730/real 1787829730]  req@ffff9ee0057070c0 x1874670273278592/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829755 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829730.452024:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057070c0 x1874670273278592/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829755 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829730.452029:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829730.452030:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829730.452032:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273278592:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787829730.452044:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273278720:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787829730.452053:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829730.452059:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829730/real 1787829730]  req@ffff9ee0057052c0 x1874670273278720/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829755 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829730.452065:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057052c0 x1874670273278720/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829755 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829730.452070:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829730.452072:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829730.452075:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273278720:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787829731.283448:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787829731.475448:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829732.307454:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787829732.499408:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829733.331462:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787829733.523459:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829734.355463:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787829734.547397:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829735.379499:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787829735.571392:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787829735.571393:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829735.571401:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787829735.571405:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829735.571413:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4899
00000100:00080000:3.0:1787829735.571422:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829735.571429:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787829735.571460:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707c00 x1874670273278848/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829735.571484:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829735.571488:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787829735.571490:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829735.571494:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4899
00000100:00080000:3.0:1787829735.571498:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829735.571502:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829735.571512:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787829735.571525:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057061c0 x1874670273278976/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829735.571543:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829735.571546:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787829735.571548:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1787829735.571551:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273278848:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787829735.571553:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4899
00000100:00080000:3.0:1787829735.571560:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829735.571564:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829735.571568:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829735.571580:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057052c0 x1874670273279104/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829735.571587:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829735.571589:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787829735.571591:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829735.571593:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4899
00000100:00080000:3.0:1787829735.571603:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829735.571606:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829735.571609:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:2.0:1787829735.571611:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829735.571620:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057070c0 x1874670273279232/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829735.571627:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829735.571629:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787829735.571630:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829735.571633:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4899
00000100:00080000:3.0:1787829735.571636:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829735.571640:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829735.571642:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787829735.571650:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707480 x1874670273279360/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829735.571657:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829735.571661:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00100000:2.0:1787829735.571662:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829735/real 1787829735]  req@ffff9ee005707c00 x1874670273278848/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829760 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829735.571663:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829735.571671:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4899
00000100:00080000:3.0:1787829735.571676:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829735.571681:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829735.571685:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787829735.571690:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707c00 x1874670273278848/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829760 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829735.571694:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704000 x1874670273279488/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829735.571711:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829735.571712:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829735.571719:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787829735.571721:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:3.0:1787829735.571722:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1787829735.571729:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273278848:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787829735.571730:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4899
00000100:00080000:3.0:1787829735.571734:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829735.571739:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829735.571742:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829735.571748:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706940 x1874670273279616/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787829735.571754:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273278976:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787829735.571779:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829735.571790:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829735/real 1787829735]  req@ffff9ee0057061c0 x1874670273278976/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829760 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829735.571798:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057061c0 x1874670273278976/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829760 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829735.571804:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829735.571806:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829735.571808:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273278976:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787829735.571812:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273279104:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787829735.571825:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829735.571831:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829735/real 1787829735]  req@ffff9ee0057052c0 x1874670273279104/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829760 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829735.571838:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057052c0 x1874670273279104/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829760 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829735.571843:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829735.571845:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829735.571847:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273279104:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787829735.571850:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273279232:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787829735.571859:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829735.571864:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829735/real 1787829735]  req@ffff9ee0057070c0 x1874670273279232/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829760 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829735.571871:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057070c0 x1874670273279232/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829760 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829735.571876:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829735.571878:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829735.571880:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273279232:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787829735.571883:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273279360:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787829735.571892:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829735.571899:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829735/real 1787829735]  req@ffff9ee005707480 x1874670273279360/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829760 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829735.571918:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707480 x1874670273279360/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829760 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829735.571927:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829735.571930:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829735.571933:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273279360:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787829735.571940:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273279488:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787829735.571960:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829735.571979:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829735/real 1787829735]  req@ffff9ee005704000 x1874670273279488/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829760 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829735.571987:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704000 x1874670273279488/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829760 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829735.571992:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829735.571994:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829735.571996:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273279488:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787829735.572009:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273279616:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787829735.572022:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829735.572028:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829735/real 1787829735]  req@ffff9ee005706940 x1874670273279616/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829760 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829735.572035:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706940 x1874670273279616/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829760 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829735.572044:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829735.572046:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829735.572048:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273279616:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787829736.403469:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787829736.595395:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829737.427478:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787829737.619379:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829738.451483:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787829738.643385:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829739.475450:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787829739.667395:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829740.499483:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787829740.691392:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787829740.691392:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829740.691401:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787829740.691405:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829740.691412:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4904
00000100:00080000:3.0:1787829740.691422:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829740.691429:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787829740.691462:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707840 x1874670273279744/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829740.691486:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829740.691489:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787829740.691490:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829740.691493:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4904
00000100:00080000:3.0:1787829740.691495:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829740.691498:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829740.691505:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787829740.691513:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705680 x1874670273279872/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829740.691521:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829740.691523:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787829740.691524:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829740.691527:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4904
00000100:00080000:3.0:1787829740.691530:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1787829740.691535:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273279744:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787829740.691536:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829740.691542:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829740.691550:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704780 x1874670273280000/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829740.691557:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829740.691559:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787829740.691561:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829740.691563:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4904
00000100:00080000:3.0:1787829740.691566:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829740.691568:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829740.691572:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829740.691579:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057043c0 x1874670273280128/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829740.691585:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829740.691588:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787829740.691590:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:2.0:1787829740.691594:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787829740.691597:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4904
00000100:00080000:3.0:1787829740.691601:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829740.691604:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829740.691607:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787829740.691615:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705a40 x1874670273280256/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829740.691625:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829740.691628:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787829740.691629:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829740.691633:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4904
00000100:00080000:3.0:1787829740.691635:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1787829740.691640:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829740/real 1787829740]  req@ffff9ee005707840 x1874670273279744/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829765 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829740.691641:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829740.691647:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829740.691656:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704b40 x1874670273280384/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829740.691665:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829740.691667:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:2.0:1787829740.691672:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707840 x1874670273279744/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829765 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829740.691672:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829740.691682:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829740.691686:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4904
00000100:00080000:2.0:1787829740.691689:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:3.0:1787829740.691692:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1787829740.691696:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273279744:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787829740.691699:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829740.691705:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787829740.691707:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273279872:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787829740.691716:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706580 x1874670273280512/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:2.0:1787829740.691731:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829740.691744:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829740/real 1787829740]  req@ffff9ee005705680 x1874670273279872/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829765 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829740.691758:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705680 x1874670273279872/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829765 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829740.691766:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829740.691770:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829740.691774:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273279872:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787829740.691799:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273280000:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787829740.691819:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829740.691828:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829740/real 1787829740]  req@ffff9ee005704780 x1874670273280000/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829765 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829740.691836:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704780 x1874670273280000/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829765 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829740.691842:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829740.691844:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829740.691846:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273280000:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787829740.691850:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273280128:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787829740.691861:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829740.691866:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829740/real 1787829740]  req@ffff9ee0057043c0 x1874670273280128/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829765 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829740.691874:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057043c0 x1874670273280128/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829765 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829740.691878:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829740.691880:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829740.691882:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273280128:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787829740.691886:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273280256:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787829740.691895:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829740.691901:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829740/real 1787829740]  req@ffff9ee005705a40 x1874670273280256/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829765 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829740.691908:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705a40 x1874670273280256/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829765 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829740.691913:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829740.691915:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829740.691917:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273280256:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787829740.691920:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273280384:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787829740.691930:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829740.691935:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829740/real 1787829740]  req@ffff9ee005704b40 x1874670273280384/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829765 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829740.691950:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704b40 x1874670273280384/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829765 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829740.691956:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829740.691958:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829740.691960:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273280384:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787829740.691963:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273280512:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787829740.691974:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829740.691980:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829740/real 1787829740]  req@ffff9ee005706580 x1874670273280512/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829765 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829740.691987:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706580 x1874670273280512/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829765 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829740.691993:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829740.691995:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829740.691997:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273280512:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787829741.523460:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829741.715505:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829742.547469:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829742.739394:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829743.571461:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829743.763423:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829744.595455:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829744.787359:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829745.619495:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829745.811413:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:0.0:1787829745.811423:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829745.811428:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1787829745.811432:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829745.811440:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4909
00000100:00080000:0.0:1787829745.811449:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829745.811456:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787829745.811487:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ead00 x1874670273280640/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829745.811509:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829745.811511:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787829745.811513:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829745.811515:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4909
00000100:00080000:0.0:1787829745.811518:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829745.811520:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829745.811527:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787829745.811536:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ea940 x1874670273280768/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829745.811544:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829745.811547:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787829745.811550:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1787829745.811551:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273280640:192.168.203.121@tcp:250:kworker.0
00000100:00080000:0.0:1787829745.811553:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4909
00000100:00080000:0.0:1787829745.811558:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829745.811561:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829745.811564:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787829745.811573:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8780 x1874670273280896/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829745.811579:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829745.811582:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787829745.811584:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829745.811587:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4909
00000100:00080000:0.0:1787829745.811589:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829745.811592:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829745.811594:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787829745.811601:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9680 x1874670273281024/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829745.811606:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829745.811608:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787829745.811611:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:2.0:1787829745.811612:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:0.0:1787829745.811616:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4909
00000100:00080000:0.0:1787829745.811619:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829745.811621:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829745.811624:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787829745.811632:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ea580 x1874670273281152/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829745.811637:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829745.811639:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787829745.811641:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829745.811644:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4909
00000100:00080000:0.0:1787829745.811646:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829745.811648:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787829745.811652:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829745/real 1787829745]  req@ffff9ee0056ead00 x1874670273280640/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829770 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:0.0:1787829745.811653:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787829745.811665:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9a40 x1874670273281280/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829745.811672:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1787829745.811673:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ead00 x1874670273280640/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829770 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829745.811677:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787829745.811680:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829745.811688:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4909
00000100:00080000:0.0:1787829745.811692:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829745.811695:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00080000:2.0:1787829745.811695:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000008:00100000:0.0:1787829745.811702:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:2.0:1787829745.811704:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829745.811710:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273280640:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787829745.811712:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb0c0 x1874670273281408/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787829745.811733:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273280768:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787829745.811750:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829745.811758:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829745/real 1787829745]  req@ffff9ee0056ea940 x1874670273280768/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829770 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829745.811766:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ea940 x1874670273280768/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829770 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829745.811772:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829745.811774:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829745.811777:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273280768:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787829745.811781:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273280896:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787829745.811791:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829745.811797:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829745/real 1787829745]  req@ffff9ee0056e8780 x1874670273280896/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829770 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829745.811804:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8780 x1874670273280896/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829770 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829745.811809:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829745.811811:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829745.811813:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273280896:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787829745.811816:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273281024:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787829745.811825:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829745.811830:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829745/real 1787829745]  req@ffff9ee0056e9680 x1874670273281024/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829770 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829745.811837:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9680 x1874670273281024/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829770 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829745.811842:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829745.811844:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829745.811845:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273281024:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787829745.811849:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273281152:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787829745.811857:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829745.811863:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829745/real 1787829745]  req@ffff9ee0056ea580 x1874670273281152/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829770 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829745.811870:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ea580 x1874670273281152/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829770 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829745.811875:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829745.811877:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829745.811879:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273281152:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787829745.811882:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273281280:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787829745.811891:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829745.811896:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829745/real 1787829745]  req@ffff9ee0056e9a40 x1874670273281280/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829770 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829745.811902:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9a40 x1874670273281280/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829770 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829745.811918:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829745.811922:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829745.811924:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273281280:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787829745.811928:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273281408:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787829745.811940:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829745.811946:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829745/real 1787829745]  req@ffff9ee0056eb0c0 x1874670273281408/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829770 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829745.811953:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb0c0 x1874670273281408/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829770 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829745.811959:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829745.811961:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829745.811963:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273281408:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787829746.643470:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829746.835448:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829747.667529:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829747.859365:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829748.691521:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829748.883419:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829749.715558:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829749.907403:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829750.739499:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1787829750.931376:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829750.931384:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787829750.931388:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1787829750.931393:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787829750.931398:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4914
00000100:00080000:3.0:1787829750.931408:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829750.931415:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787829750.931468:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705e00 x1874670273281536/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829750.931520:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829750.931524:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787829750.931526:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829750.931530:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4914
00000100:00080000:3.0:1787829750.931534:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829750.931538:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829750.931549:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787829750.931567:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273281536:192.168.203.121@tcp:250:kworker.0
00000100:00100000:3.0:1787829750.931571:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706d00 x1874670273281664/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829750.931582:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829750.931585:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787829750.931586:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829750.931589:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4914
00000100:00080000:3.0:1787829750.931592:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829750.931595:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829750.931602:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829750.931612:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706580 x1874670273281792/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829750.931619:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829750.931622:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787829750.931623:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829750.931625:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4914
00000100:00080000:3.0:1787829750.931628:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000800:00000100:2.0:1787829750.931633:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787829750.931634:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829750.931662:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829750.931682:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704b40 x1874670273281920/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829750.931698:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829750.931703:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00100000:2.0:1787829750.931709:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829750/real 1787829750]  req@ffff9ee005705e00 x1874670273281536/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829775 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829750.931711:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829750.931726:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4914
00000100:00080000:3.0:1787829750.931738:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1787829750.931744:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705e00 x1874670273281536/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829775 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829750.931746:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829750.931757:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00080000:2.0:1787829750.931765:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829750.931772:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829750.931778:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705a40 x1874670273282048/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787829750.931782:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273281536:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787829750.931806:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829750.931812:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00100000:2.0:1787829750.931817:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273281664:192.168.203.121@tcp:38:kworker.0
00000100:00080000:3.0:1787829750.931818:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829750.931829:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4914
00000100:00080000:3.0:1787829750.931836:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829750.931845:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829750.931854:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:2.0:1787829750.931872:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829750.931879:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057043c0 x1874670273282176/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787829750.931893:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829750/real 1787829750]  req@ffff9ee005706d00 x1874670273281664/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829775 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829750.931903:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1787829750.931913:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706d00 x1874670273281664/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829775 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829750.931925:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829750.931930:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00080000:3.0:1787829750.931934:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:2.0:1787829750.931936:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273281664:192.168.203.121@tcp:38:kworker.0
00000100:00080000:3.0:1787829750.931942:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1787829750.931948:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273281792:192.168.203.121@tcp:8:kworker.0
00000100:00080000:3.0:1787829750.931957:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4914
00000100:00080000:3.0:1787829750.931981:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829750.931987:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000800:00000100:2.0:1787829750.931994:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000008:00100000:3.0:1787829750.931996:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787829750.932007:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829750/real 1787829750]  req@ffff9ee005706580 x1874670273281792/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829775 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829750.932020:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704780 x1874670273282304/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:2.0:1787829750.932022:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706580 x1874670273281792/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829775 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829750.932060:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829750.932063:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829750.932066:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273281792:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787829750.932085:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273281920:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787829750.932102:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829750.932110:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829750/real 1787829750]  req@ffff9ee005704b40 x1874670273281920/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829775 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829750.932118:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704b40 x1874670273281920/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829775 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829750.932124:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829750.932126:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829750.932128:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273281920:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787829750.932132:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273282048:192.168.203.121@tcp:38:kworker.0
00000800:00000100:2.0:1787829750.932142:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829750.932149:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829750/real 1787829750]  req@ffff9ee005705a40 x1874670273282048/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829775 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829750.932156:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705a40 x1874670273282048/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829775 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829750.932161:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829750.932163:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829750.932164:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273282048:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787829750.932176:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273282176:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787829750.932186:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829750.932192:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829750/real 1787829750]  req@ffff9ee0057043c0 x1874670273282176/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829775 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829750.932199:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057043c0 x1874670273282176/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829775 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829750.932204:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829750.932207:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829750.932209:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273282176:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787829750.932212:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273282304:192.168.203.121@tcp:8:kworker.0
00000800:00000100:2.0:1787829750.932221:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829750.932226:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829750/real 1787829750]  req@ffff9ee005704780 x1874670273282304/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829775 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829750.932233:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704780 x1874670273282304/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829775 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829750.932248:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829750.932250:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829750.932253:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273282304:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787829751.763491:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829751.955390:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829752.787478:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829752.979404:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829753.811487:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829754.003401:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829754.835474:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829755.027365:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829755.859526:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1787829756.051435:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1787829756.051436:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:0.0:1787829756.051444:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1787829756.051449:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829756.051458:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4919
00000100:00080000:0.0:1787829756.051466:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829756.051473:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787829756.051505:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8b40 x1874670273282432/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829756.051528:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829756.051531:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787829756.051533:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829756.051536:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4919
00000100:00080000:0.0:1787829756.051539:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829756.051542:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829756.051550:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787829756.051557:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273282432:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787829756.051563:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e92c0 x1874670273282560/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829756.051573:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829756.051575:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787829756.051577:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829756.051580:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4919
00000100:00080000:0.0:1787829756.051582:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829756.051585:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829756.051589:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787829756.051597:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb480 x1874670273282688/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829756.051604:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829756.051607:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787829756.051608:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829756.051617:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4919
00000100:00080000:0.0:1787829756.051619:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829756.051622:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829756.051625:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787829756.051633:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb840 x1874670273282816/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829756.051639:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829756.051641:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787829756.051642:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829756.051644:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4919
00000100:00080000:0.0:1787829756.051646:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829756.051648:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829756.051650:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787829756.051655:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8f00 x1874670273282944/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1787829756.051662:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:0.0:1787829756.051664:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829756.051668:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787829756.051669:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829756.051672:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4919
00000100:00080000:0.0:1787829756.051674:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829756.051676:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829756.051679:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787829756.051686:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e83c0 x1874670273283072/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829756.051691:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829756.051693:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787829756.051694:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829756.051698:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4919
00000100:00080000:0.0:1787829756.051700:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829756.051703:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829756.051706:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787829756.051708:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829756/real 1787829756]  req@ffff9ee0056e8b40 x1874670273282432/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829781 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829756.051715:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ebc00 x1874670273283200/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787829756.051734:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8b40 x1874670273282432/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829781 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829756.051744:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829756.051747:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829756.051750:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273282432:192.168.203.121@tcp:250:kworker.0
00000100:00100000:1.0:1787829756.051768:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273282560:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787829756.051785:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829756.051794:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829756/real 1787829756]  req@ffff9ee0056e92c0 x1874670273282560/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829781 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829756.051802:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e92c0 x1874670273282560/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829781 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829756.051808:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829756.051810:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829756.051812:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273282560:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787829756.051816:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273282688:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787829756.051827:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829756.051833:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829756/real 1787829756]  req@ffff9ee0056eb480 x1874670273282688/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829781 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829756.051841:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb480 x1874670273282688/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829781 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829756.051850:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829756.051852:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829756.051854:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273282688:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787829756.051857:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273282816:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787829756.051867:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829756.051872:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829756/real 1787829756]  req@ffff9ee0056eb840 x1874670273282816/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829781 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829756.051888:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb840 x1874670273282816/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829781 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829756.051894:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829756.051896:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829756.051898:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273282816:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787829756.051901:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273282944:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787829756.051912:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829756.051918:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829756/real 1787829756]  req@ffff9ee0056e8f00 x1874670273282944/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829781 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829756.051924:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8f00 x1874670273282944/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829781 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829756.051930:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829756.051932:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829756.051935:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273282944:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787829756.051939:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273283072:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787829756.051968:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829756.051976:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829756/real 1787829756]  req@ffff9ee0056e83c0 x1874670273283072/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829781 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829756.051988:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e83c0 x1874670273283072/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829781 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829756.051994:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829756.051996:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829756.051998:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273283072:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787829756.052004:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273283200:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787829756.052017:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829756.052026:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829756/real 1787829756]  req@ffff9ee0056ebc00 x1874670273283200/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829781 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829756.052069:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ebc00 x1874670273283200/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829781 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829756.052075:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829756.052079:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829756.052082:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273283200:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787829756.883625:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829757.075387:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829757.907469:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829758.099388:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829758.931486:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829759.123422:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829759.955523:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829760.147488:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829760.979515:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1787829761.171480:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:2.0:1787829761.171481:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:0.0:1787829761.171489:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1787829761.171493:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829761.171501:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4924
00000100:00080000:0.0:1787829761.171527:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829761.171536:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787829761.171575:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9e00 x1874670273283328/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829761.171607:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829761.171612:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787829761.171614:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829761.171618:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4924
00000100:00080000:0.0:1787829761.171623:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829761.171627:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829761.171638:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787829761.171652:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8000 x1874670273283456/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787829761.171664:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273283328:192.168.203.121@tcp:250:kworker.0
00000100:00080000:0.0:1787829761.171671:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829761.171676:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787829761.171678:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829761.171682:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4924
00000100:00080000:0.0:1787829761.171686:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829761.171691:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829761.171698:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787829761.171712:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ebc00 x1874670273283584/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829761.171723:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829761.171727:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787829761.171731:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829761.171734:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4924
00000100:00080000:0.0:1787829761.171753:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829761.171756:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829761.171761:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1787829761.171770:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829761.171773:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e83c0 x1874670273283712/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829761.171786:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829761.171791:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787829761.171794:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829761.171801:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4924
00000100:00080000:0.0:1787829761.171808:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829761.171816:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829761.171837:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787829761.171844:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829761/real 1787829761]  req@ffff9ee0056e9e00 x1874670273283328/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829786 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829761.171854:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8f00 x1874670273283840/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787829761.171865:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9e00 x1874670273283328/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829786 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829761.171882:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829761.171924:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787829761.171933:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829761.171940:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829761.171942:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4924
00000100:00080000:1.0:1787829761.171954:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:0.0:1787829761.171955:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1787829761.171984:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273283328:192.168.203.121@tcp:250:kworker.0
00000100:00080000:0.0:1787829761.171986:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829761.172030:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787829761.172060:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb840 x1874670273283968/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829761.172074:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829761.172077:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787829761.172081:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1787829761.172087:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273283456:192.168.203.121@tcp:38:kworker.0
00000100:00080000:0.0:1787829761.172090:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4924
00000100:00080000:0.0:1787829761.172102:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829761.172107:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829761.172123:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787829761.172143:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb480 x1874670273284096/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1787829761.172163:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829761.172204:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829761/real 1787829761]  req@ffff9ee0056e8000 x1874670273283456/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829786 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829761.172219:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8000 x1874670273283456/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829786 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829761.172230:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829761.172234:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829761.172254:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273283456:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787829761.172261:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273283584:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787829761.172284:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829761.172297:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829761/real 1787829761]  req@ffff9ee0056ebc00 x1874670273283584/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829786 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829761.172330:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ebc00 x1874670273283584/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829786 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829761.172346:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829761.172349:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829761.172352:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273283584:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787829761.172358:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273283712:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787829761.172420:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829761.172434:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829761/real 1787829761]  req@ffff9ee0056e83c0 x1874670273283712/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829786 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829761.172476:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e83c0 x1874670273283712/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829786 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829761.172484:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829761.172487:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829761.172490:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273283712:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787829761.172495:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273283840:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787829761.172532:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829761.172553:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829761/real 1787829761]  req@ffff9ee0056e8f00 x1874670273283840/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829786 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829761.172568:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8f00 x1874670273283840/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829786 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829761.172576:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829761.172578:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829761.172582:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273283840:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787829761.172587:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273283968:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787829761.172604:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829761.172612:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829761/real 1787829761]  req@ffff9ee0056eb840 x1874670273283968/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829786 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829761.172620:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb840 x1874670273283968/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829786 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829761.172625:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829761.172628:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829761.172630:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273283968:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787829761.172647:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273284096:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787829761.172657:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829761.172663:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829761/real 1787829761]  req@ffff9ee0056eb480 x1874670273284096/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829786 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829761.172671:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb480 x1874670273284096/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829786 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829761.172676:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829761.172677:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829761.172679:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273284096:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787829762.003480:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829762.195508:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829763.027452:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829763.219394:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829764.051533:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829764.243380:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829765.075460:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829765.267439:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829766.099473:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829766.291373:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787829766.291420:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829766.291425:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787829766.291429:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829766.291436:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4930
00000100:00080000:3.0:1787829766.291453:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829766.291461:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787829766.291499:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705680 x1874670273284224/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829766.291522:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829766.291525:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787829766.291526:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829766.291529:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4930
00000100:00080000:3.0:1787829766.291532:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829766.291535:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829766.291544:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787829766.291558:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707840 x1874670273284352/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787829766.291562:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273284224:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787829766.291578:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829766.291583:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787829766.291585:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829766.291590:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4930
00000100:00080000:3.0:1787829766.291594:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829766.291599:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829766.291604:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829766.291618:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706940 x1874670273284480/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829766.291630:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:1.0:1787829766.291633:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787829766.291635:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787829766.291639:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829766.291645:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4930
00000100:00080000:3.0:1787829766.291649:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829766.291652:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829766.291657:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829766.291666:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704000 x1874670273284608/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829766.291672:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829766.291675:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787829766.291676:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829766.291680:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4930
00000100:00080000:3.0:1787829766.291682:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829766.291687:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787829766.291689:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829766/real 1787829766]  req@ffff9ee005705680 x1874670273284224/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829791 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:3.0:1787829766.291691:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787829766.291702:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707480 x1874670273284736/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829766.291709:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829766.291713:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00100000:1.0:1787829766.291714:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705680 x1874670273284224/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829791 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829766.291715:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829766.291722:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4930
00000100:00080000:3.0:1787829766.291725:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829766.291731:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829766.291735:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:1.0:1787829766.291740:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:3.0:1787829766.291744:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057070c0 x1874670273284864/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829766.291750:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:3.0:1787829766.291754:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829766.291758:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:1.0:1787829766.291760:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273284224:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787829766.291761:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829766.291768:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4930
00000100:00080000:3.0:1787829766.291771:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829766.291774:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829766.291776:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829766.291782:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057052c0 x1874670273284992/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787829766.291792:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273284352:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787829766.291821:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829766.291836:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829766/real 1787829766]  req@ffff9ee005707840 x1874670273284352/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829791 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829766.291847:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707840 x1874670273284352/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829791 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829766.291853:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829766.291856:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829766.291858:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273284352:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787829766.291862:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273284480:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787829766.291880:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829766.291888:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829766/real 1787829766]  req@ffff9ee005706940 x1874670273284480/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829791 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829766.291899:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706940 x1874670273284480/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829791 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829766.291907:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829766.291910:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829766.291913:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273284480:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787829766.291917:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273284608:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787829766.291931:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829766.291938:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829766/real 1787829766]  req@ffff9ee005704000 x1874670273284608/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829791 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829766.291945:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704000 x1874670273284608/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829791 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829766.291953:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829766.291956:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829766.291959:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273284608:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787829766.291980:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273284736:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787829766.292000:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829766.292013:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829766/real 1787829766]  req@ffff9ee005707480 x1874670273284736/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829791 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829766.292030:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707480 x1874670273284736/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829791 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829766.292035:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829766.292037:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829766.292039:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273284736:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787829766.292043:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273284864:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787829766.292058:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829766.292065:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829766/real 1787829766]  req@ffff9ee0057070c0 x1874670273284864/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829791 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829766.292072:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057070c0 x1874670273284864/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829791 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829766.292076:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829766.292078:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829766.292080:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273284864:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787829766.292094:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273284992:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787829766.292104:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829766.292110:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829766/real 1787829766]  req@ffff9ee0057052c0 x1874670273284992/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829791 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829766.292117:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057052c0 x1874670273284992/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829791 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829766.292126:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829766.292128:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829766.292130:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273284992:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787829767.123499:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829767.315379:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829768.147449:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829768.339457:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829769.171512:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829769.363414:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829770.195454:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829770.387434:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829771.219449:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829771.411453:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:0.0:1787829771.411494:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829771.411504:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1787829771.411509:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829771.411519:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4935
00000100:00080000:0.0:1787829771.411531:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829771.411538:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787829771.411577:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e92c0 x1874670273285120/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829771.411606:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829771.411610:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787829771.411612:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829771.411615:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4935
00000100:00080000:0.0:1787829771.411619:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829771.411624:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829771.411634:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787829771.411647:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8b40 x1874670273285248/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787829771.411661:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273285120:192.168.203.121@tcp:250:kworker.0
00000100:00080000:0.0:1787829771.411665:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829771.411675:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787829771.411678:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829771.411683:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4935
00000100:00080000:0.0:1787829771.411687:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829771.411692:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829771.411698:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787829771.411710:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb0c0 x1874670273285376/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829771.411720:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829771.411723:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787829771.411724:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829771.411728:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4935
00000100:00080000:0.0:1787829771.411757:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829771.411763:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000800:00000100:1.0:1787829771.411769:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000008:00100000:0.0:1787829771.411775:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787829771.411803:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9a40 x1874670273285504/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829771.411816:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1787829771.411820:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829771/real 1787829771]  req@ffff9ee0056e92c0 x1874670273285120/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829796 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829771.411822:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787829771.411827:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829771.411840:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4935
00000100:00080000:0.0:1787829771.411850:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829771.411855:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787829771.411860:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e92c0 x1874670273285120/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829796 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:0.0:1787829771.411865:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00080000:1.0:1787829771.411875:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829771.411881:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829771.411886:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ea580 x1874670273285632/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787829771.411887:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273285120:192.168.203.121@tcp:250:kworker.0
00000100:00080000:0.0:1787829771.411911:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829771.411914:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787829771.411917:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829771.411922:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4935
00000100:00080000:0.0:1787829771.411924:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829771.411940:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829771.411946:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787829771.411955:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273285248:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787829771.411963:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9680 x1874670273285760/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829771.411977:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829771.411981:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787829771.411983:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829771.411988:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4935
00000100:00080000:0.0:1787829771.411992:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829771.411999:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000800:00000100:1.0:1787829771.411999:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000008:00100000:0.0:1787829771.412011:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787829771.412025:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8780 x1874670273285888/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787829771.412035:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829771/real 1787829771]  req@ffff9ee0056e8b40 x1874670273285248/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829796 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829771.412067:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8b40 x1874670273285248/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829796 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829771.412075:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829771.412079:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829771.412081:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273285248:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787829771.412087:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273285376:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787829771.412108:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829771.412118:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829771/real 1787829771]  req@ffff9ee0056eb0c0 x1874670273285376/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829796 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829771.412126:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb0c0 x1874670273285376/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829796 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829771.412131:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829771.412134:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829771.412136:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273285376:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787829771.412140:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273285504:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787829771.412151:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829771.412157:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829771/real 1787829771]  req@ffff9ee0056e9a40 x1874670273285504/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829796 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829771.412164:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9a40 x1874670273285504/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829796 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829771.412169:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829771.412171:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829771.412174:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273285504:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787829771.412177:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273285632:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787829771.412187:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829771.412193:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829771/real 1787829771]  req@ffff9ee0056ea580 x1874670273285632/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829796 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829771.412200:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ea580 x1874670273285632/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829796 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829771.412204:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829771.412206:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829771.412209:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273285632:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787829771.412224:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273285760:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787829771.412234:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829771.412241:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829771/real 1787829771]  req@ffff9ee0056e9680 x1874670273285760/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829796 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829771.412248:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9680 x1874670273285760/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829796 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829771.412253:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829771.412255:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829771.412257:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273285760:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787829771.412260:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273285888:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787829771.412273:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829771.412285:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829771/real 1787829771]  req@ffff9ee0056e8780 x1874670273285888/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829796 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829771.412298:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8780 x1874670273285888/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829796 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829771.412306:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829771.412310:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829771.412335:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273285888:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787829772.243469:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829772.435481:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829773.267523:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829773.459450:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829774.291513:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829774.483387:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829775.315458:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829775.507459:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829776.339514:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1787829776.531428:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829776.531438:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1787829776.531443:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1787829776.531446:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:0.0:1787829776.531456:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4940
00000100:00080000:0.0:1787829776.531468:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829776.531476:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787829776.531510:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ea940 x1874670273286016/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829776.531536:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829776.531540:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787829776.531542:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829776.531547:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4940
00000100:00080000:0.0:1787829776.531550:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829776.531554:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829776.531563:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787829776.531569:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273286016:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787829776.531577:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ead00 x1874670273286144/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829776.531591:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829776.531594:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787829776.531596:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829776.531600:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4940
00000100:00080000:0.0:1787829776.531603:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829776.531606:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829776.531611:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787829776.531623:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8780 x1874670273286272/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829776.531639:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829776.531642:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787829776.531644:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829776.531647:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4940
00000100:00080000:0.0:1787829776.531653:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000800:00000100:1.0:1787829776.531655:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:0.0:1787829776.531663:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829776.531669:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787829776.531683:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9680 x1874670273286400/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829776.531693:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829776.531696:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787829776.531698:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1787829776.531702:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829776/real 1787829776]  req@ffff9ee0056ea940 x1874670273286016/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829801 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829776.531704:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4940
00000100:00080000:0.0:1787829776.531713:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829776.531724:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829776.531730:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787829776.531731:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ea940 x1874670273286016/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829801 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829776.531744:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:0.0:1787829776.531749:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ea580 x1874670273286528/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829776.531752:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829776.531764:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273286016:192.168.203.121@tcp:250:kworker.0
00000100:00080000:0.0:1787829776.531784:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829776.531788:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787829776.531790:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829776.531794:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4940
00000100:00080000:0.0:1787829776.531799:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1787829776.531804:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273286144:192.168.203.121@tcp:38:kworker.0
00000100:00080000:0.0:1787829776.531807:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829776.531818:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787829776.531832:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9a40 x1874670273286656/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1787829776.531838:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:0.0:1787829776.531857:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1787829776.531857:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829776/real 1787829776]  req@ffff9ee0056ead00 x1874670273286144/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829801 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829776.531873:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787829776.531880:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829776.531890:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4940
00000100:00100000:1.0:1787829776.531906:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ead00 x1874670273286144/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829801 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829776.531916:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829776.531922:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829776.531925:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00080000:1.0:1787829776.531931:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000008:00100000:0.0:1787829776.531936:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787829776.531939:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273286144:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787829776.531950:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273286272:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829776.531960:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb0c0 x1874670273286784/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1787829776.531977:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829776.531989:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829776/real 1787829776]  req@ffff9ee0056e8780 x1874670273286272/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829801 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829776.531999:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8780 x1874670273286272/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829801 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829776.532005:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829776.532007:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829776.532009:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273286272:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787829776.532013:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273286400:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787829776.532031:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829776.532037:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829776/real 1787829776]  req@ffff9ee0056e9680 x1874670273286400/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829801 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829776.532044:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9680 x1874670273286400/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829801 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829776.532049:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829776.532051:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829776.532053:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273286400:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787829776.532056:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273286528:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787829776.532066:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829776.532071:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829776/real 1787829776]  req@ffff9ee0056ea580 x1874670273286528/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829801 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829776.532077:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ea580 x1874670273286528/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829801 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829776.532082:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829776.532083:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829776.532085:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273286528:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787829776.532097:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273286656:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787829776.532106:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829776.532112:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829776/real 1787829776]  req@ffff9ee0056e9a40 x1874670273286656/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829801 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829776.532118:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9a40 x1874670273286656/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829801 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829776.532122:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829776.532124:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829776.532126:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273286656:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787829776.532130:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273286784:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787829776.532139:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829776.532144:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829776/real 1787829776]  req@ffff9ee0056eb0c0 x1874670273286784/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829801 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829776.532150:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb0c0 x1874670273286784/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829801 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829776.532155:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829776.532156:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829776.532158:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273286784:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787829777.363518:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829777.555410:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829778.387511:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829778.579426:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829779.411509:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829779.603429:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829780.435481:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829780.627435:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829781.459513:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829781.651414:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787829781.651414:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829781.651425:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787829781.651430:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829781.651439:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4945
00000100:00080000:3.0:1787829781.651450:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829781.651458:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787829781.651502:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057061c0 x1874670273286912/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829781.651527:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829781.651530:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787829781.651532:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829781.651536:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4945
00000100:00080000:3.0:1787829781.651540:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829781.651545:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787829781.651555:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273286912:192.168.203.121@tcp:250:kworker.0
00000008:00100000:3.0:1787829781.651564:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787829781.651579:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707c00 x1874670273287040/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829781.651589:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829781.651599:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787829781.651601:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829781.651605:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4945
00000100:00080000:3.0:1787829781.651610:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829781.651615:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829781.651620:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829781.651632:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057052c0 x1874670273287168/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829781.651640:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829781.651642:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787829781.651644:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829781.651647:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4945
00000100:00080000:3.0:1787829781.651651:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829781.651654:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829781.651658:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787829781.651665:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273287040:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787829781.651670:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057070c0 x1874670273287296/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829781.651681:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829781.651684:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787829781.651686:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829781.651691:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4945
00000100:00080000:3.0:1787829781.651697:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829781.651704:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787829781.651707:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273287168:192.168.203.121@tcp:8:kworker.0
00000008:00100000:3.0:1787829781.651712:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787829781.651733:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707480 x1874670273287424/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787829781.651739:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273287296:192.168.203.121@tcp:8:kworker.0
00000100:00080000:3.0:1787829781.651743:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829781.651747:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787829781.651748:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829781.651752:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4945
00000100:00080000:3.0:1787829781.651755:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829781.651758:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787829781.651762:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273287424:192.168.203.121@tcp:38:kworker.0
00000008:00100000:3.0:1787829781.651763:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829781.651778:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704000 x1874670273287552/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829781.651791:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1787829781.651795:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273287552:192.168.203.121@tcp:8:kworker.0
00000100:00080000:3.0:1787829781.651795:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787829781.651797:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829781.651808:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4945
00000100:00080000:3.0:1787829781.651811:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829781.651814:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829781.651821:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829781.651829:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706940 x1874670273287680/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787829781.651853:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273287680:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787829782.483478:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829782.675433:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829783.507492:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829783.699405:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829784.531436:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829784.723426:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000400:00000100:1.0:1787829784.723683:0:2354:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.203.121:988
00000400:00000100:1.0:1787829784.723720:0:2354:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.203.121@tcp at host 192.168.203.121 was unreachable: the network or that node may be down, or Lustre may be misconfigured.
00000800:00000100:1.0:1787829784.723736:0:2354:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:1.0:1787829784.723769:0:2354:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:1.0:1787829784.723776:0:2354:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:1.0:1787829784.723785:0:2354:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:1.0:1787829784.723794:0:2354:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:1.0:1787829784.723804:0:2354:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000100:00100000:2.0:1787829784.723809:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829781/real 1787829784]  req@ffff9ee0057070c0 x1874670273287296/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829806 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000800:00000100:1.0:1787829784.723814:0:2354:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000100:00100000:2.0:1787829784.723849:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057070c0 x1874670273287296/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829806 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829784.723862:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829784.723867:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829784.723872:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273287296:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787829784.723879:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829781/real 1787829784]  req@ffff9ee005707c00 x1874670273287040/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829806 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829784.723893:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707c00 x1874670273287040/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829806 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829784.723900:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829784.723903:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829784.723906:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273287040:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787829784.723912:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829781/real 1787829784]  req@ffff9ee0057052c0 x1874670273287168/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829806 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829784.723924:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057052c0 x1874670273287168/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829806 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829784.723931:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829784.723934:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829784.723937:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273287168:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787829784.723943:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829781/real 1787829784]  req@ffff9ee0057061c0 x1874670273286912/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829806 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829784.723955:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057061c0 x1874670273286912/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829806 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829784.723961:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829784.723964:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829784.723967:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273286912:192.168.203.121@tcp:250:kworker.0
00000100:00100000:2.0:1787829784.723991:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829781/real 1787829784]  req@ffff9ee005706940 x1874670273287680/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829806 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829784.724003:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706940 x1874670273287680/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829806 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829784.724011:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829784.724014:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829784.724017:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273287680:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787829784.724024:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829781/real 1787829784]  req@ffff9ee005704000 x1874670273287552/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829806 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829784.724036:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704000 x1874670273287552/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829806 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829784.724042:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829784.724046:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829784.724049:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273287552:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787829784.724149:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829781/real 1787829784]  req@ffff9ee005707480 x1874670273287424/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829806 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829784.724165:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707480 x1874670273287424/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829806 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829784.724172:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829784.724175:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829784.724179:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273287424:192.168.203.121@tcp:38:kworker.0
00010000:00010000:0.0:1787829785.555490:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829785.747397:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829786.579495:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1787829786.771424:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1787829786.771431:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:2.0:1787829786.771433:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787829786.771438:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829786.771447:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4950
00000100:00080000:2.0:1787829786.771457:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829786.771463:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787829786.771494:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729e00 x1874670273287808/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829786.771517:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829786.771521:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787829786.771523:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829786.771527:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4950
00000100:00080000:2.0:1787829786.771530:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829786.771534:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829786.771544:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787829786.771558:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a940 x1874670273287936/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787829786.771567:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273287808:192.168.203.121@tcp:250:kworker.0
00000100:00080000:2.0:1787829786.771575:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829786.771579:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787829786.771580:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829786.771584:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4950
00000100:00080000:2.0:1787829786.771586:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829786.771590:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829786.771595:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787829786.771610:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057292c0 x1874670273288064/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829786.771620:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829786.771623:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787829786.771627:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829786.771631:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4950
00000100:00080000:2.0:1787829786.771635:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000800:00000100:1.0:1787829786.771640:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:2.0:1787829786.771642:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829786.771649:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787829786.771663:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728780 x1874670273288192/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829786.771672:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829786.771675:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787829786.771677:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829786.771681:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4950
00000100:00080000:2.0:1787829786.771685:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829786.771689:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829786.771696:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787829786.771697:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829786/real 1787829786]  req@ffff9ee005729e00 x1874670273287808/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829811 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829786.771712:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a580 x1874670273288320/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787829786.771722:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729e00 x1874670273287808/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829811 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829786.771725:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829786.771735:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787829786.771740:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829786.771745:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829786.771746:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4950
00000100:00080000:2.0:1787829786.771754:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829786.771755:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:2.0:1787829786.771761:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787829786.771764:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273287808:192.168.203.121@tcp:250:kworker.0
00000008:00100000:2.0:1787829786.771768:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787829786.771783:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572bc00 x1874670273288448/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829786.771792:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829786.771795:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787829786.771798:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1787829786.771799:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273287936:192.168.203.121@tcp:38:kworker.0
00000100:00080000:2.0:1787829786.771806:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4950
00000100:00080000:2.0:1787829786.771811:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829786.771815:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829786.771835:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1787829786.771853:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829786.771853:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057283c0 x1874670273288576/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787829786.771891:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829786/real 1787829786]  req@ffff9ee00572a940 x1874670273287936/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829811 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829786.771905:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a940 x1874670273287936/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829811 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829786.771914:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829786.771917:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829786.771921:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273287936:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787829786.771928:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057292c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273288064:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787829786.771951:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829786.771963:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829786/real 1787829786]  req@ffff9ee0057292c0 x1874670273288064/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829811 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829786.771975:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057292c0 x1874670273288064/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829811 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829786.771983:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829786.771986:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829786.771989:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057292c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273288064:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787829786.771996:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273288192:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787829786.772015:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829786.772026:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829786/real 1787829786]  req@ffff9ee005728780 x1874670273288192/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829811 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829786.772037:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728780 x1874670273288192/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829811 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829786.772045:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829786.772047:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829786.772051:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273288192:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787829786.772056:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273288320:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787829786.772077:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829786.772087:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829786/real 1787829786]  req@ffff9ee00572a580 x1874670273288320/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829811 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829786.772099:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a580 x1874670273288320/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829811 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829786.772107:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829786.772109:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829786.772112:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273288320:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787829786.772118:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273288448:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787829786.772138:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829786.772149:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829786/real 1787829786]  req@ffff9ee00572bc00 x1874670273288448/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829811 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829786.772163:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572bc00 x1874670273288448/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829811 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829786.772170:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829786.772173:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829786.772176:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273288448:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787829786.772197:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273288576:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787829786.772223:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829786.772235:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829786/real 1787829786]  req@ffff9ee0057283c0 x1874670273288576/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829811 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829786.772246:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057283c0 x1874670273288576/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829811 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829786.772253:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829786.772256:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829786.772259:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273288576:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787829787.603459:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787829787.795428:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829788.627490:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787829788.819414:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829789.651511:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787829789.843468:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829790.675466:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787829790.867385:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829791.699509:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1787829791.891439:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829791.891447:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787829791.891452:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829791.891460:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4955
00000100:00100000:1.0:1787829791.891468:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:2.0:1787829791.891469:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829791.891480:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787829791.891509:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728000 x1874670273288704/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829791.891536:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829791.891539:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787829791.891540:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829791.891543:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4955
00000100:00080000:2.0:1787829791.891546:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829791.891549:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829791.891556:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787829791.891568:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273288704:192.168.203.121@tcp:250:kworker.0
00000100:00100000:2.0:1787829791.891569:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a1c0 x1874670273288832/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829791.891584:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829791.891586:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787829791.891587:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829791.891591:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4955
00000100:00080000:2.0:1787829791.891594:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829791.891597:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829791.891600:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787829791.891611:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729680 x1874670273288960/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829791.891618:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829791.891620:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787829791.891621:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829791.891625:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4955
00000100:00080000:2.0:1787829791.891629:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829791.891632:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829791.891636:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:3.0:1787829791.891644:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829791.891646:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728b40 x1874670273289088/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829791.891654:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829791.891657:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787829791.891659:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829791.891662:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4955
00000100:00080000:2.0:1787829791.891665:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829791.891667:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829791.891670:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787829791.891677:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728f00 x1874670273289216/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829791.891683:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829791.891685:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787829791.891686:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829791.891689:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4955
00000100:00080000:2.0:1787829791.891691:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829791.891693:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829791.891696:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787829791.891703:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b840 x1874670273289344/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829791.891713:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829791.891715:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787829791.891717:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829791.891719:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4955
00000100:00080000:2.0:1787829791.891721:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829791.891723:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829791.891725:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787829791.891731:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729a40 x1874670273289472/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787829791.891744:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829791/real 1787829791]  req@ffff9ee005728000 x1874670273288704/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829816 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829791.891759:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728000 x1874670273288704/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829816 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829791.891772:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829791.891775:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829791.891779:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273288704:192.168.203.121@tcp:250:kworker.0
00000100:00100000:3.0:1787829791.891917:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273288832:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787829791.891976:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829791.891997:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829791/real 1787829791]  req@ffff9ee00572a1c0 x1874670273288832/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829816 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829791.892023:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a1c0 x1874670273288832/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829816 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829791.892033:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829791.892037:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829791.892040:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273288832:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787829791.892046:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273288960:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829791.892064:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829791.892072:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829791/real 1787829791]  req@ffff9ee005729680 x1874670273288960/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829816 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829791.892080:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729680 x1874670273288960/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829816 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829791.892086:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829791.892088:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829791.892090:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273288960:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829791.892095:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273289088:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829791.892113:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829791.892124:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829791/real 1787829791]  req@ffff9ee005728b40 x1874670273289088/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829816 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829791.892137:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728b40 x1874670273289088/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829816 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829791.892146:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829791.892149:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829791.892152:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273289088:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829791.892157:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273289216:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787829791.892172:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829791.892180:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829791/real 1787829791]  req@ffff9ee005728f00 x1874670273289216/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829816 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829791.892191:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728f00 x1874670273289216/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829816 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829791.892199:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829791.892203:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829791.892206:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273289216:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787829791.892212:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273289344:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829791.892234:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829791.892244:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829791/real 1787829791]  req@ffff9ee00572b840 x1874670273289344/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829816 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829791.892252:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b840 x1874670273289344/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829816 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829791.892258:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829791.892260:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829791.892262:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273289344:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829791.892265:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273289472:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829791.892278:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829791.892285:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829791/real 1787829791]  req@ffff9ee005729a40 x1874670273289472/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829816 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829791.892296:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729a40 x1874670273289472/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829816 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829791.892304:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829791.892308:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829791.892311:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273289472:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787829792.723492:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829792.915437:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829793.747505:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829793.939395:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829794.771510:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829794.963461:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829795.795515:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829795.987409:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829796.819515:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829797.011409:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:0.0:1787829797.011433:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829797.011439:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1787829797.011443:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829797.011452:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4960
00000100:00080000:0.0:1787829797.011467:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829797.011474:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787829797.011503:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8b40 x1874670273289600/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829797.011523:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829797.011526:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787829797.011527:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829797.011530:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4960
00000100:00080000:0.0:1787829797.011532:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829797.011535:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829797.011542:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787829797.011550:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e92c0 x1874670273289728/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829797.011559:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829797.011562:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787829797.011564:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1787829797.011566:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273289600:192.168.203.121@tcp:250:kworker.0
00000100:00080000:0.0:1787829797.011569:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4960
00000100:00080000:0.0:1787829797.011575:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829797.011578:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829797.011581:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787829797.011589:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb480 x1874670273289856/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829797.011596:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829797.011599:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787829797.011600:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829797.011603:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4960
00000100:00080000:0.0:1787829797.011606:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829797.011609:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829797.011611:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787829797.011618:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb840 x1874670273289984/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829797.011624:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:3.0:1787829797.011628:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:0.0:1787829797.011629:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787829797.011633:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829797.011637:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4960
00000100:00080000:0.0:1787829797.011640:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829797.011643:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829797.011646:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787829797.011670:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8f00 x1874670273290112/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829797.011677:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829797.011679:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787829797.011683:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1787829797.011684:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829797/real 1787829797]  req@ffff9ee0056e8b40 x1874670273289600/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829822 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829797.011691:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4960
00000100:00080000:0.0:1787829797.011699:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829797.011704:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787829797.011708:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8b40 x1874670273289600/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829822 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:0.0:1787829797.011711:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:3.0:1787829797.011724:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:0.0:1787829797.011725:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e83c0 x1874670273290240/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829797.011730:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829797.011738:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273289600:192.168.203.121@tcp:250:kworker.0
00000100:00080000:0.0:1787829797.011742:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829797.011746:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787829797.011747:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829797.011763:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4960
00000100:00080000:0.0:1787829797.011767:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829797.011769:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829797.011790:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829797.011798:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273289728:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787829797.011803:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ebc00 x1874670273290368/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1787829797.011824:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829797.011835:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829797/real 1787829797]  req@ffff9ee0056e92c0 x1874670273289728/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829822 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829797.011844:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e92c0 x1874670273289728/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829822 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829797.011850:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829797.011852:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829797.011854:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273289728:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787829797.011858:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273289856:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829797.011870:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829797.011876:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829797/real 1787829797]  req@ffff9ee0056eb480 x1874670273289856/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829822 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829797.011884:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb480 x1874670273289856/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829822 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829797.011889:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829797.011891:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829797.011893:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273289856:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829797.011897:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273289984:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829797.011907:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829797.011912:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829797/real 1787829797]  req@ffff9ee0056eb840 x1874670273289984/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829822 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829797.011919:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb840 x1874670273289984/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829822 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829797.011924:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829797.011926:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829797.011928:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273289984:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829797.011933:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273290112:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787829797.011958:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829797.011971:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829797/real 1787829797]  req@ffff9ee0056e8f00 x1874670273290112/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829822 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829797.011984:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8f00 x1874670273290112/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829822 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829797.011990:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829797.011992:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829797.011994:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273290112:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787829797.011998:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273290240:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829797.012013:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829797.012021:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829797/real 1787829797]  req@ffff9ee0056e83c0 x1874670273290240/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829822 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829797.012029:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e83c0 x1874670273290240/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829822 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829797.012034:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829797.012036:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829797.012038:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273290240:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829797.012051:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273290368:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829797.012068:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829797.012075:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829797/real 1787829797]  req@ffff9ee0056ebc00 x1874670273290368/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829822 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829797.012082:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ebc00 x1874670273290368/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829822 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829797.012088:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829797.012090:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829797.012092:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273290368:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787829797.843529:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829798.035411:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829798.867512:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829799.059397:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829799.891458:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829800.083412:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829800.915491:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829801.107389:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829801.939452:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1787829802.131409:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1787829802.131418:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:1.0:1787829802.131421:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1787829802.131427:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829802.131438:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4965
00000100:00080000:1.0:1787829802.131450:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829802.131456:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787829802.131487:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0000 x1874670273290496/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829802.131510:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829802.131514:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787829802.131516:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829802.131520:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4965
00000100:00080000:1.0:1787829802.131523:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829802.131527:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829802.131537:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787829802.131549:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a3c00 x1874670273290624/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829802.131560:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829802.131564:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787829802.131566:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1787829802.131567:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273290496:192.168.203.121@tcp:250:kworker.0
00000100:00080000:1.0:1787829802.131569:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4965
00000100:00080000:1.0:1787829802.131573:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829802.131577:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829802.131582:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787829802.131590:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a2940 x1874670273290752/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829802.131598:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829802.131601:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787829802.131604:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829802.131607:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4965
00000100:00080000:1.0:1787829802.131610:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829802.131613:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829802.131617:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787829802.131625:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a21c0 x1874670273290880/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1787829802.131627:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:1.0:1787829802.131633:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829802.131636:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787829802.131637:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829802.131641:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4965
00000100:00080000:1.0:1787829802.131652:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829802.131657:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829802.131661:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787829802.131671:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1680 x1874670273291008/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787829802.131671:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829802/real 1787829802]  req@ffff9ee0056a0000 x1874670273290496/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829827 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829802.131682:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829802.131685:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787829802.131686:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1787829802.131689:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0000 x1874670273290496/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829827 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829802.131690:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4965
00000100:00080000:1.0:1787829802.131693:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829802.131697:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00080000:3.0:1787829802.131700:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000008:00100000:1.0:1787829802.131701:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:3.0:1787829802.131704:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829802.131708:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273290496:192.168.203.121@tcp:250:kworker.0
00000100:00100000:1.0:1787829802.131709:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a03c0 x1874670273291136/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829802.131731:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829802.131734:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787829802.131736:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829802.131739:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4965
00000100:00080000:1.0:1787829802.131743:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1787829802.131743:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273290624:192.168.203.121@tcp:38:kworker.0
00000100:00080000:1.0:1787829802.131747:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829802.131751:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787829802.131761:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1a40 x1874670273291264/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1787829802.131774:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829802.131787:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829802/real 1787829802]  req@ffff9ee0056a3c00 x1874670273290624/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829827 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829802.131801:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a3c00 x1874670273290624/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829827 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829802.131810:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829802.131812:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829802.131814:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273290624:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787829802.131819:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273290752:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829802.131835:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829802.131842:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829802/real 1787829802]  req@ffff9ee0056a2940 x1874670273290752/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829827 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829802.131850:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a2940 x1874670273290752/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829827 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829802.131855:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829802.131857:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829802.131859:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273290752:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829802.131863:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273290880:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829802.131872:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829802.131878:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829802/real 1787829802]  req@ffff9ee0056a21c0 x1874670273290880/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829827 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829802.131885:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a21c0 x1874670273290880/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829827 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829802.131890:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829802.131891:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829802.131893:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273290880:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829802.131896:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273291008:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787829802.131905:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829802.131911:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829802/real 1787829802]  req@ffff9ee0056a1680 x1874670273291008/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829827 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829802.131920:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1680 x1874670273291008/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829827 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829802.131928:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829802.131931:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829802.131935:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273291008:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787829802.131941:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273291136:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829802.131960:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829802.131972:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829802/real 1787829802]  req@ffff9ee0056a03c0 x1874670273291136/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829827 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829802.131982:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a03c0 x1874670273291136/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829827 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829802.131987:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829802.131989:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829802.131991:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273291136:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829802.132006:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273291264:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829802.132020:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829802.132026:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829802/real 1787829802]  req@ffff9ee0056a1a40 x1874670273291264/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829827 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829802.132033:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1a40 x1874670273291264/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829827 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829802.132038:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829802.132041:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829802.132042:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273291264:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787829802.963501:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787829803.155405:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829803.987489:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787829804.179413:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829805.011477:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787829805.203382:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829806.035503:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787829806.227416:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829807.059511:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1787829807.251443:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1787829807.251446:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:2.0:1787829807.251451:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787829807.251456:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829807.251465:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4970
00000100:00080000:2.0:1787829807.251477:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829807.251484:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787829807.251521:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572ad00 x1874670273291392/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829807.251545:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829807.251549:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787829807.251550:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829807.251557:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4970
00000100:00080000:2.0:1787829807.251561:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829807.251566:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829807.251576:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787829807.251580:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273291392:192.168.203.121@tcp:250:kworker.0
00000100:00100000:2.0:1787829807.251588:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b480 x1874670273291520/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829807.251598:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829807.251600:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787829807.251602:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829807.251605:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4970
00000100:00080000:2.0:1787829807.251608:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829807.251612:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829807.251616:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787829807.251625:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b0c0 x1874670273291648/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829807.251633:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829807.251635:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787829807.251637:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:3.0:1787829807.251639:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:2.0:1787829807.251641:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4970
00000100:00080000:2.0:1787829807.251643:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829807.251646:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829807.251650:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787829807.251660:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729a40 x1874670273291776/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829807.251668:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829807.251671:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787829807.251673:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829807.251676:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4970
00000100:00100000:3.0:1787829807.251677:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829807/real 1787829807]  req@ffff9ee00572ad00 x1874670273291392/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829832 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829807.251699:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829807.251704:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829807.251708:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787829807.251716:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572ad00 x1874670273291392/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829832 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829807.251719:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b840 x1874670273291904/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829807.251728:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829807.251728:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829807.251732:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787829807.251732:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:2.0:1787829807.251734:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1787829807.251736:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273291392:192.168.203.121@tcp:250:kworker.0
00000100:00080000:2.0:1787829807.251737:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4970
00000100:00080000:2.0:1787829807.251741:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829807.251744:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829807.251748:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787829807.251756:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728f00 x1874670273292032/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787829807.251758:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273291520:192.168.203.121@tcp:38:kworker.0
00000100:00080000:2.0:1787829807.251767:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829807.251770:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787829807.251771:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829807.251775:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4970
00000800:00000100:3.0:1787829807.251779:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:2.0:1787829807.251787:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1787829807.251792:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829807/real 1787829807]  req@ffff9ee00572b480 x1874670273291520/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829832 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829807.251795:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829807.251800:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829807.251805:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b480 x1874670273291520/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829832 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829807.251810:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728b40 x1874670273292160/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829807.251814:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829807.251817:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829807.251820:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273291520:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787829807.251826:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273291648:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829807.251848:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829807.251860:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829807/real 1787829807]  req@ffff9ee00572b0c0 x1874670273291648/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829832 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829807.251870:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b0c0 x1874670273291648/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829832 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829807.251880:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829807.251882:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829807.251884:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273291648:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829807.251888:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273291776:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829807.251902:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829807.251908:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829807/real 1787829807]  req@ffff9ee005729a40 x1874670273291776/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829832 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829807.251916:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729a40 x1874670273291776/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829832 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829807.251921:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829807.251922:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829807.251924:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273291776:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829807.251928:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273291904:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787829807.251938:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829807.251944:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829807/real 1787829807]  req@ffff9ee00572b840 x1874670273291904/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829832 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829807.251951:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b840 x1874670273291904/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829832 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829807.251956:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829807.251957:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829807.251960:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273291904:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787829807.251971:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273292032:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829807.251982:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829807.251988:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829807/real 1787829807]  req@ffff9ee005728f00 x1874670273292032/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829832 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829807.251995:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728f00 x1874670273292032/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829832 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829807.252000:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829807.252001:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829807.252003:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273292032:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829807.252006:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273292160:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829807.252016:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829807.252021:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829807/real 1787829807]  req@ffff9ee005728b40 x1874670273292160/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829832 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829807.252028:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728b40 x1874670273292160/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829832 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829807.252033:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829807.252034:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829807.252036:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273292160:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787829808.083455:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787829808.275423:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829809.107498:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787829809.299412:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829810.131501:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787829810.323394:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829811.155450:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787829811.347418:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829812.179497:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787829812.371417:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:1.0:1787829812.371444:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829812.371452:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1787829812.371456:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829812.371465:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4976
00000100:00080000:1.0:1787829812.371476:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829812.371484:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787829812.371520:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a12c0 x1874670273292288/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829812.371548:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829812.371552:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787829812.371554:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829812.371559:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4976
00000100:00080000:1.0:1787829812.371564:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829812.371570:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787829812.371578:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273292288:192.168.203.121@tcp:250:kworker.0
00000008:00100000:1.0:1787829812.371591:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787829812.371610:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1a40 x1874670273292416/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829812.371624:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829812.371628:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787829812.371630:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829812.371635:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4976
00000100:00080000:1.0:1787829812.371640:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000800:00000100:3.0:1787829812.371657:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:1.0:1787829812.371663:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829812.371671:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787829812.371684:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a03c0 x1874670273292544/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829812.371692:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829812.371694:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787829812.371696:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829812.371699:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4976
00000100:00080000:1.0:1787829812.371702:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1787829812.371703:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829812/real 1787829812]  req@ffff9ee0056a12c0 x1874670273292288/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829837 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829812.371707:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829812.371714:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787829812.371727:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1680 x1874670273292672/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787829812.371731:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a12c0 x1874670273292288/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829837 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829812.371739:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829812.371747:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787829812.371749:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829812.371751:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829812.371754:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4976
00000100:00080000:1.0:1787829812.371757:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829812.371758:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:1.0:1787829812.371764:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787829812.371765:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273292288:192.168.203.121@tcp:250:kworker.0
00000008:00100000:1.0:1787829812.371769:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787829812.371778:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a21c0 x1874670273292800/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829812.371784:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829812.371787:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00100000:3.0:1787829812.371789:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273292416:192.168.203.121@tcp:38:kworker.0
00000100:00080000:1.0:1787829812.371790:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829812.371798:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4976
00000100:00080000:1.0:1787829812.371801:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829812.371803:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829812.371807:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787829812.371819:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a2940 x1874670273292928/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1787829812.371819:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:1.0:1787829812.371829:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1787829812.371833:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829812/real 1787829812]  req@ffff9ee0056a1a40 x1874670273292416/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829837 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829812.371834:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787829812.371837:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829812.371844:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4976
00000100:00080000:1.0:1787829812.371849:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829812.371854:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787829812.371859:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1a40 x1874670273292416/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829837 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:1.0:1787829812.371860:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:3.0:1787829812.371871:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:1.0:1787829812.371872:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a3c00 x1874670273293056/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829812.371879:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829812.371886:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273292416:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787829812.371894:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273292544:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829812.371907:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829812.371914:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829812/real 1787829812]  req@ffff9ee0056a03c0 x1874670273292544/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829837 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829812.371921:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a03c0 x1874670273292544/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829837 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829812.371926:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829812.371928:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829812.371930:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273292544:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829812.371933:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273292672:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829812.371943:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829812.371948:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829812/real 1787829812]  req@ffff9ee0056a1680 x1874670273292672/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829837 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829812.371955:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1680 x1874670273292672/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829837 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829812.371960:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829812.371961:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829812.371963:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273292672:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829812.371967:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273292800:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787829812.371976:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829812.371981:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829812/real 1787829812]  req@ffff9ee0056a21c0 x1874670273292800/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829837 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829812.371989:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a21c0 x1874670273292800/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829837 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829812.371994:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829812.372003:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829812.372005:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273292800:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787829812.372017:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273292928:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829812.372028:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829812.372034:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829812/real 1787829812]  req@ffff9ee0056a2940 x1874670273292928/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829837 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829812.372042:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a2940 x1874670273292928/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829837 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829812.372046:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829812.372049:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829812.372050:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273292928:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829812.372054:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273293056:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829812.372063:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829812.372068:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829812/real 1787829812]  req@ffff9ee0056a3c00 x1874670273293056/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829837 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829812.372075:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a3c00 x1874670273293056/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829837 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829812.372084:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829812.372087:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829812.372089:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273293056:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787829813.203466:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787829813.395406:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829814.227560:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787829814.419406:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829815.251574:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787829815.443388:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829816.275488:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787829816.467382:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829817.299521:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787829817.491452:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787829817.491457:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829817.491465:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787829817.491469:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829817.491483:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4981
00000100:00080000:3.0:1787829817.491496:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829817.491503:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787829817.491543:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707840 x1874670273293184/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829817.491569:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829817.491573:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787829817.491575:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829817.491580:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4981
00000100:00080000:3.0:1787829817.491586:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829817.491592:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829817.491619:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787829817.491628:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273293184:192.168.203.121@tcp:250:kworker.0
00000100:00100000:3.0:1787829817.491638:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705680 x1874670273293312/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829817.491648:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829817.491651:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787829817.491653:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829817.491657:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4981
00000100:00080000:3.0:1787829817.491660:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829817.491664:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829817.491670:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829817.491677:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704780 x1874670273293440/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829817.491684:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829817.491687:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787829817.491690:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829817.491693:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4981
00000100:00080000:3.0:1787829817.491698:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000800:00000100:1.0:1787829817.491700:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787829817.491705:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829817.491708:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829817.491716:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057043c0 x1874670273293568/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829817.491723:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829817.491726:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787829817.491727:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829817.491733:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4981
00000100:00080000:3.0:1787829817.491744:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829817.491749:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829817.491755:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787829817.491773:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705a40 x1874670273293696/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787829817.491774:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829817/real 1787829817]  req@ffff9ee005707840 x1874670273293184/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829842 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829817.491813:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829817.491819:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787829817.491821:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1787829817.491829:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707840 x1874670273293184/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829842 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829817.491835:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4981
00000100:00080000:3.0:1787829817.491848:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829817.491850:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829817.491857:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:3.0:1787829817.491857:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787829817.491868:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273293184:192.168.203.121@tcp:250:kworker.0
00000008:00100000:3.0:1787829817.491880:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787829817.491891:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273293312:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787829817.491901:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704b40 x1874670273293824/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1787829817.491916:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787829817.491917:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829817.491921:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787829817.491924:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829817.491930:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4981
00000100:00080000:3.0:1787829817.491935:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829817.491940:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787829817.491942:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829817/real 1787829817]  req@ffff9ee005705680 x1874670273293312/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829842 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:3.0:1787829817.491946:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829817.491962:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706580 x1874670273293952/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787829817.491971:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705680 x1874670273293312/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829842 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829817.491992:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829817.491995:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829817.491998:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273293312:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787829817.492004:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273293440:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787829817.492024:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829817.492034:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829817/real 1787829817]  req@ffff9ee005704780 x1874670273293440/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829842 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829817.492047:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704780 x1874670273293440/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829842 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829817.492063:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829817.492067:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829817.492071:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273293440:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787829817.492079:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273293568:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787829817.492099:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829817.492109:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829817/real 1787829817]  req@ffff9ee0057043c0 x1874670273293568/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829842 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829817.492121:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057043c0 x1874670273293568/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829842 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829817.492130:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829817.492134:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829817.492137:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273293568:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787829817.492144:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273293696:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787829817.492165:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829817.492174:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829817/real 1787829817]  req@ffff9ee005705a40 x1874670273293696/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829842 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829817.492187:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705a40 x1874670273293696/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829842 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829817.492192:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829817.492194:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829817.492196:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273293696:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787829817.492210:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273293824:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787829817.492223:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829817.492229:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829817/real 1787829817]  req@ffff9ee005704b40 x1874670273293824/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829842 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829817.492238:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704b40 x1874670273293824/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829842 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829817.492246:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829817.492250:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829817.492253:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273293824:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787829817.492259:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273293952:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787829817.492280:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829817.492292:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829817/real 1787829817]  req@ffff9ee005706580 x1874670273293952/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829842 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829817.492302:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706580 x1874670273293952/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829842 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829817.492311:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829817.492338:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829817.492342:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273293952:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787829818.323528:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787829818.515438:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829819.347504:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787829819.539412:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829820.371487:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787829820.563449:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829821.395496:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787829821.588656:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829822.419494:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1787829822.611398:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1787829822.611399:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:0.0:1787829822.611407:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1787829822.611410:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829822.611419:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4986
00000100:00080000:0.0:1787829822.611428:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829822.611435:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787829822.611468:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8000 x1874670273294080/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829822.611491:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829822.611495:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787829822.611496:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829822.611500:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4986
00000100:00080000:0.0:1787829822.611503:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829822.611506:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829822.611514:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787829822.611524:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9e00 x1874670273294208/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829822.611531:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829822.611535:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787829822.611537:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1787829822.611537:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273294080:192.168.203.121@tcp:250:kworker.0
00000100:00080000:0.0:1787829822.611544:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4986
00000100:00080000:0.0:1787829822.611548:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829822.611550:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829822.611553:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787829822.611562:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ebc00 x1874670273294336/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829822.611567:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829822.611569:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787829822.611570:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829822.611582:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4986
00000100:00080000:0.0:1787829822.611596:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829822.611599:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829822.611602:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1787829822.611607:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829822.611612:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e83c0 x1874670273294464/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829822.611619:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829822.611622:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787829822.611623:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829822.611626:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4986
00000100:00080000:0.0:1787829822.611628:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829822.611630:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829822.611633:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787829822.611641:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8f00 x1874670273294592/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787829822.611646:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829822/real 1787829822]  req@ffff9ee0056e8000 x1874670273294080/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829847 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829822.611649:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829822.611654:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787829822.611657:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829822.611663:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4986
00000100:00080000:0.0:1787829822.611666:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829822.611669:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829822.611671:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787829822.611675:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8000 x1874670273294080/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829847 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829822.611679:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb840 x1874670273294720/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829822.611698:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829822.611699:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829822.611701:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787829822.611703:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829822.611708:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4986
00000100:00080000:1.0:1787829822.611708:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:0.0:1787829822.611712:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829822.611717:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787829822.611718:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273294080:192.168.203.121@tcp:250:kworker.0
00000008:00100000:0.0:1787829822.611720:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787829822.611729:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb480 x1874670273294848/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787829822.611744:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273294208:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787829822.611765:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829822.611775:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829822/real 1787829822]  req@ffff9ee0056e9e00 x1874670273294208/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829847 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829822.611786:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9e00 x1874670273294208/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829847 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829822.611793:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829822.611796:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829822.611800:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273294208:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787829822.611806:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273294336:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787829822.611821:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829822.611829:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829822/real 1787829822]  req@ffff9ee0056ebc00 x1874670273294336/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829847 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829822.611839:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ebc00 x1874670273294336/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829847 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829822.611846:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829822.611849:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829822.611852:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273294336:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787829822.611857:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273294464:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787829822.611870:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829822.611878:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829822/real 1787829822]  req@ffff9ee0056e83c0 x1874670273294464/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829847 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829822.611888:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e83c0 x1874670273294464/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829847 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829822.611895:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829822.611898:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829822.611901:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273294464:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787829822.611906:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273294592:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787829822.611918:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829822.611926:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829822/real 1787829822]  req@ffff9ee0056e8f00 x1874670273294592/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829847 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829822.611937:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8f00 x1874670273294592/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829847 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829822.611945:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829822.611948:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829822.611950:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273294592:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787829822.611956:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273294720:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787829822.611971:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829822.611993:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829822/real 1787829822]  req@ffff9ee0056eb840 x1874670273294720/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829847 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829822.612004:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb840 x1874670273294720/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829847 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829822.612012:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829822.612015:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829822.612017:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273294720:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787829822.612022:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273294848:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787829822.612037:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829822.612045:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829822/real 1787829822]  req@ffff9ee0056eb480 x1874670273294848/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829847 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829822.612054:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb480 x1874670273294848/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829847 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829822.612068:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829822.612071:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829822.612073:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273294848:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787829823.443476:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787829823.635469:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829824.467518:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787829824.659383:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829825.491450:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787829825.683436:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829826.515477:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787829826.707436:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829827.539496:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787829827.731458:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:0.0:1787829827.731461:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829827.731474:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1787829827.731478:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829827.731489:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4991
00000100:00080000:0.0:1787829827.731500:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829827.731508:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787829827.731554:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e92c0 x1874670273294976/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829827.731580:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829827.731584:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787829827.731586:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829827.731590:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4991
00000100:00080000:0.0:1787829827.731595:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829827.731599:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829827.731609:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787829827.731616:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273294976:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787829827.731626:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8b40 x1874670273295104/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829827.731639:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829827.731643:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787829827.731644:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829827.731650:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4991
00000100:00080000:0.0:1787829827.731662:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829827.731668:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000800:00000100:1.0:1787829827.731669:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000008:00100000:0.0:1787829827.731676:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787829827.731696:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb0c0 x1874670273295232/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829827.731706:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829827.731711:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787829827.731715:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1787829827.731720:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829827/real 1787829827]  req@ffff9ee0056e92c0 x1874670273294976/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829852 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829827.731731:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4991
00000100:00100000:1.0:1787829827.731735:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e92c0 x1874670273294976/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829852 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829827.731738:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829827.731747:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00080000:1.0:1787829827.731751:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000008:00100000:0.0:1787829827.731754:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:1.0:1787829827.731758:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829827.731764:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273294976:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787829827.731770:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9a40 x1874670273295360/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829827.731780:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829827.731784:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787829827.731786:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1787829827.731789:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273295104:192.168.203.121@tcp:38:kworker.0
00000100:00080000:0.0:1787829827.731793:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4991
00000100:00080000:0.0:1787829827.731798:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829827.731802:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829827.731807:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787829827.731821:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ea580 x1874670273295488/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1787829827.731823:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:0.0:1787829827.731836:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1787829827.731836:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829827/real 1787829827]  req@ffff9ee0056e8b40 x1874670273295104/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829852 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829827.731846:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787829827.731850:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1787829827.731854:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8b40 x1874670273295104/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829852 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829827.731858:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4991
00000100:00080000:0.0:1787829827.731865:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829827.731866:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829827.731871:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00080000:0.0:1787829827.731874:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787829827.731877:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273295104:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787829827.731883:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273295232:192.168.203.121@tcp:8:kworker.0
00000008:00100000:0.0:1787829827.731896:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1787829827.731897:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829827.731906:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829827/real 1787829827]  req@ffff9ee0056eb0c0 x1874670273295232/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829852 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829827.731913:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9680 x1874670273295616/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787829827.731917:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb0c0 x1874670273295232/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829852 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829827.731936:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829827.731937:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829827.731940:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00080000:0.0:1787829827.731943:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787829827.731947:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1787829827.731948:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273295232:192.168.203.121@tcp:8:kworker.0
00000100:00080000:0.0:1787829827.731955:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4991
00000100:00080000:0.0:1787829827.731961:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1787829827.731961:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273295360:192.168.203.121@tcp:8:kworker.0
00000100:00080000:0.0:1787829827.731969:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829827.731983:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787829827.731999:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8780 x1874670273295744/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1787829827.732005:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829827.732029:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829827/real 1787829827]  req@ffff9ee0056e9a40 x1874670273295360/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829852 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829827.732042:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9a40 x1874670273295360/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829852 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829827.732063:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829827.732066:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829827.732069:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273295360:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787829827.732085:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273295488:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787829827.732111:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829827.732142:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829827/real 1787829827]  req@ffff9ee0056ea580 x1874670273295488/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829852 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829827.732154:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ea580 x1874670273295488/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829852 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829827.732162:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829827.732173:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829827.732176:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273295488:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787829827.732182:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273295616:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787829827.732199:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829827.732220:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829827/real 1787829827]  req@ffff9ee0056e9680 x1874670273295616/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829852 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829827.732231:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9680 x1874670273295616/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829852 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829827.732238:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829827.732241:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829827.732244:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273295616:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787829827.732249:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273295744:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787829827.732276:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829827.732287:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829827/real 1787829827]  req@ffff9ee0056e8780 x1874670273295744/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829852 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829827.732298:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8780 x1874670273295744/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829852 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829827.732310:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829827.732313:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829827.732350:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273295744:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787829828.563483:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787829828.755443:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829829.587548:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787829829.779440:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829830.611478:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787829830.803424:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829831.635501:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787829831.827446:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829832.659491:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787829832.851392:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:1.0:1787829832.851411:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829832.851418:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1787829832.851423:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829832.851431:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 4996
00000100:00080000:1.0:1787829832.851440:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829832.851446:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787829832.851475:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0000 x1874670273295872/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829832.851496:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829832.851509:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787829832.851511:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829832.851515:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4996
00000100:00080000:1.0:1787829832.851519:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829832.851523:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829832.851532:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787829832.851535:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273295872:192.168.203.121@tcp:250:kworker.0
00000100:00100000:1.0:1787829832.851553:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a2580 x1874670273296000/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829832.851565:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829832.851568:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787829832.851570:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829832.851573:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4996
00000100:00080000:1.0:1787829832.851579:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829832.851583:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829832.851588:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:3.0:1787829832.851590:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829832.851605:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0b40 x1874670273296128/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829832.851617:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829832.851620:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787829832.851621:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829832.851625:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 4996
00000100:00080000:1.0:1787829832.851628:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829832.851632:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829832.851637:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829832.851643:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829832/real 1787829832]  req@ffff9ee0056a0000 x1874670273295872/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829857 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829832.851651:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1e00 x1874670273296256/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829832.851663:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1787829832.851666:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0000 x1874670273295872/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829857 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829832.851668:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787829832.851672:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829832.851681:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4996
00000100:00080000:3.0:1787829832.851684:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829832.851686:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829832.851692:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:1.0:1787829832.851696:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787829832.851702:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273295872:192.168.203.121@tcp:250:kworker.0
00000008:00100000:1.0:1787829832.851704:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787829832.851718:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a3480 x1874670273296384/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829832.851727:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1787829832.851728:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273296000:192.168.203.121@tcp:38:kworker.0
00000100:00080000:1.0:1787829832.851734:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787829832.851736:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829832.851741:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4996
00000100:00080000:1.0:1787829832.851745:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829832.851749:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829832.851754:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:3.0:1787829832.851754:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829832.851769:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a30c0 x1874670273296512/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787829832.851769:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829832/real 1787829832]  req@ffff9ee0056a2580 x1874670273296000/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829857 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829832.851797:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1787829832.851801:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a2580 x1874670273296000/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829857 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829832.851802:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787829832.851806:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829832.851815:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 4996
00000100:00080000:1.0:1787829832.851820:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829832.851824:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829832.851829:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787829832.851838:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0f00 x1874670273296640/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829832.851918:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829832.851924:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829832.851928:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273296000:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787829832.851934:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273296128:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829832.851958:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829832.851970:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829832/real 1787829832]  req@ffff9ee0056a0b40 x1874670273296128/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829857 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829832.851981:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0b40 x1874670273296128/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829857 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829832.851989:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829832.851992:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829832.851994:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273296128:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829832.851999:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273296256:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829832.852017:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829832.852035:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829832/real 1787829832]  req@ffff9ee0056a1e00 x1874670273296256/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829857 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829832.852046:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1e00 x1874670273296256/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829857 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829832.852065:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829832.852069:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829832.852072:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273296256:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829832.852094:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273296384:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787829832.852113:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829832.852123:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829832/real 1787829832]  req@ffff9ee0056a3480 x1874670273296384/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829857 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829832.852134:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a3480 x1874670273296384/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829857 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829832.852141:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829832.852143:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829832.852146:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273296384:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787829832.852152:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273296512:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829832.852169:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829832.852179:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829832/real 1787829832]  req@ffff9ee0056a30c0 x1874670273296512/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829857 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829832.852188:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a30c0 x1874670273296512/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829857 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829832.852196:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829832.852198:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829832.852201:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273296512:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829832.852206:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273296640:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829832.852223:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829832.852233:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829832/real 1787829832]  req@ffff9ee0056a0f00 x1874670273296640/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829857 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829832.852242:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0f00 x1874670273296640/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829857 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829832.852249:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829832.852252:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829832.852255:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273296640:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787829833.683476:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787829833.876420:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829834.707450:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787829834.899453:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829835.731476:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787829835.923414:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829836.755507:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787829836.947389:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829837.779514:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829837.971404:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787829837.971419:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829837.971426:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787829837.971430:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829837.971439:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 5001
00000100:00080000:3.0:1787829837.971449:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829837.971455:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787829837.971498:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706d00 x1874670273296768/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829837.971523:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829837.971526:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787829837.971528:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829837.971533:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5001
00000100:00080000:3.0:1787829837.971537:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829837.971542:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787829837.971546:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273296768:192.168.203.121@tcp:250:kworker.0
00000008:00100000:3.0:1787829837.971553:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787829837.971568:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705e00 x1874670273296896/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829837.971579:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829837.971583:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787829837.971585:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829837.971589:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5001
00000100:00080000:3.0:1787829837.971593:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000800:00000100:1.0:1787829837.971596:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787829837.971601:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829837.971607:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829837.971620:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706580 x1874670273297024/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829837.971630:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1787829837.971633:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829837/real 1787829837]  req@ffff9ee005706d00 x1874670273296768/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829862 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829837.971635:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787829837.971639:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829837.971647:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5001
00000100:00100000:1.0:1787829837.971652:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706d00 x1874670273296768/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829862 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829837.971654:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829837.971663:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00080000:1.0:1787829837.971664:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829837.971669:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000008:00100000:3.0:1787829837.971670:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787829837.971672:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273296768:192.168.203.121@tcp:250:kworker.0
00000100:00100000:3.0:1787829837.971687:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704b40 x1874670273297152/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787829837.971692:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273296896:192.168.203.121@tcp:38:kworker.0
00000100:00080000:3.0:1787829837.971706:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829837.971710:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000800:00000100:1.0:1787829837.971713:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787829837.971715:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829837.971722:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5001
00000100:00100000:1.0:1787829837.971724:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829837/real 1787829837]  req@ffff9ee005705e00 x1874670273296896/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829862 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829837.971727:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829837.971736:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787829837.971739:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705e00 x1874670273296896/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829862 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:3.0:1787829837.971744:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00080000:1.0:1787829837.971746:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829837.971751:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829837.971753:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273296896:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787829837.971757:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273297024:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829837.971762:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705a40 x1874670273297280/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1787829837.971772:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787829837.971774:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829837.971779:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00100000:1.0:1787829837.971781:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829837/real 1787829837]  req@ffff9ee005706580 x1874670273297024/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829862 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829837.971783:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829837.971792:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5001
00000100:00100000:1.0:1787829837.971796:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706580 x1874670273297024/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829862 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829837.971799:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829837.971808:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829837.971818:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:1.0:1787829837.971819:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829837.971824:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829837.971827:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273297024:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829837.971836:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057043c0 x1874670273297408/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787829837.971839:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273297152:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787829837.971855:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787829837.971860:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1787829837.971865:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829837/real 1787829837]  req@ffff9ee005704b40 x1874670273297152/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829862 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829837.971866:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787829837.971870:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829837.971880:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5001
00000100:00100000:1.0:1787829837.971881:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704b40 x1874670273297152/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829862 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829837.971887:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829837.971889:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829837.971895:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00080000:3.0:1787829837.971896:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787829837.971898:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273297152:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787829837.971905:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273297280:192.168.203.121@tcp:38:kworker.0
00000008:00100000:3.0:1787829837.971905:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1787829837.971924:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829837.971925:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704780 x1874670273297536/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787829837.971931:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829837/real 1787829837]  req@ffff9ee005705a40 x1874670273297280/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829862 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829837.971941:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705a40 x1874670273297280/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829862 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829837.971945:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829837.971949:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829837.971953:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273297280:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787829837.971963:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273297408:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787829837.971980:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829837.971989:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829837/real 1787829837]  req@ffff9ee0057043c0 x1874670273297408/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829862 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829837.971995:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057043c0 x1874670273297408/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829862 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829837.972000:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829837.972001:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829837.972003:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273297408:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787829837.972006:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273297536:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787829837.972014:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829837.972019:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829837/real 1787829837]  req@ffff9ee005704780 x1874670273297536/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829862 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829837.972025:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704780 x1874670273297536/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829862 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829837.972029:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829837.972031:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829837.972032:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273297536:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787829838.803475:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829838.995403:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829839.827501:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829840.019405:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829840.851502:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829841.043435:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829841.875581:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829842.067402:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829842.899472:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1787829843.091428:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1787829843.091438:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787829843.091453:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787829843.091458:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829843.091470:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 5006
00000100:00080000:3.0:1787829843.091485:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829843.091494:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787829843.091542:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705680 x1874670273297664/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829843.091576:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829843.091581:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787829843.091583:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829843.091588:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5006
00000100:00080000:3.0:1787829843.091594:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829843.091601:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787829843.091609:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273297664:192.168.203.121@tcp:250:kworker.0
00000008:00100000:3.0:1787829843.091613:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787829843.091640:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707840 x1874670273297792/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829843.091653:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829843.091658:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787829843.091660:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829843.091664:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5006
00000100:00080000:3.0:1787829843.091669:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829843.091673:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829843.091678:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1787829843.091703:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829843.091705:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707480 x1874670273297920/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829843.091717:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829843.091731:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787829843.091733:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829843.091738:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5006
00000100:00080000:3.0:1787829843.091743:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829843.091748:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829843.091764:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787829843.091771:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829843/real 1787829843]  req@ffff9ee005705680 x1874670273297664/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829868 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829843.091780:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704000 x1874670273298048/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787829843.091800:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705680 x1874670273297664/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829868 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829843.091803:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829843.091814:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787829843.091818:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829843.091825:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829843.091826:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5006
00000100:00080000:3.0:1787829843.091835:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829843.091836:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829843.091843:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273297664:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787829843.091846:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829843.091862:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787829843.091876:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706940 x1874670273298176/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787829843.091883:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273297792:192.168.203.121@tcp:38:kworker.0
00000100:00080000:3.0:1787829843.091895:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829843.091901:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787829843.091903:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829843.091909:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5006
00000100:00080000:3.0:1787829843.091913:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829843.091918:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000800:00000100:1.0:1787829843.091924:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000008:00100000:3.0:1787829843.091927:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787829843.091941:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829843/real 1787829843]  req@ffff9ee005707840 x1874670273297792/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829868 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829843.091944:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057061c0 x1874670273298304/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829843.091963:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1787829843.091964:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707840 x1874670273297792/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829868 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829843.091970:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787829843.091974:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829843.091983:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5006
00000100:00080000:1.0:1787829843.091985:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829843.091988:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829843.091994:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00080000:3.0:1787829843.091997:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787829843.092003:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273297792:192.168.203.121@tcp:38:kworker.0
00000008:00100000:3.0:1787829843.092005:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787829843.092028:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273297920:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829843.092036:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057052c0 x1874670273298432/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1787829843.092066:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829843.092078:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829843/real 1787829843]  req@ffff9ee005707480 x1874670273297920/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829868 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829843.092088:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707480 x1874670273297920/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829868 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829843.092094:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829843.092096:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829843.092099:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273297920:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787829843.092103:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273298048:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787829843.092116:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829843.092122:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829843/real 1787829843]  req@ffff9ee005704000 x1874670273298048/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829868 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829843.092130:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704000 x1874670273298048/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829868 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829843.092135:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829843.092137:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829843.092139:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273298048:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787829843.092167:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273298176:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787829843.092181:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829843.092188:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829843/real 1787829843]  req@ffff9ee005706940 x1874670273298176/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829868 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829843.092212:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706940 x1874670273298176/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829868 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829843.092227:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829843.092230:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829843.092232:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273298176:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787829843.092236:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273298304:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787829843.092248:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829843.092254:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829843/real 1787829843]  req@ffff9ee0057061c0 x1874670273298304/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829868 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829843.092273:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057061c0 x1874670273298304/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829868 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829843.092278:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829843.092280:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829843.092282:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273298304:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787829843.092286:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273298432:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787829843.092295:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829843.092300:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829843/real 1787829843]  req@ffff9ee0057052c0 x1874670273298432/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829868 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829843.092308:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057052c0 x1874670273298432/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829868 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829843.092335:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829843.092337:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829843.092339:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273298432:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787829843.923480:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829844.115388:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829844.947502:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829845.139407:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829845.971488:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829846.163386:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829846.995529:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829847.187456:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829848.019506:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829848.211457:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787829848.211468:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829848.211481:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787829848.211486:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829848.211500:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 5011
00000100:00080000:3.0:1787829848.211516:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829848.211527:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787829848.211576:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707c00 x1874670273298560/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829848.211617:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829848.211622:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787829848.211624:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829848.211629:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5011
00000100:00080000:3.0:1787829848.211634:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829848.211639:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829848.211653:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787829848.211667:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273298560:192.168.203.121@tcp:250:kworker.0
00000100:00100000:3.0:1787829848.211672:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057070c0 x1874670273298688/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829848.211700:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829848.211705:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787829848.211707:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829848.211713:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5011
00000100:00080000:3.0:1787829848.211718:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829848.211726:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829848.211731:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829848.211748:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057052c0 x1874670273298816/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829848.211759:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829848.211764:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787829848.211766:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829848.211771:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5011
00000100:00080000:3.0:1787829848.211776:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829848.211781:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829848.211787:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829848.211802:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057061c0 x1874670273298944/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787829848.211811:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273298688:192.168.203.121@tcp:38:kworker.0
00000100:00080000:3.0:1787829848.211823:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829848.211829:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787829848.211832:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829848.211839:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5011
00000100:00080000:3.0:1787829848.211848:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829848.211855:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829848.211861:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787829848.211871:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273298816:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829848.211880:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706940 x1874670273299072/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829848.211895:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829848.211901:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787829848.211904:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1787829848.211909:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273298944:192.168.203.121@tcp:8:kworker.0
00000100:00080000:3.0:1787829848.211914:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5011
00000100:00080000:3.0:1787829848.211922:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829848.211929:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787829848.211931:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273299072:192.168.203.121@tcp:38:kworker.0
00000008:00100000:3.0:1787829848.211945:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829848.211965:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704000 x1874670273299200/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829848.211985:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829848.211991:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787829848.211993:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829848.212000:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5011
00000100:00100000:1.0:1787829848.212011:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273299200:192.168.203.121@tcp:8:kworker.0
00000100:00080000:3.0:1787829848.212014:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829848.212028:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829848.212035:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829848.212053:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707480 x1874670273299328/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787829848.212098:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273299328:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787829849.043501:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829849.235460:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829850.067482:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829850.259409:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829851.091511:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829851.283439:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000400:00000100:2.0:1787829851.283554:0:2352:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.203.121:988
00000400:00000100:2.0:1787829851.283585:0:2352:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.203.121@tcp at host 192.168.203.121 was unreachable: the network or that node may be down, or Lustre may be misconfigured.
00000800:00000100:2.0:1787829851.283599:0:2352:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:2.0:1787829851.283628:0:2352:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:2.0:1787829851.283634:0:2352:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:2.0:1787829851.283641:0:2352:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:2.0:1787829851.283647:0:2352:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:2.0:1787829851.283657:0:2352:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:2.0:1787829851.283669:0:2352:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000100:00100000:1.0:1787829851.283670:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829848/real 1787829851]  req@ffff9ee0057061c0 x1874670273298944/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829873 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829851.283697:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057061c0 x1874670273298944/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829873 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829851.283710:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829851.283716:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829851.283720:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273298944:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787829851.283727:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829848/real 1787829851]  req@ffff9ee005706940 x1874670273299072/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829873 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829851.283740:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706940 x1874670273299072/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829873 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829851.283747:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829851.283750:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829851.283754:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273299072:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787829851.283760:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829848/real 1787829851]  req@ffff9ee0057070c0 x1874670273298688/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829873 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829851.283772:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057070c0 x1874670273298688/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829873 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829851.283780:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829851.283784:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829851.283787:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273298688:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787829851.283794:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829848/real 1787829851]  req@ffff9ee0057052c0 x1874670273298816/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829873 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829851.283807:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057052c0 x1874670273298816/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829873 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829851.283816:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829851.283820:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829851.283824:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273298816:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787829851.283831:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829848/real 1787829851]  req@ffff9ee005707c00 x1874670273298560/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829873 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829851.283844:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707c00 x1874670273298560/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829873 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829851.283852:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829851.283856:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829851.283859:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273298560:192.168.203.121@tcp:250:kworker.0
00000100:00100000:1.0:1787829851.283887:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829848/real 1787829851]  req@ffff9ee005707480 x1874670273299328/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829873 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829851.283900:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707480 x1874670273299328/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829873 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829851.283908:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829851.283912:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829851.283915:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273299328:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787829851.283922:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829848/real 1787829851]  req@ffff9ee005704000 x1874670273299200/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829873 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829851.283934:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704000 x1874670273299200/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829873 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829851.283944:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829851.283948:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829851.283951:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273299200:192.168.203.121@tcp:8:kworker.0
00010000:00010000:0.0:1787829852.115450:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829852.307419:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829853.139524:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829853.331412:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:0.0:1787829853.331424:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829853.331430:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1787829853.331434:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829853.331443:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 5017
00000100:00080000:0.0:1787829853.331452:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829853.331458:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787829853.331485:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ead00 x1874670273299456/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829853.331505:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829853.331508:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787829853.331509:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829853.331518:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5017
00000100:00080000:0.0:1787829853.331520:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829853.331523:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829853.331533:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787829853.331534:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273299456:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787829853.331550:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ea940 x1874670273299584/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829853.331563:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829853.331567:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787829853.331569:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829853.331573:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5017
00000100:00080000:0.0:1787829853.331578:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829853.331582:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829853.331588:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787829853.331600:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8780 x1874670273299712/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1787829853.331613:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:0.0:1787829853.331625:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829853.331629:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787829853.331632:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829853.331638:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5017
00000100:00080000:0.0:1787829853.331644:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829853.331650:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829853.331656:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787829853.331667:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829853/real 1787829853]  req@ffff9ee0056ead00 x1874670273299456/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829878 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829853.331672:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9680 x1874670273299840/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829853.331694:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829853.331699:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00100000:1.0:1787829853.331702:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ead00 x1874670273299456/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829878 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829853.331703:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829853.331711:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5017
00000100:00080000:0.0:1787829853.331718:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829853.331726:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829853.331727:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829853.331737:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00080000:1.0:1787829853.331738:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829853.331746:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273299456:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787829853.331754:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ea580 x1874670273299968/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829853.331764:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829853.331768:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787829853.331770:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1787829853.331775:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273299584:192.168.203.121@tcp:38:kworker.0
00000100:00080000:0.0:1787829853.331778:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5017
00000100:00080000:0.0:1787829853.331786:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829853.331792:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829853.331797:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787829853.331810:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9a40 x1874670273300096/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1787829853.331817:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829853.331837:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829853/real 1787829853]  req@ffff9ee0056ea940 x1874670273299584/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829878 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829853.331843:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829853.331853:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787829853.331856:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829853.331863:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5017
00000100:00100000:1.0:1787829853.331863:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ea940 x1874670273299584/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829878 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829853.331869:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829853.331878:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00080000:1.0:1787829853.331880:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000008:00100000:0.0:1787829853.331885:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:1.0:1787829853.331888:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829853.331895:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273299584:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787829853.331903:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb0c0 x1874670273300224/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787829853.331906:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273299712:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787829853.331941:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829853.331956:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829853/real 1787829853]  req@ffff9ee0056e8780 x1874670273299712/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829878 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829853.331968:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8780 x1874670273299712/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829878 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829853.331975:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829853.331978:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829853.331981:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273299712:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787829853.331987:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273299840:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787829853.332006:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829853.332019:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829853/real 1787829853]  req@ffff9ee0056e9680 x1874670273299840/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829878 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829853.332030:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9680 x1874670273299840/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829878 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829853.332038:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829853.332041:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829853.332045:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273299840:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787829853.332051:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273299968:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787829853.332071:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829853.332084:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829853/real 1787829853]  req@ffff9ee0056ea580 x1874670273299968/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829878 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829853.332096:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ea580 x1874670273299968/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829878 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829853.332104:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829853.332108:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829853.332111:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273299968:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787829853.332130:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273300096:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787829853.332153:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829853.332165:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829853/real 1787829853]  req@ffff9ee0056e9a40 x1874670273300096/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829878 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829853.332177:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9a40 x1874670273300096/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829878 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829853.332186:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829853.332190:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829853.332194:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273300096:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787829853.332201:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273300224:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787829853.332220:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829853.332231:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829853/real 1787829853]  req@ffff9ee0056eb0c0 x1874670273300224/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829878 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829853.332249:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb0c0 x1874670273300224/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829878 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829853.332258:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829853.332261:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829853.332263:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273300224:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787829854.163519:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829854.355409:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829855.187514:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829855.379452:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829856.211504:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829856.403431:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829857.235502:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829857.427458:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829858.259545:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829858.451405:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787829858.451524:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829858.451536:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787829858.451547:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829858.451561:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 5022
00000100:00080000:3.0:1787829858.451576:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829858.451586:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787829858.451646:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707840 x1874670273300352/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829858.451677:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829858.451681:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787829858.451683:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829858.451688:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5022
00000100:00080000:3.0:1787829858.451693:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829858.451699:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829858.451712:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787829858.451724:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273300352:192.168.203.121@tcp:250:kworker.0
00000100:00100000:3.0:1787829858.451732:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705680 x1874670273300480/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829858.451749:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829858.451753:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787829858.451756:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829858.451762:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5022
00000100:00080000:3.0:1787829858.451770:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829858.451776:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829858.451784:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1787829858.451793:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829858.451804:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704780 x1874670273300608/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829858.451819:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829858.451823:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787829858.451825:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829858.451829:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5022
00000100:00080000:3.0:1787829858.451835:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1787829858.451841:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829858/real 1787829858]  req@ffff9ee005707840 x1874670273300352/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829883 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829858.451846:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829858.451862:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787829858.451874:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707840 x1874670273300352/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829883 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829858.451884:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057043c0 x1874670273300736/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829858.451895:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829858.451901:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829858.451906:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:3.0:1787829858.451909:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787829858.451914:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1787829858.451915:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273300352:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787829858.451926:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5022
00000100:00080000:3.0:1787829858.451934:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829858.451940:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829858.451946:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787829858.451955:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273300480:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787829858.451964:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705a40 x1874670273300864/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829858.451980:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829858.451984:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787829858.451986:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829858.451994:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5022
00000800:00000100:1.0:1787829858.451995:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787829858.452006:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829858.452013:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787829858.452018:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829858/real 1787829858]  req@ffff9ee005705680 x1874670273300480/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829883 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:3.0:1787829858.452020:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787829858.452040:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705680 x1874670273300480/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829883 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829858.452051:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829858.452054:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829858.452057:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704b40 x1874670273300992/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787829858.452058:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273300480:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787829858.452075:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273300608:192.168.203.121@tcp:8:kworker.0
00000100:00080000:3.0:1787829858.452097:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829858.452102:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787829858.452110:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:1.0:1787829858.452111:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829858.452124:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829858/real 1787829858]  req@ffff9ee005704780 x1874670273300608/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829883 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829858.452136:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5022
00000100:00100000:1.0:1787829858.452144:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704780 x1874670273300608/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829883 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829858.452145:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829858.452159:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829858.452159:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00080000:1.0:1787829858.452167:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829858.452170:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273300608:192.168.203.121@tcp:8:kworker.0
00000008:00100000:3.0:1787829858.452171:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787829858.452176:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273300736:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829858.452197:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706580 x1874670273301120/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1787829858.452200:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829858.452212:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829858/real 1787829858]  req@ffff9ee0057043c0 x1874670273300736/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829883 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829858.452227:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057043c0 x1874670273300736/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829883 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829858.452236:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829858.452240:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829858.452243:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273300736:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787829858.452259:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273300864:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787829858.452270:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829858.452276:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829858/real 1787829858]  req@ffff9ee005705a40 x1874670273300864/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829883 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829858.452283:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705a40 x1874670273300864/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829883 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829858.452289:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829858.452291:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829858.452293:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273300864:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787829858.452296:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273300992:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787829858.452306:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829858.452311:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829858/real 1787829858]  req@ffff9ee005704b40 x1874670273300992/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829883 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829858.452355:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704b40 x1874670273300992/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829883 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829858.452361:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829858.452363:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829858.452366:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273300992:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787829858.452370:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273301120:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787829858.452386:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829858.452394:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829858/real 1787829858]  req@ffff9ee005706580 x1874670273301120/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829883 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829858.452401:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706580 x1874670273301120/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829883 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829858.452407:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829858.452410:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829858.452413:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273301120:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787829859.283524:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829859.475425:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829860.307467:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829860.499427:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829861.331489:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829861.523377:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829862.355474:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829862.547422:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829863.379486:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829863.571385:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787829863.571398:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829863.571406:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787829863.571412:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829863.571422:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 5027
00000100:00080000:3.0:1787829863.571433:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829863.571441:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787829863.571478:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705e00 x1874670273301248/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829863.571509:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829863.571514:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787829863.571516:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829863.571522:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5027
00000100:00080000:3.0:1787829863.571527:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829863.571533:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787829863.571543:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273301248:192.168.203.121@tcp:250:kworker.0
00000008:00100000:3.0:1787829863.571543:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787829863.571563:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706d00 x1874670273301376/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829863.571578:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829863.571582:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787829863.571585:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829863.571590:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5027
00000100:00080000:3.0:1787829863.571595:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829863.571601:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829863.571608:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1787829863.571613:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829863.571629:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706580 x1874670273301504/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829863.571648:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829863.571652:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:1.0:1787829863.571655:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829863/real 1787829863]  req@ffff9ee005705e00 x1874670273301248/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829888 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829863.571656:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829863.571665:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5027
00000100:00080000:3.0:1787829863.571673:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829863.571681:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829863.571687:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787829863.571688:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705e00 x1874670273301248/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829888 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829863.571704:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:3.0:1787829863.571707:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704b40 x1874670273301632/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829863.571712:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829863.571723:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273301248:192.168.203.121@tcp:250:kworker.0
00000100:00100000:1.0:1787829863.571757:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273301376:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787829863.571781:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787829863.571793:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1787829863.571798:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829863/real 1787829863]  req@ffff9ee005706d00 x1874670273301376/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829888 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829863.571800:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787829863.571805:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1787829863.571825:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706d00 x1874670273301376/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829888 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829863.571835:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829863.571838:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829863.571842:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273301376:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787829863.571849:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273301504:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787829863.571877:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829863.571896:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829863/real 1787829863]  req@ffff9ee005706580 x1874670273301504/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829888 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829863.571912:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706580 x1874670273301504/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829888 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829863.571921:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829863.571925:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829863.571928:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273301504:192.168.203.121@tcp:8:kworker.0
00000100:00080000:3.0:1787829863.571940:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5027
00000100:00100000:1.0:1787829863.571942:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273301632:192.168.203.121@tcp:8:kworker.0
00000100:00080000:3.0:1787829863.571951:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000800:00000100:1.0:1787829863.571969:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829863.571984:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829863/real 1787829863]  req@ffff9ee005704b40 x1874670273301632/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829888 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829863.572001:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704b40 x1874670273301632/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829888 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829863.572006:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00080000:1.0:1787829863.572020:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000008:00100000:3.0:1787829863.572020:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787829863.572040:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705a40 x1874670273301760/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829863.572041:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829863.572048:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273301632:192.168.203.121@tcp:8:kworker.0
00000100:00080000:3.0:1787829863.572076:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829863.572081:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00100000:1.0:1787829863.572082:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273301760:192.168.203.121@tcp:38:kworker.0
00000100:00080000:3.0:1787829863.572087:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829863.572094:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5027
00000100:00080000:3.0:1787829863.572101:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829863.572107:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829863.572113:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1787829863.572115:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829863.572132:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057043c0 x1874670273301888/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787829863.572135:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829863/real 1787829863]  req@ffff9ee005705a40 x1874670273301760/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829888 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829863.572160:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1787829863.572164:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705a40 x1874670273301760/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829888 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829863.572168:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787829863.572173:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829863.572177:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829863.572182:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5027
00000100:00080000:1.0:1787829863.572185:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829863.572191:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273301760:192.168.203.121@tcp:38:kworker.0
00000100:00080000:3.0:1787829863.572192:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829863.572200:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787829863.572203:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273301888:192.168.203.121@tcp:8:kworker.0
00000008:00100000:3.0:1787829863.572211:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1787829863.572225:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829863.572230:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704780 x1874670273302016/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787829863.572236:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829863/real 1787829863]  req@ffff9ee0057043c0 x1874670273301888/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829888 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829863.572258:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057043c0 x1874670273301888/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829888 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829863.572265:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829863.572268:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829863.572271:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273301888:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787829863.572283:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273302016:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787829863.572338:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829863.572353:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829863/real 1787829863]  req@ffff9ee005704780 x1874670273302016/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829888 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829863.572365:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704780 x1874670273302016/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829888 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829863.572372:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829863.572376:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829863.572379:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273302016:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787829864.403458:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829864.595420:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829865.427515:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829865.619415:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829866.451504:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829866.643448:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829867.475466:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829867.667415:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829868.499503:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1787829868.691420:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1787829868.691423:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:1.0:1787829868.691431:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1787829868.691435:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829868.691443:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 5032
00000100:00080000:1.0:1787829868.691452:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829868.691459:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787829868.691488:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0780 x1874670273302144/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829868.691515:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829868.691519:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787829868.691521:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829868.691526:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5032
00000100:00080000:1.0:1787829868.691531:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829868.691536:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787829868.691542:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273302144:192.168.203.121@tcp:250:kworker.0
00000008:00100000:1.0:1787829868.691547:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787829868.691562:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0f00 x1874670273302272/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829868.691571:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829868.691574:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787829868.691576:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829868.691578:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5032
00000100:00080000:1.0:1787829868.691582:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829868.691585:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829868.691589:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787829868.691597:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a30c0 x1874670273302400/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1787829868.691601:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:1.0:1787829868.691611:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829868.691613:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787829868.691614:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829868.691618:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5032
00000100:00080000:1.0:1787829868.691621:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829868.691624:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829868.691627:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787829868.691634:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a3480 x1874670273302528/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787829868.691642:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829868/real 1787829868]  req@ffff9ee0056a0780 x1874670273302144/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829893 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829868.691643:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829868.691653:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787829868.691658:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829868.691666:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5032
00000100:00100000:3.0:1787829868.691669:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0780 x1874670273302144/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829893 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829868.691673:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829868.691683:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829868.691705:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00080000:3.0:1787829868.691706:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829868.691713:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829868.691717:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273302144:192.168.203.121@tcp:250:kworker.0
00000100:00100000:1.0:1787829868.691721:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1e00 x1874670273302656/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829868.691730:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829868.691733:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787829868.691734:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829868.691737:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5032
00000100:00100000:3.0:1787829868.691741:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273302272:192.168.203.121@tcp:38:kworker.0
00000100:00080000:1.0:1787829868.691743:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829868.691751:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829868.691756:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:3.0:1787829868.691770:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829868.691774:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0b40 x1874670273302784/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829868.691789:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829868.691791:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:3.0:1787829868.691793:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829868/real 1787829868]  req@ffff9ee0056a0f00 x1874670273302272/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829893 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829868.691796:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829868.691806:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5032
00000100:00080000:1.0:1787829868.691812:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1787829868.691815:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0f00 x1874670273302272/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829893 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829868.691817:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829868.691824:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:3.0:1787829868.691829:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:1.0:1787829868.691836:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a2580 x1874670273302912/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829868.691836:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829868.691841:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273302272:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787829868.691853:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273302400:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829868.691874:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829868.691886:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829868/real 1787829868]  req@ffff9ee0056a30c0 x1874670273302400/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829893 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829868.691898:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a30c0 x1874670273302400/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829893 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829868.691908:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829868.691911:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829868.691915:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273302400:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829868.691922:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273302528:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829868.691942:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829868.691955:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829868/real 1787829868]  req@ffff9ee0056a3480 x1874670273302528/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829893 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829868.691967:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a3480 x1874670273302528/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829893 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829868.691976:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829868.691979:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829868.691983:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273302528:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829868.691989:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273302656:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787829868.692008:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829868.692015:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829868/real 1787829868]  req@ffff9ee0056a1e00 x1874670273302656/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829893 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829868.692023:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1e00 x1874670273302656/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829893 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829868.692029:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829868.692031:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829868.692033:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273302656:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787829868.692047:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273302784:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829868.692065:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829868.692076:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829868/real 1787829868]  req@ffff9ee0056a0b40 x1874670273302784/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829893 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829868.692089:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0b40 x1874670273302784/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829893 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829868.692098:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829868.692102:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829868.692105:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273302784:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829868.692109:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273302912:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829868.692124:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829868.692132:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829868/real 1787829868]  req@ffff9ee0056a2580 x1874670273302912/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829893 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829868.692139:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a2580 x1874670273302912/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829893 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829868.692144:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829868.692146:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829868.692148:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273302912:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787829869.523445:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787829869.715418:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829870.547537:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787829870.739425:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829871.571527:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787829871.763403:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829872.595505:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787829872.787438:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829873.619482:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787829873.811397:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:1.0:1787829873.811404:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829873.811419:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1787829873.811423:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829873.811433:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 5037
00000100:00080000:1.0:1787829873.811444:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829873.811451:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787829873.811488:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0000 x1874670273303040/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829873.811516:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829873.811520:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787829873.811522:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829873.811527:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5037
00000100:00080000:1.0:1787829873.811531:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829873.811537:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829873.811549:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787829873.811549:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273303040:192.168.203.121@tcp:250:kworker.0
00000100:00100000:1.0:1787829873.811568:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a3c00 x1874670273303168/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829873.811582:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829873.811586:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787829873.811588:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829873.811592:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5037
00000100:00080000:1.0:1787829873.811606:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829873.811611:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829873.811617:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:3.0:1787829873.811622:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829873.811634:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a2940 x1874670273303296/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829873.811646:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829873.811650:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787829873.811652:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829873.811657:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5037
00000100:00080000:1.0:1787829873.811661:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829873.811666:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787829873.811672:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829873/real 1787829873]  req@ffff9ee0056a0000 x1874670273303040/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829898 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:1.0:1787829873.811673:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787829873.811694:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a21c0 x1874670273303424/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787829873.811695:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0000 x1874670273303040/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829898 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829873.811731:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829873.811733:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829873.811736:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:1.0:1787829873.811740:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787829873.811744:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1787829873.811748:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273303040:192.168.203.121@tcp:250:kworker.0
00000100:00080000:1.0:1787829873.811753:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5037
00000100:00080000:1.0:1787829873.811758:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829873.811763:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829873.811768:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787829873.811772:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273303168:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787829873.811781:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1680 x1874670273303552/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829873.811791:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829873.811795:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000800:00000100:3.0:1787829873.811796:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:1.0:1787829873.811798:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829873.811804:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5037
00000100:00080000:1.0:1787829873.811808:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1787829873.811812:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829873/real 1787829873]  req@ffff9ee0056a3c00 x1874670273303168/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829898 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829873.811814:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829873.811822:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829873.811834:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a3c00 x1874670273303168/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829898 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829873.811836:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a03c0 x1874670273303680/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829873.811865:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829873.811866:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829873.811872:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787829873.811874:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00080000:1.0:1787829873.811875:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1787829873.811881:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273303168:192.168.203.121@tcp:38:kworker.0
00000100:00080000:1.0:1787829873.811882:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5037
00000100:00080000:1.0:1787829873.811886:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829873.811890:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787829873.811894:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273303296:192.168.203.121@tcp:8:kworker.0
00000008:00100000:1.0:1787829873.811896:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787829873.811908:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1a40 x1874670273303808/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1787829873.811916:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829873.811926:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829873/real 1787829873]  req@ffff9ee0056a2940 x1874670273303296/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829898 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829873.811950:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a2940 x1874670273303296/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829898 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829873.811955:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829873.811958:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829873.811960:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273303296:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829873.811964:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273303424:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829873.811975:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829873.811981:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829873/real 1787829873]  req@ffff9ee0056a21c0 x1874670273303424/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829898 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829873.811988:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a21c0 x1874670273303424/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829898 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829873.811993:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829873.811995:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829873.811997:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273303424:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829873.812008:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273303552:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787829873.812018:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829873.812024:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829873/real 1787829873]  req@ffff9ee0056a1680 x1874670273303552/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829898 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829873.812031:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1680 x1874670273303552/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829898 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829873.812041:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829873.812043:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829873.812045:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273303552:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787829873.812048:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273303680:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829873.812058:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829873.812063:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829873/real 1787829873]  req@ffff9ee0056a03c0 x1874670273303680/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829898 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829873.812070:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a03c0 x1874670273303680/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829898 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829873.812075:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829873.812077:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829873.812079:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273303680:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829873.812082:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273303808:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829873.812090:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829873.812096:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829873/real 1787829873]  req@ffff9ee0056a1a40 x1874670273303808/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829898 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829873.812102:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1a40 x1874670273303808/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829898 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829873.812107:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829873.812108:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829873.812111:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273303808:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787829874.643482:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787829874.835434:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829875.667484:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787829875.859397:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829876.691501:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787829876.883453:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829877.715517:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787829877.907439:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829878.739480:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829878.931411:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:0.0:1787829878.931413:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829878.931421:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1787829878.931425:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829878.931433:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 5042
00000100:00080000:0.0:1787829878.931443:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829878.931449:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787829878.931488:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8b40 x1874670273303936/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829878.931508:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829878.931510:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787829878.931512:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829878.931514:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5042
00000100:00080000:0.0:1787829878.931517:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829878.931520:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829878.931527:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787829878.931539:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e92c0 x1874670273304064/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787829878.931540:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273303936:192.168.203.121@tcp:250:kworker.0
00000100:00080000:0.0:1787829878.931554:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829878.931557:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787829878.931558:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829878.931561:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5042
00000100:00080000:0.0:1787829878.931563:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829878.931566:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829878.931569:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787829878.931577:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb480 x1874670273304192/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829878.931586:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829878.931590:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787829878.931592:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829878.931595:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5042
00000100:00080000:0.0:1787829878.931600:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829878.931604:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829878.931611:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:3.0:1787829878.931611:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829878.931627:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb840 x1874670273304320/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829878.931637:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829878.931641:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787829878.931643:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829878.931647:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5042
00000100:00080000:0.0:1787829878.931651:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1787829878.931654:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829878/real 1787829878]  req@ffff9ee0056e8b40 x1874670273303936/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829903 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829878.931657:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829878.931664:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787829878.931678:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8f00 x1874670273304448/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787829878.931678:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8b40 x1874670273303936/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829903 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829878.931709:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829878.931712:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787829878.931714:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829878.931714:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829878.931721:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5042
00000100:00080000:0.0:1787829878.931724:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829878.931725:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:0.0:1787829878.931728:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829878.931733:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829878.931736:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273303936:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787829878.931742:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e83c0 x1874670273304576/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829878.931749:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829878.931751:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787829878.931753:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829878.931755:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5042
00000100:00080000:0.0:1787829878.931757:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829878.931759:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829878.931763:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829878.931766:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273304064:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787829878.931771:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ebc00 x1874670273304704/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1787829878.931795:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829878.931809:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829878/real 1787829878]  req@ffff9ee0056e92c0 x1874670273304064/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829903 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829878.931822:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e92c0 x1874670273304064/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829903 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829878.931831:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829878.931835:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829878.931839:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273304064:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787829878.931846:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273304192:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829878.931867:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829878.931875:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829878/real 1787829878]  req@ffff9ee0056eb480 x1874670273304192/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829903 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829878.931883:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb480 x1874670273304192/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829903 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829878.931889:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829878.931892:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829878.931895:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273304192:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829878.931902:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273304320:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829878.931921:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829878.931932:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829878/real 1787829878]  req@ffff9ee0056eb840 x1874670273304320/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829903 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829878.931945:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb840 x1874670273304320/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829903 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829878.931952:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829878.931955:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829878.931957:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273304320:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829878.931962:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273304448:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787829878.931977:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829878.931985:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829878/real 1787829878]  req@ffff9ee0056e8f00 x1874670273304448/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829903 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829878.931992:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8f00 x1874670273304448/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829903 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829878.931997:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829878.931999:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829878.932001:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273304448:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787829878.932013:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273304576:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829878.932024:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829878.932030:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829878/real 1787829878]  req@ffff9ee0056e83c0 x1874670273304576/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829903 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829878.932037:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e83c0 x1874670273304576/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829903 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829878.932042:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829878.932044:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829878.932046:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273304576:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829878.932059:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273304704:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829878.932069:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829878.932075:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829878/real 1787829878]  req@ffff9ee0056ebc00 x1874670273304704/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829903 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829878.932086:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ebc00 x1874670273304704/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829903 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829878.932091:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829878.932093:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829878.932095:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273304704:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787829879.763500:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829879.955445:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829880.787499:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829880.979407:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829881.811509:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829882.003398:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829882.835491:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829883.027386:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829883.859447:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829884.051397:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:0.0:1787829884.051414:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829884.051420:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1787829884.051424:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829884.051432:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 5047
00000100:00080000:0.0:1787829884.051441:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829884.051446:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787829884.051474:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9e00 x1874670273304832/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829884.051494:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829884.051497:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787829884.051498:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829884.051502:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5047
00000100:00080000:0.0:1787829884.051504:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829884.051508:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829884.051516:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787829884.051523:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273304832:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787829884.051527:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8000 x1874670273304960/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829884.051537:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829884.051540:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787829884.051541:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829884.051544:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5047
00000100:00080000:0.0:1787829884.051546:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829884.051549:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829884.051552:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787829884.051562:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ebc00 x1874670273305088/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829884.051568:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829884.051570:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787829884.051572:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829884.051574:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5047
00000100:00080000:0.0:1787829884.051577:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000800:00000100:3.0:1787829884.051579:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:0.0:1787829884.051583:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829884.051588:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787829884.051598:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e83c0 x1874670273305216/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829884.051606:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829884.051608:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787829884.051610:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829884.051613:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5047
00000100:00080000:0.0:1787829884.051617:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1787829884.051618:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829884/real 1787829884]  req@ffff9ee0056e9e00 x1874670273304832/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829909 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829884.051624:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829884.051632:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787829884.051643:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8f00 x1874670273305344/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787829884.051646:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9e00 x1874670273304832/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829909 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829884.051658:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829884.051666:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787829884.051668:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829884.051673:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5047
00000100:00080000:3.0:1787829884.051674:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829884.051676:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829884.051681:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829884.051685:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787829884.051692:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb840 x1874670273305472/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829884.051692:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829884.051705:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273304832:192.168.203.121@tcp:250:kworker.0
00000100:00080000:0.0:1787829884.051706:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829884.051718:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787829884.051722:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829884.051726:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5047
00000100:00080000:0.0:1787829884.051728:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829884.051731:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829884.051734:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787829884.051741:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb480 x1874670273305600/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787829884.051746:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273304960:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787829884.051779:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829884.051790:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829884/real 1787829884]  req@ffff9ee0056e8000 x1874670273304960/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829909 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829884.051804:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8000 x1874670273304960/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829909 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829884.051810:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829884.051812:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829884.051815:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273304960:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787829884.051819:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273305088:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829884.051832:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829884.051839:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829884/real 1787829884]  req@ffff9ee0056ebc00 x1874670273305088/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829909 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829884.051851:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ebc00 x1874670273305088/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829909 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829884.051861:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829884.051864:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829884.051868:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273305088:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829884.051875:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273305216:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829884.051902:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829884.051911:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829884/real 1787829884]  req@ffff9ee0056e83c0 x1874670273305216/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829909 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829884.051919:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e83c0 x1874670273305216/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829909 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829884.051929:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829884.051931:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829884.051935:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273305216:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829884.051941:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273305344:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787829884.051974:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829884.051986:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829884/real 1787829884]  req@ffff9ee0056e8f00 x1874670273305344/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829909 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829884.051999:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8f00 x1874670273305344/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829909 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829884.052007:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829884.052011:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829884.052014:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273305344:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787829884.052020:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273305472:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829884.052042:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829884.052052:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829884/real 1787829884]  req@ffff9ee0056eb840 x1874670273305472/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829909 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829884.052061:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb840 x1874670273305472/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829909 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829884.052066:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829884.052068:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829884.052071:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273305472:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829884.052085:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273305600:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829884.052098:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829884.052105:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829884/real 1787829884]  req@ffff9ee0056eb480 x1874670273305600/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829909 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829884.052112:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb480 x1874670273305600/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829909 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829884.052117:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829884.052119:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829884.052121:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273305600:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787829884.883469:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829885.075440:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829885.907502:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829886.099382:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829886.931452:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829887.123421:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829887.955498:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829888.147406:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829888.979469:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1787829889.171448:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1787829889.171451:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:0.0:1787829889.171462:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1787829889.171468:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829889.171479:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 5052
00000100:00080000:0.0:1787829889.171492:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829889.171501:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787829889.171545:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e92c0 x1874670273305728/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829889.171575:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829889.171578:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787829889.171580:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829889.171583:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5052
00000100:00080000:0.0:1787829889.171585:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829889.171588:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829889.171597:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787829889.171607:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8b40 x1874670273305856/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829889.171616:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829889.171619:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787829889.171621:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829889.171624:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5052
00000100:00080000:0.0:1787829889.171626:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829889.171629:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829889.171633:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829889.171635:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273305728:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787829889.171642:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb0c0 x1874670273305984/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829889.171650:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829889.171652:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787829889.171654:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829889.171657:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5052
00000100:00080000:0.0:1787829889.171659:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829889.171662:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829889.171665:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787829889.171673:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9a40 x1874670273306112/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829889.171680:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829889.171683:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787829889.171684:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829889.171687:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5052
00000100:00080000:0.0:1787829889.171690:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829889.171692:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829889.171695:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787829889.171702:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ea580 x1874670273306240/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829889.171708:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829889.171710:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787829889.171711:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:3.0:1787829889.171716:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:0.0:1787829889.171717:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5052
00000100:00080000:0.0:1787829889.171722:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829889.171724:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829889.171728:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787829889.171737:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9680 x1874670273306368/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829889.171743:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829889.171746:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787829889.171747:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829889.171750:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5052
00000100:00080000:0.0:1787829889.171753:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829889.171756:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829889.171759:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829889.171764:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829889/real 1787829889]  req@ffff9ee0056e92c0 x1874670273305728/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829914 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829889.171769:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8780 x1874670273306496/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787829889.171797:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e92c0 x1874670273305728/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829914 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829889.171807:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829889.171810:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829889.171814:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273305728:192.168.203.121@tcp:250:kworker.0
00000100:00100000:3.0:1787829889.171822:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273305856:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787829889.171840:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829889.171848:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829889/real 1787829889]  req@ffff9ee0056e8b40 x1874670273305856/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829914 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829889.171857:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8b40 x1874670273305856/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829914 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829889.171865:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829889.171869:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829889.171873:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273305856:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787829889.171901:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273305984:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829889.171925:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829889.171938:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829889/real 1787829889]  req@ffff9ee0056eb0c0 x1874670273305984/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829914 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829889.171950:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb0c0 x1874670273305984/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829914 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829889.171959:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829889.171962:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829889.171974:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273305984:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829889.171980:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273306112:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829889.172001:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829889.172013:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829889/real 1787829889]  req@ffff9ee0056e9a40 x1874670273306112/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829914 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829889.172027:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9a40 x1874670273306112/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829914 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829889.172035:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829889.172038:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829889.172041:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273306112:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829889.172047:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273306240:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787829889.172067:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829889.172078:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829889/real 1787829889]  req@ffff9ee0056ea580 x1874670273306240/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829914 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829889.172090:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ea580 x1874670273306240/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829914 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829889.172098:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829889.172101:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829889.172105:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273306240:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787829889.172125:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273306368:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829889.172145:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829889.172157:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829889/real 1787829889]  req@ffff9ee0056e9680 x1874670273306368/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829914 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829889.172170:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9680 x1874670273306368/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829914 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829889.172183:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829889.172186:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829889.172188:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273306368:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829889.172192:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273306496:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829889.172208:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829889.172216:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829889/real 1787829889]  req@ffff9ee0056e8780 x1874670273306496/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829914 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829889.172223:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8780 x1874670273306496/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829914 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829889.172228:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829889.172231:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829889.172233:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273306496:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787829890.003528:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829890.195424:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829891.027510:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829891.219430:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829892.051497:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829892.243438:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829893.075509:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829893.267425:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829894.099549:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1787829894.291442:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1787829894.291446:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:2.0:1787829894.291454:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787829894.291460:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829894.291470:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 5058
00000100:00080000:2.0:1787829894.291483:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829894.291492:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787829894.291537:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729680 x1874670273306624/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829894.291564:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829894.291567:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787829894.291568:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829894.291571:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5058
00000100:00080000:2.0:1787829894.291573:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829894.291576:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829894.291591:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787829894.291599:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a1c0 x1874670273306752/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829894.291607:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829894.291610:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787829894.291611:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829894.291614:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5058
00000100:00080000:2.0:1787829894.291617:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829894.291621:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829894.291625:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787829894.291633:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728000 x1874670273306880/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829894.291641:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829894.291645:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787829894.291647:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829894.291650:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5058
00000100:00080000:2.0:1787829894.291652:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829894.291659:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787829894.291661:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273306624:192.168.203.121@tcp:250:kworker.0
00000008:00100000:2.0:1787829894.291662:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787829894.291681:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057283c0 x1874670273307008/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829894.291689:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829894.291692:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787829894.291693:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829894.291697:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5058
00000100:00080000:2.0:1787829894.291699:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829894.291702:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829894.291705:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787829894.291713:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572bc00 x1874670273307136/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829894.291719:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829894.291722:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787829894.291723:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829894.291726:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5058
00000100:00080000:2.0:1787829894.291730:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829894.291732:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829894.291735:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:3.0:1787829894.291745:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829894.291746:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a580 x1874670273307264/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829894.291756:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829894.291759:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787829894.291760:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829894.291764:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5058
00000100:00080000:2.0:1787829894.291768:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829894.291771:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829894.291774:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787829894.291780:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728780 x1874670273307392/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787829894.291813:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829894/real 1787829894]  req@ffff9ee005729680 x1874670273306624/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829919 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829894.291830:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729680 x1874670273306624/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829919 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829894.291845:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829894.291848:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829894.291852:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273306624:192.168.203.121@tcp:250:kworker.0
00000100:00100000:3.0:1787829894.291865:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273306752:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787829894.291886:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829894.291895:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829894/real 1787829894]  req@ffff9ee00572a1c0 x1874670273306752/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829919 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829894.291903:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a1c0 x1874670273306752/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829919 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829894.291908:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829894.291911:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829894.291913:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273306752:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787829894.291940:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273306880:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829894.291964:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829894.291977:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829894/real 1787829894]  req@ffff9ee005728000 x1874670273306880/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829919 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829894.291986:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728000 x1874670273306880/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829919 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829894.291992:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829894.291995:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829894.291997:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273306880:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829894.292001:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273307008:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829894.292015:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829894.292022:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829894/real 1787829894]  req@ffff9ee0057283c0 x1874670273307008/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829919 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829894.292030:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057283c0 x1874670273307008/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829919 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829894.292035:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829894.292037:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829894.292038:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273307008:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829894.292042:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273307136:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787829894.292052:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829894.292058:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829894/real 1787829894]  req@ffff9ee00572bc00 x1874670273307136/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829919 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829894.292065:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572bc00 x1874670273307136/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829919 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829894.292070:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829894.292086:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829894.292089:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273307136:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787829894.292093:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273307264:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829894.292108:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829894.292116:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829894/real 1787829894]  req@ffff9ee00572a580 x1874670273307264/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829919 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829894.292124:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a580 x1874670273307264/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829919 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829894.292129:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829894.292131:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829894.292133:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273307264:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829894.292137:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273307392:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829894.292146:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829894.292152:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829894/real 1787829894]  req@ffff9ee005728780 x1874670273307392/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829919 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829894.292159:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728780 x1874670273307392/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829919 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829894.292163:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829894.292165:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829894.292167:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273307392:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787829895.123509:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829895.315383:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829896.147563:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829896.339488:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829897.171507:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829897.363467:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829898.195516:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829898.387418:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829899.219489:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1787829899.411441:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829899.411450:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00100000:1.0:1787829899.411453:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:0.0:1787829899.411455:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829899.411468:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 5063
00000100:00080000:0.0:1787829899.411479:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829899.411487:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787829899.411519:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ea940 x1874670273307520/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829899.411546:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829899.411549:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787829899.411551:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829899.411556:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5063
00000100:00080000:0.0:1787829899.411559:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829899.411565:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829899.411575:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787829899.411594:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273307520:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787829899.411595:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ead00 x1874670273307648/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829899.411620:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829899.411624:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787829899.411626:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829899.411631:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5063
00000100:00080000:0.0:1787829899.411636:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829899.411640:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829899.411645:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787829899.411658:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8780 x1874670273307776/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829899.411668:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829899.411671:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787829899.411673:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829899.411679:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5063
00000100:00080000:0.0:1787829899.411684:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829899.411688:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829899.411693:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1787829899.411698:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829899.411710:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9680 x1874670273307904/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829899.411721:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829899.411724:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787829899.411726:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829899.411730:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5063
00000100:00080000:0.0:1787829899.411734:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829899.411739:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829899.411745:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787829899.411756:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829899/real 1787829899]  req@ffff9ee0056ea940 x1874670273307520/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829924 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829899.411760:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ea580 x1874670273308032/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829899.411814:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1787829899.411817:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ea940 x1874670273307520/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829924 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829899.411819:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787829899.411823:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829899.411837:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5063
00000100:00080000:0.0:1787829899.411845:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829899.411855:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829899.411867:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:1.0:1787829899.411869:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829899.411876:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829899.411882:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9a40 x1874670273308160/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787829899.411884:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273307520:192.168.203.121@tcp:250:kworker.0
00000100:00080000:0.0:1787829899.411906:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829899.411910:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787829899.411913:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829899.411918:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5063
00000100:00080000:0.0:1787829899.411924:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829899.411932:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787829899.411932:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273307648:192.168.203.121@tcp:38:kworker.0
00000008:00100000:0.0:1787829899.411943:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787829899.411957:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb0c0 x1874670273308288/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1787829899.411979:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829899.412005:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829899/real 1787829899]  req@ffff9ee0056ead00 x1874670273307648/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829924 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829899.412022:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ead00 x1874670273307648/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829924 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829899.412030:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829899.412034:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829899.412048:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273307648:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787829899.412057:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273307776:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787829899.412085:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829899.412097:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829899/real 1787829899]  req@ffff9ee0056e8780 x1874670273307776/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829924 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829899.412108:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8780 x1874670273307776/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829924 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829899.412116:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829899.412119:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829899.412122:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273307776:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787829899.412128:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273307904:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787829899.412146:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829899.412154:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829899/real 1787829899]  req@ffff9ee0056e9680 x1874670273307904/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829924 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829899.412164:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9680 x1874670273307904/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829924 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829899.412172:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829899.412175:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829899.412178:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273307904:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787829899.412183:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273308032:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787829899.412199:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829899.412208:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829899/real 1787829899]  req@ffff9ee0056ea580 x1874670273308032/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829924 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829899.412218:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ea580 x1874670273308032/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829924 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829899.412225:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829899.412228:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829899.412232:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273308032:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787829899.412237:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273308160:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787829899.412253:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829899.412263:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829899/real 1787829899]  req@ffff9ee0056e9a40 x1874670273308160/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829924 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829899.412273:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9a40 x1874670273308160/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829924 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829899.412280:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829899.412283:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829899.412286:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273308160:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787829899.412304:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273308288:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787829899.412347:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829899.412368:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829899/real 1787829899]  req@ffff9ee0056eb0c0 x1874670273308288/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829924 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829899.412380:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb0c0 x1874670273308288/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829924 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829899.412387:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829899.412390:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829899.412393:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273308288:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787829900.243517:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829900.435388:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829901.267518:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829901.459447:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829902.291536:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829902.483417:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829903.315553:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829903.507443:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829904.339527:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829904.531438:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787829904.531438:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829904.531449:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787829904.531455:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829904.531468:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 5068
00000100:00080000:3.0:1787829904.531481:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829904.531490:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787829904.531535:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705680 x1874670273308416/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829904.531563:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829904.531567:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787829904.531569:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829904.531574:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5068
00000100:00080000:3.0:1787829904.531578:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829904.531583:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787829904.531595:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273308416:192.168.203.121@tcp:250:kworker.0
00000008:00100000:3.0:1787829904.531595:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787829904.531612:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707840 x1874670273308544/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829904.531624:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829904.531627:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787829904.531629:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829904.531633:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5068
00000100:00080000:3.0:1787829904.531637:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829904.531641:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829904.531647:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829904.531658:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704000 x1874670273308672/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1787829904.531671:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787829904.531679:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829904.531684:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787829904.531686:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829904.531690:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5068
00000100:00080000:3.0:1787829904.531694:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829904.531698:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829904.531702:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829904.531713:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707480 x1874670273308800/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829904.531723:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829904.531727:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787829904.531730:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1787829904.531732:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829904/real 1787829904]  req@ffff9ee005705680 x1874670273308416/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829929 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829904.531737:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5068
00000100:00080000:3.0:1787829904.531743:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829904.531749:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829904.531755:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787829904.531764:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705680 x1874670273308416/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829929 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829904.531767:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707c00 x1874670273308928/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829904.531793:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829904.531794:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829904.531799:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787829904.531803:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829904.531804:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:3.0:1787829904.531810:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5068
00000100:00100000:1.0:1787829904.531812:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273308416:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787829904.531816:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829904.531822:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829904.531827:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829904.531838:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057052c0 x1874670273309056/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787829904.531841:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273308544:192.168.203.121@tcp:38:kworker.0
00000100:00080000:3.0:1787829904.531854:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829904.531858:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787829904.531860:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829904.531864:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5068
00000100:00080000:3.0:1787829904.531869:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829904.531876:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000800:00000100:1.0:1787829904.531877:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000008:00100000:3.0:1787829904.531885:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787829904.531902:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829904/real 1787829904]  req@ffff9ee005707840 x1874670273308544/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829929 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829904.531902:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057070c0 x1874670273309184/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787829904.531935:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707840 x1874670273308544/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829929 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829904.531944:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829904.531948:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829904.531951:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273308544:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787829904.531957:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273308672:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787829904.531974:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829904.531982:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829904/real 1787829904]  req@ffff9ee005704000 x1874670273308672/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829929 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829904.531989:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704000 x1874670273308672/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829929 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829904.531999:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829904.532012:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829904.532015:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273308672:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787829904.532019:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273308800:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787829904.532032:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829904.532039:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829904/real 1787829904]  req@ffff9ee005707480 x1874670273308800/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829929 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829904.532046:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707480 x1874670273308800/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829929 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829904.532051:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829904.532053:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829904.532055:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273308800:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787829904.532058:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273308928:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787829904.532067:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829904.532072:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829904/real 1787829904]  req@ffff9ee005707c00 x1874670273308928/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829929 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829904.532084:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707c00 x1874670273308928/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829929 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829904.532091:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829904.532093:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829904.532095:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273308928:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787829904.532107:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273309056:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787829904.532117:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829904.532123:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829904/real 1787829904]  req@ffff9ee0057052c0 x1874670273309056/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829929 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829904.532129:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057052c0 x1874670273309056/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829929 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829904.532134:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829904.532135:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829904.532137:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273309056:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787829904.532139:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273309184:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787829904.532148:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829904.532153:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829904/real 1787829904]  req@ffff9ee0057070c0 x1874670273309184/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829929 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829904.532159:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057070c0 x1874670273309184/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829929 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829904.532164:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829904.532165:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829904.532167:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273309184:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787829905.363500:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829905.555444:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829906.387503:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829906.579430:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829907.411508:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829907.603414:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829908.435495:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829908.627425:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829909.459509:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1787829909.651502:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829909.651512:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1787829909.651516:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829909.651526:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 5073
00000100:00080000:0.0:1787829909.651537:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829909.651556:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787829909.651592:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8b40 x1874670273309312/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829909.651627:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829909.651631:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787829909.651633:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829909.651637:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5073
00000100:00080000:0.0:1787829909.651641:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829909.651645:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829909.651654:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787829909.651665:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e92c0 x1874670273309440/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829909.651674:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829909.651678:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787829909.651679:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829909.651682:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5073
00000100:00080000:0.0:1787829909.651693:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829909.651697:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829909.651702:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787829909.651711:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb480 x1874670273309568/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829909.651720:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829909.651723:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787829909.651725:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829909.651728:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5073
00000100:00080000:0.0:1787829909.651732:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829909.651735:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829909.651739:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787829909.651748:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb840 x1874670273309696/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829909.651756:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829909.651759:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787829909.651761:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829909.651765:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5073
00000100:00080000:0.0:1787829909.651768:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829909.651771:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829909.651775:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787829909.651784:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8f00 x1874670273309824/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829909.651792:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829909.651795:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787829909.651796:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829909.651800:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5073
00000100:00080000:0.0:1787829909.651803:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829909.651806:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829909.651810:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787829909.651819:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e83c0 x1874670273309952/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829909.651832:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829909.651836:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787829909.651837:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829909.651840:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5073
00000100:00080000:0.0:1787829909.651843:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829909.651847:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829909.651851:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787829909.651859:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ebc00 x1874670273310080/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787829909.653144:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273309312:192.168.203.121@tcp:250:kworker.0
00000100:00100000:2.0:1787829909.653161:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000800:00000100:1.0:1787829909.653250:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829909.653287:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829909/real 1787829909]  req@ffff9ee0056e8b40 x1874670273309312/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829934 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829909.653300:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8b40 x1874670273309312/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829934 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829909.653307:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829909.653309:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829909.653312:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273309312:192.168.203.121@tcp:250:kworker.0
00000100:00100000:1.0:1787829909.653330:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273309440:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787829909.653347:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829909.653356:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829909/real 1787829909]  req@ffff9ee0056e92c0 x1874670273309440/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829934 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829909.653365:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e92c0 x1874670273309440/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829934 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829909.653373:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829909.653376:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829909.653379:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273309440:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787829909.653385:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273309568:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787829909.653405:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829909.653416:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829909/real 1787829909]  req@ffff9ee0056eb480 x1874670273309568/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829934 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829909.653425:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb480 x1874670273309568/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829934 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829909.653432:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829909.653435:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829909.653438:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273309568:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787829909.653444:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273309696:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787829909.653464:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829909.653475:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829909/real 1787829909]  req@ffff9ee0056eb840 x1874670273309696/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829934 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829909.653484:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb840 x1874670273309696/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829934 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829909.653489:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829909.653491:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829909.653493:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273309696:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787829909.653497:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273309824:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787829909.653510:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829909.653517:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829909/real 1787829909]  req@ffff9ee0056e8f00 x1874670273309824/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829934 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829909.653527:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8f00 x1874670273309824/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829934 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829909.653535:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829909.653538:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829909.653541:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273309824:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787829909.653547:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273309952:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787829909.653565:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829909.653574:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829909/real 1787829909]  req@ffff9ee0056e83c0 x1874670273309952/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829934 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829909.653580:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e83c0 x1874670273309952/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829934 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829909.653585:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829909.653587:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829909.653589:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273309952:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787829909.653592:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273310080:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787829909.653603:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829909.653608:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829909/real 1787829909]  req@ffff9ee0056ebc00 x1874670273310080/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829934 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829909.653615:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ebc00 x1874670273310080/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829934 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829909.653622:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829909.653625:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829909.653628:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273310080:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787829910.483512:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829910.675389:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829911.507514:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829911.699426:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829912.531464:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829912.723428:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829913.555478:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829913.747437:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829914.579472:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829914.771410:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:2.0:1787829914.771430:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829914.771437:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787829914.771440:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829914.771449:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 5078
00000100:00080000:2.0:1787829914.771458:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829914.771465:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787829914.771497:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057292c0 x1874670273310208/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829914.771516:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829914.771518:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787829914.771520:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829914.771522:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5078
00000100:00080000:2.0:1787829914.771525:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829914.771527:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829914.771535:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787829914.771547:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057292c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273310208:192.168.203.121@tcp:250:kworker.0
00000100:00100000:2.0:1787829914.771548:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a940 x1874670273310336/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829914.771563:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829914.771567:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787829914.771569:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829914.771572:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5078
00000100:00080000:2.0:1787829914.771576:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829914.771580:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829914.771585:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787829914.771595:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729e00 x1874670273310464/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829914.771601:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829914.771603:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787829914.771605:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829914.771607:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5078
00000100:00080000:2.0:1787829914.771609:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829914.771612:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829914.771614:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787829914.771622:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728780 x1874670273310592/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829914.771627:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829914.771629:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787829914.771631:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829914.771633:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5078
00000100:00080000:2.0:1787829914.771635:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829914.771639:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829914.771643:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787829914.771651:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273310336:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787829914.771656:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a580 x1874670273310720/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829914.771668:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829914.771679:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787829914.771681:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1787829914.771683:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273310464:192.168.203.121@tcp:8:kworker.0
00000100:00080000:2.0:1787829914.771688:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5078
00000100:00080000:2.0:1787829914.771695:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829914.771700:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829914.771705:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787829914.771712:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273310592:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787829914.771720:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572bc00 x1874670273310848/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829914.771729:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829914.771732:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787829914.771733:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829914.771737:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5078
00000100:00100000:1.0:1787829914.771739:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273310720:192.168.203.121@tcp:38:kworker.0
00000100:00080000:2.0:1787829914.771741:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829914.771747:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829914.771752:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787829914.771762:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057283c0 x1874670273310976/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787829914.771771:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273310848:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787829914.771794:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273310976:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787829915.603496:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829915.795442:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829916.627500:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829916.819369:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829917.651468:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829917.843421:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000400:00000100:3.0:1787829917.843535:0:2355:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.203.121:988
00000400:00000100:3.0:1787829917.843569:0:2355:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.203.121@tcp at host 192.168.203.121 was unreachable: the network or that node may be down, or Lustre may be misconfigured.
00000800:00000100:3.0:1787829917.843581:0:2355:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:3.0:1787829917.843662:0:2355:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:3.0:1787829917.843671:0:2355:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:3.0:1787829917.843679:0:2355:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:3.0:1787829917.843687:0:2355:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:3.0:1787829917.843697:0:2355:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:3.0:1787829917.843706:0:2355:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000100:00100000:1.0:1787829917.843717:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829914/real 1787829917]  req@ffff9ee00572a580 x1874670273310720/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829939 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829917.843738:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a580 x1874670273310720/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829939 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829917.843749:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829917.843754:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829917.843757:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273310720:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787829917.843764:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829914/real 1787829917]  req@ffff9ee00572bc00 x1874670273310848/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829939 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829917.843777:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572bc00 x1874670273310848/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829939 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829917.843784:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829917.843788:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829917.843791:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273310848:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787829917.843797:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829914/real 1787829917]  req@ffff9ee00572a940 x1874670273310336/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829939 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829917.843809:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a940 x1874670273310336/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829939 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829917.843816:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829917.843819:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829917.843822:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273310336:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787829917.843827:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829914/real 1787829917]  req@ffff9ee005729e00 x1874670273310464/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829939 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829917.843838:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729e00 x1874670273310464/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829939 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829917.843845:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829917.843848:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829917.843852:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273310464:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787829917.843857:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829914/real 1787829917]  req@ffff9ee005728780 x1874670273310592/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829939 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829917.843868:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728780 x1874670273310592/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829939 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829917.843876:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829917.843879:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829917.843882:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273310592:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787829917.843887:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829914/real 1787829917]  req@ffff9ee0057292c0 x1874670273310208/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829939 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829917.843896:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057292c0 x1874670273310208/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829939 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829917.843902:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829917.843905:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829917.843908:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057292c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273310208:192.168.203.121@tcp:250:kworker.0
00000100:00100000:1.0:1787829917.843952:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829914/real 1787829917]  req@ffff9ee0057283c0 x1874670273310976/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829939 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829917.843963:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057283c0 x1874670273310976/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829939 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829917.843970:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829917.843973:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829917.843976:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273310976:192.168.203.121@tcp:8:kworker.0
00010000:00010000:0.0:1787829918.675486:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829918.867435:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829919.699493:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829919.891389:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:0.0:1787829919.891502:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829919.891506:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1787829919.891509:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829919.891516:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 5083
00000100:00080000:0.0:1787829919.891527:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829919.891533:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787829919.891563:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8000 x1874670273311104/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829919.891591:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829919.891595:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787829919.891597:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829919.891601:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5083
00000100:00080000:0.0:1787829919.891605:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829919.891610:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829919.891618:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787829919.891631:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9e00 x1874670273311232/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829919.891640:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829919.891643:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787829919.891644:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829919.891647:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5083
00000100:00080000:0.0:1787829919.891650:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829919.891653:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829919.891658:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787829919.891667:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ebc00 x1874670273311360/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829919.891674:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829919.891676:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787829919.891678:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829919.891681:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5083
00000100:00080000:0.0:1787829919.891684:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829919.891687:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829919.891691:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787829919.891699:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e83c0 x1874670273311488/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829919.891712:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829919.891715:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787829919.891716:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829919.891719:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5083
00000100:00080000:0.0:1787829919.891723:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829919.891726:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829919.891730:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787829919.891740:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8f00 x1874670273311616/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829919.891750:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1787829919.891753:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273311104:192.168.203.121@tcp:250:kworker.0
00000100:00080000:0.0:1787829919.891755:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787829919.891759:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829919.891765:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5083
00000100:00080000:0.0:1787829919.891768:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829919.891771:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829919.891776:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787829919.891786:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb840 x1874670273311744/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829919.891795:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829919.891798:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787829919.891800:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829919.891804:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5083
00000800:00000100:1.0:1787829919.891828:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:0.0:1787829919.892269:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829919.892277:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829919.892283:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787829919.892296:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb480 x1874670273311872/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787829919.892313:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829919/real 1787829919]  req@ffff9ee0056e8000 x1874670273311104/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829944 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829919.892356:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8000 x1874670273311104/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829944 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829919.892379:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829919.892384:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829919.892387:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273311104:192.168.203.121@tcp:250:kworker.0
00000100:00100000:1.0:1787829919.892395:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273311232:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787829919.892418:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829919.892442:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829919/real 1787829919]  req@ffff9ee0056e9e00 x1874670273311232/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829944 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829919.892457:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9e00 x1874670273311232/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829944 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829919.892465:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829919.892469:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829919.892471:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273311232:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787829919.892475:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273311360:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787829919.892494:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829919.892505:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829919/real 1787829919]  req@ffff9ee0056ebc00 x1874670273311360/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829944 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829919.892516:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ebc00 x1874670273311360/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829944 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829919.892523:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829919.892526:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829919.892537:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273311360:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787829919.892543:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273311488:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787829919.892561:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829919.892572:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829919/real 1787829919]  req@ffff9ee0056e83c0 x1874670273311488/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829944 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829919.892583:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e83c0 x1874670273311488/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829944 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829919.892590:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829919.892592:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829919.892595:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273311488:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787829919.892624:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273311616:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787829919.892642:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829919.892652:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829919/real 1787829919]  req@ffff9ee0056e8f00 x1874670273311616/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829944 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829919.892663:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8f00 x1874670273311616/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829944 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829919.892677:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829919.892681:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829919.892684:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273311616:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787829919.892690:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273311744:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787829919.892708:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829919.892718:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829919/real 1787829919]  req@ffff9ee0056eb840 x1874670273311744/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829944 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829919.892730:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb840 x1874670273311744/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829944 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829919.892737:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829919.892740:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829919.892744:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273311744:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787829919.892750:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273311872:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787829919.892767:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829919.892777:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829919/real 1787829919]  req@ffff9ee0056eb480 x1874670273311872/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829944 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829919.892786:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb480 x1874670273311872/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829944 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829919.892794:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829919.892796:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829919.892800:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273311872:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787829920.723431:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829920.915435:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829921.747513:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829921.939390:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829922.771477:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829922.963430:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829923.795486:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829923.987431:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829924.819499:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829925.011413:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:0.0:1787829925.011420:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829925.011427:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1787829925.011431:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829925.011440:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 5088
00000100:00080000:0.0:1787829925.011451:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829925.011457:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787829925.011486:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e92c0 x1874670273312000/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829925.011517:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829925.011521:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787829925.011524:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829925.011529:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5088
00000100:00080000:0.0:1787829925.011533:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829925.011537:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787829925.011542:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273312000:192.168.203.121@tcp:250:kworker.0
00000008:00100000:0.0:1787829925.011547:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787829925.011560:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8b40 x1874670273312128/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829925.011572:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829925.011576:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787829925.011578:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829925.011581:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5088
00000100:00080000:0.0:1787829925.011593:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829925.011597:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829925.011603:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1787829925.011603:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829925.011617:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb0c0 x1874670273312256/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829925.011628:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829925.011630:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787829925.011632:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829925.011636:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5088
00000100:00080000:0.0:1787829925.011640:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1787829925.011643:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829925/real 1787829925]  req@ffff9ee0056e92c0 x1874670273312000/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829950 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829925.011648:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787829925.011661:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e92c0 x1874670273312000/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829950 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:0.0:1787829925.011664:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:1.0:1787829925.011673:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829925.011676:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829925.011683:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273312000:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787829925.011684:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9a40 x1874670273312384/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829925.011696:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829925.011699:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00100000:1.0:1787829925.011700:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273312128:192.168.203.121@tcp:38:kworker.0
00000100:00080000:0.0:1787829925.011702:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829925.011707:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5088
00000100:00080000:0.0:1787829925.011711:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829925.011714:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829925.011718:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000800:00000100:1.0:1787829925.011722:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829925.011731:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ea580 x1874670273312512/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787829925.011734:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829925/real 1787829925]  req@ffff9ee0056e8b40 x1874670273312128/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829950 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829925.011752:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1787829925.011755:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8b40 x1874670273312128/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829950 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829925.011756:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787829925.011759:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829925.011765:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5088
00000100:00080000:1.0:1787829925.011769:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829925.011770:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829925.011775:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00080000:0.0:1787829925.011778:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787829925.011780:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273312128:192.168.203.121@tcp:38:kworker.0
00000008:00100000:0.0:1787829925.011787:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787829925.011787:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273312256:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829925.011805:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9680 x1874670273312640/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1787829925.011806:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829925.011814:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829925/real 1787829925]  req@ffff9ee0056eb0c0 x1874670273312256/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829950 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829925.011819:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829925.011824:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:1.0:1787829925.011824:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb0c0 x1874670273312256/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829950 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829925.011828:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829925.011835:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829925.011836:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5088
00000100:00080000:1.0:1787829925.011841:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00080000:0.0:1787829925.011845:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1787829925.011845:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273312256:192.168.203.121@tcp:8:kworker.0
00000100:00080000:0.0:1787829925.011854:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787829925.011854:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273312384:192.168.203.121@tcp:8:kworker.0
00000008:00100000:0.0:1787829925.011873:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787829925.011887:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8780 x1874670273312768/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1787829925.011891:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829925.011902:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829925/real 1787829925]  req@ffff9ee0056e9a40 x1874670273312384/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829950 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829925.011910:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9a40 x1874670273312384/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829950 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829925.011915:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829925.011917:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829925.011919:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273312384:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787829925.011933:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273312512:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787829925.011943:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829925.011950:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829925/real 1787829925]  req@ffff9ee0056ea580 x1874670273312512/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829950 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829925.011958:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ea580 x1874670273312512/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829950 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829925.011963:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829925.011966:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829925.011969:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273312512:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787829925.011972:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273312640:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787829925.011982:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829925.011987:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829925/real 1787829925]  req@ffff9ee0056e9680 x1874670273312640/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829950 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829925.011994:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9680 x1874670273312640/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829950 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829925.011998:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829925.012000:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829925.012001:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273312640:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787829925.012004:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273312768:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787829925.012012:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829925.012016:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829925/real 1787829925]  req@ffff9ee0056e8780 x1874670273312768/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829950 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829925.012022:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8780 x1874670273312768/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829950 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829925.012027:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829925.012029:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829925.012031:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273312768:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787829925.843475:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829926.035417:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829926.867480:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829927.059407:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829927.891475:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829928.083438:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829928.915498:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787829929.107422:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829929.939460:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1787829930.131411:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829930.131418:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787829930.131421:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1787829930.131429:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:2.0:1787829930.131430:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 5093
00000100:00080000:2.0:1787829930.131442:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829930.131448:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787829930.131479:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728000 x1874670273312896/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829930.131502:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829930.131505:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787829930.131507:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829930.131511:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5093
00000100:00080000:2.0:1787829930.131514:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829930.131518:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829930.131529:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787829930.131538:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a1c0 x1874670273313024/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829930.131546:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829930.131548:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787829930.131550:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829930.131554:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5093
00000100:00100000:1.0:1787829930.131555:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273312896:192.168.203.121@tcp:250:kworker.0
00000100:00080000:2.0:1787829930.131556:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829930.131562:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829930.131568:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787829930.131580:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729680 x1874670273313152/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829930.131590:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829930.131593:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787829930.131595:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829930.131599:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5093
00000100:00080000:2.0:1787829930.131602:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829930.131606:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829930.131611:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787829930.131621:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728b40 x1874670273313280/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1787829930.131630:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:2.0:1787829930.131632:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829930.131637:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787829930.131639:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829930.131644:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5093
00000100:00080000:2.0:1787829930.131649:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829930.131653:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829930.131658:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787829930.131668:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728f00 x1874670273313408/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829930.131675:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1787829930.131678:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829930/real 1787829930]  req@ffff9ee005728000 x1874670273312896/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829955 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829930.131679:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787829930.131683:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829930.131693:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5093
00000100:00080000:2.0:1787829930.131699:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829930.131705:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787829930.131706:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728000 x1874670273312896/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829955 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:2.0:1787829930.131712:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:1.0:1787829930.131721:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829930.131726:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:2.0:1787829930.131731:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b840 x1874670273313536/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787829930.131732:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273312896:192.168.203.121@tcp:250:kworker.0
00000100:00080000:2.0:1787829930.131745:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829930.131747:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787829930.131749:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829930.131752:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5093
00000100:00080000:2.0:1787829930.131754:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829930.131757:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829930.131760:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787829930.131762:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273313024:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787829930.131770:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729a40 x1874670273313664/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1787829930.131790:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829930.131804:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829930/real 1787829930]  req@ffff9ee00572a1c0 x1874670273313024/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829955 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829930.131837:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a1c0 x1874670273313024/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829955 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829930.131846:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829930.131849:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829930.131853:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273313024:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787829930.131859:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273313152:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787829930.131878:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829930.131890:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829930/real 1787829930]  req@ffff9ee005729680 x1874670273313152/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829955 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829930.131902:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729680 x1874670273313152/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829955 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829930.131910:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829930.131913:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829930.131916:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273313152:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787829930.131922:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273313280:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787829930.131940:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829930.131950:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829930/real 1787829930]  req@ffff9ee005728b40 x1874670273313280/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829955 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829930.131961:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728b40 x1874670273313280/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829955 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829930.131968:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829930.131981:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829930.131985:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273313280:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787829930.131991:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273313408:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787829930.132010:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829930.132021:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829930/real 1787829930]  req@ffff9ee005728f00 x1874670273313408/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829955 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829930.132032:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728f00 x1874670273313408/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829955 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829930.132039:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829930.132042:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829930.132045:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273313408:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787829930.132051:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273313536:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787829930.132068:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829930.132078:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829930/real 1787829930]  req@ffff9ee00572b840 x1874670273313536/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829955 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829930.132088:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b840 x1874670273313536/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829955 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829930.132095:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829930.132098:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829930.132100:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273313536:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787829930.132119:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273313664:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787829930.132136:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829930.132146:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829930/real 1787829930]  req@ffff9ee005729a40 x1874670273313664/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829955 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829930.132163:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729a40 x1874670273313664/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829955 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829930.132170:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829930.132173:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829930.132176:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273313664:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787829930.963480:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787829931.155423:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829931.987496:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787829932.179424:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829933.011513:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787829933.204029:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829934.035505:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787829934.229134:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829935.059487:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1787829935.251433:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829935.251442:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787829935.251446:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829935.251456:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 5098
00000100:00100000:1.0:1787829935.251457:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:2.0:1787829935.251465:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829935.251473:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787829935.251505:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b0c0 x1874670273313792/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829935.251534:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829935.251538:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787829935.251540:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829935.251543:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5098
00000100:00080000:2.0:1787829935.251547:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829935.251551:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829935.251561:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787829935.251575:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273313792:192.168.203.121@tcp:250:kworker.0
00000100:00100000:2.0:1787829935.251575:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b480 x1874670273313920/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829935.251591:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829935.251594:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787829935.251596:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829935.251601:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5098
00000100:00080000:2.0:1787829935.251605:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829935.251609:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829935.251614:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787829935.251626:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572ad00 x1874670273314048/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829935.251635:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829935.251639:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787829935.251641:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829935.251644:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5098
00000100:00080000:2.0:1787829935.251648:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829935.251651:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829935.251656:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787829935.251665:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729a40 x1874670273314176/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829935.251679:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829935.251682:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787829935.251683:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829935.251687:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5098
00000100:00080000:2.0:1787829935.251689:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829935.251692:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829935.251695:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787829935.251702:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b840 x1874670273314304/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829935.251711:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829935.251714:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787829935.251715:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829935.251719:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5098
00000100:00080000:2.0:1787829935.251721:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829935.251724:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829935.251727:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787829935.251734:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728f00 x1874670273314432/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829935.251743:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829935.251746:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787829935.251747:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829935.251750:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5098
00000100:00080000:2.0:1787829935.251754:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829935.251758:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829935.251762:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787829935.251769:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728b40 x1874670273314560/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1787829935.252786:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829935.252849:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829935/real 1787829935]  req@ffff9ee00572b0c0 x1874670273313792/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829960 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829935.252866:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b0c0 x1874670273313792/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829960 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829935.252876:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829935.252881:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829935.252885:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273313792:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787829935.252908:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273313920:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787829935.252932:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829935.252945:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829935/real 1787829935]  req@ffff9ee00572b480 x1874670273313920/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829960 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829935.252958:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b480 x1874670273313920/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829960 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829935.252967:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829935.252970:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829935.252974:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273313920:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787829935.252982:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273314048:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829935.253002:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829935.253013:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829935/real 1787829935]  req@ffff9ee00572ad00 x1874670273314048/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829960 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829935.253024:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572ad00 x1874670273314048/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829960 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829935.253031:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829935.253035:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829935.253038:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273314048:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829935.253043:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273314176:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829935.253063:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829935.253074:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829935/real 1787829935]  req@ffff9ee005729a40 x1874670273314176/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829960 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829935.253084:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729a40 x1874670273314176/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829960 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829935.253091:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829935.253095:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829935.253098:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273314176:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829935.253104:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273314304:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787829935.253121:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829935.253131:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829935/real 1787829935]  req@ffff9ee00572b840 x1874670273314304/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829960 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829935.253142:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b840 x1874670273314304/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829960 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829935.253149:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829935.253152:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829935.253155:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273314304:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787829935.253160:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273314432:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829935.253176:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829935.253185:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829935/real 1787829935]  req@ffff9ee005728f00 x1874670273314432/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829960 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829935.253196:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728f00 x1874670273314432/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829960 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829935.253203:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829935.253206:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829935.253208:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273314432:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829935.253214:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273314560:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829935.253228:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829935.253236:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829935/real 1787829935]  req@ffff9ee005728b40 x1874670273314560/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829960 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829935.253245:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728b40 x1874670273314560/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829960 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829935.253258:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829935.253260:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829935.253263:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273314560:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787829936.083434:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829936.275417:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829937.107500:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829937.299395:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829938.131475:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829938.323439:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829939.155495:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829939.347431:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829940.179466:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829940.371412:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787829940.371416:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829940.371422:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787829940.371425:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829940.371432:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 5104
00000100:00080000:3.0:1787829940.371441:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829940.371447:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787829940.371473:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706940 x1874670273314688/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829940.371493:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829940.371497:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787829940.371498:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829940.371500:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5104
00000100:00080000:3.0:1787829940.371503:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829940.371504:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829940.371511:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787829940.371517:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057061c0 x1874670273314816/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829940.371523:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829940.371525:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787829940.371526:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829940.371528:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5104
00000100:00080000:3.0:1787829940.371529:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829940.371531:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829940.371533:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829940.371540:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057070c0 x1874670273314944/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829940.371549:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829940.371552:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787829940.371554:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829940.371558:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5104
00000100:00080000:3.0:1787829940.371561:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1787829940.371568:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273314688:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787829940.371568:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829940.371576:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829940.371590:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057052c0 x1874670273315072/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829940.371598:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829940.371600:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787829940.371601:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829940.371604:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5104
00000100:00080000:3.0:1787829940.371606:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829940.371608:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829940.371611:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787829940.371619:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707c00 x1874670273315200/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1787829940.371624:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787829940.371630:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829940.371633:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787829940.371634:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829940.371637:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5104
00000100:00080000:3.0:1787829940.371640:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829940.371642:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829940.371644:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829940.371651:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707480 x1874670273315328/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829940.371656:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1787829940.371660:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829940/real 1787829940]  req@ffff9ee005706940 x1874670273314688/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829965 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829940.371660:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787829940.371663:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829940.371670:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5104
00000100:00080000:3.0:1787829940.371674:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829940.371678:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829940.371681:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787829940.371684:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706940 x1874670273314688/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829965 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829940.371691:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704000 x1874670273315456/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829940.371693:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829940.371701:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829940.371705:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273314688:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787829940.371710:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273314816:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787829940.371724:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829940.371731:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829940/real 1787829940]  req@ffff9ee0057061c0 x1874670273314816/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829965 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829940.371738:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057061c0 x1874670273314816/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829965 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829940.371743:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829940.371745:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829940.371747:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273314816:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787829940.371750:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273314944:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829940.371777:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829940.371784:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829940/real 1787829940]  req@ffff9ee0057070c0 x1874670273314944/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829965 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829940.371790:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057070c0 x1874670273314944/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829965 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829940.371795:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829940.371796:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829940.371798:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273314944:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829940.371814:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273315072:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829940.371824:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829940.371829:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829940/real 1787829940]  req@ffff9ee0057052c0 x1874670273315072/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829965 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829940.371835:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057052c0 x1874670273315072/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829965 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829940.371839:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829940.371841:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829940.371842:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273315072:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829940.371845:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273315200:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787829940.371853:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829940.371858:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829940/real 1787829940]  req@ffff9ee005707c00 x1874670273315200/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829965 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829940.371864:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707c00 x1874670273315200/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829965 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829940.371868:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829940.371870:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829940.371871:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273315200:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787829940.371874:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273315328:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829940.371882:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829940.371886:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829940/real 1787829940]  req@ffff9ee005707480 x1874670273315328/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829965 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829940.371892:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707480 x1874670273315328/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829965 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829940.371896:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829940.371897:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829940.371899:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273315328:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829940.371902:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273315456:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829940.371910:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829940.371914:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829940/real 1787829940]  req@ffff9ee005704000 x1874670273315456/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829965 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829940.371919:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704000 x1874670273315456/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829965 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829940.371924:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829940.371926:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829940.371927:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273315456:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787829941.203460:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829941.395378:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829942.227460:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829942.419424:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829943.251508:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829943.443391:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829944.275481:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829944.467419:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829945.299450:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829945.491410:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:0.0:1787829945.491426:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829945.491432:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1787829945.491441:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829945.491448:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 5109
00000100:00080000:0.0:1787829945.491456:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829945.491461:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787829945.491490:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ead00 x1874670273315584/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829945.491511:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829945.491514:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787829945.491516:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829945.491519:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5109
00000100:00080000:0.0:1787829945.491523:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829945.491528:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787829945.491536:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273315584:192.168.203.121@tcp:250:kworker.0
00000008:00100000:0.0:1787829945.491545:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787829945.491560:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ea940 x1874670273315712/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829945.491568:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829945.491571:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787829945.491572:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829945.491574:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5109
00000100:00080000:0.0:1787829945.491579:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829945.491582:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829945.491586:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1787829945.491589:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829945.491597:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8780 x1874670273315840/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829945.491603:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829945.491605:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787829945.491606:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829945.491608:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5109
00000100:00080000:0.0:1787829945.491609:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829945.491611:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829945.491613:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787829945.491618:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9680 x1874670273315968/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829945.491624:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829945.491626:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787829945.491628:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829945.491630:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5109
00000100:00080000:0.0:1787829945.491632:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829945.491635:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829945.491638:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787829945.491646:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829945/real 1787829945]  req@ffff9ee0056ead00 x1874670273315584/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829970 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829945.491647:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ea580 x1874670273316096/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829945.491676:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829945.491678:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787829945.491679:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829945.491683:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5109
00000100:00100000:1.0:1787829945.491683:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ead00 x1874670273315584/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829970 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829945.491685:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829945.491690:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829945.491696:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:1.0:1787829945.491701:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:0.0:1787829945.491705:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9a40 x1874670273316224/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829945.491707:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829945.491714:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273315584:192.168.203.121@tcp:250:kworker.0
00000100:00080000:0.0:1787829945.491727:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829945.491732:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787829945.491735:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829945.491738:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5109
00000100:00080000:0.0:1787829945.491741:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829945.491743:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829945.491747:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787829945.491754:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273315712:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787829945.491757:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb0c0 x1874670273316352/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1787829945.491777:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829945.491789:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829945/real 1787829945]  req@ffff9ee0056ea940 x1874670273315712/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829970 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829945.491797:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ea940 x1874670273315712/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829970 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829945.491805:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829945.491808:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829945.491811:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273315712:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787829945.491816:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273315840:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787829945.491836:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829945.491846:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829945/real 1787829945]  req@ffff9ee0056e8780 x1874670273315840/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829970 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829945.491854:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8780 x1874670273315840/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829970 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829945.491859:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829945.491861:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829945.491863:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273315840:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787829945.491867:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273315968:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787829945.491878:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829945.491884:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829945/real 1787829945]  req@ffff9ee0056e9680 x1874670273315968/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829970 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829945.491891:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9680 x1874670273315968/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829970 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829945.491895:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829945.491897:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829945.491898:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273315968:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787829945.491901:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273316096:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787829945.491909:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829945.491922:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829945/real 1787829945]  req@ffff9ee0056ea580 x1874670273316096/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829970 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829945.491928:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ea580 x1874670273316096/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829970 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829945.491933:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829945.491935:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829945.491937:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273316096:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787829945.491939:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273316224:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787829945.491949:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829945.491953:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829945/real 1787829945]  req@ffff9ee0056e9a40 x1874670273316224/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829970 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829945.491961:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9a40 x1874670273316224/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829970 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829945.491968:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829945.491971:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829945.491974:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273316224:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787829945.491990:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273316352:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787829945.492007:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829945.492014:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829945/real 1787829945]  req@ffff9ee0056eb0c0 x1874670273316352/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829970 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829945.492020:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb0c0 x1874670273316352/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829970 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829945.492025:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787829945.492027:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787829945.492028:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273316352:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787829946.323464:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829946.515418:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829947.347461:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829947.539407:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829948.371494:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829948.563470:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829949.395478:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787829949.587454:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829950.419534:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787829950.611393:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:1.0:1787829950.611449:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829950.611460:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1787829950.611465:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829950.611475:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 5114
00000100:00080000:1.0:1787829950.611487:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829950.611494:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787829950.611539:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a12c0 x1874670273316480/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829950.611570:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829950.611573:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787829950.611574:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829950.611577:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5114
00000100:00080000:1.0:1787829950.611580:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829950.611583:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829950.611593:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787829950.611611:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1a40 x1874670273316608/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787829950.611612:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273316480:192.168.203.121@tcp:250:kworker.0
00000100:00080000:1.0:1787829950.611635:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829950.611638:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787829950.611640:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829950.611645:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5114
00000100:00080000:1.0:1787829950.611648:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829950.611651:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829950.611654:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787829950.611663:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a03c0 x1874670273316736/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829950.611670:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829950.611672:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787829950.611673:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829950.611677:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5114
00000100:00080000:1.0:1787829950.611694:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829950.611698:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000800:00000100:0.0:1787829950.611703:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000008:00100000:1.0:1787829950.611709:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787829950.611721:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1680 x1874670273316864/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829950.611730:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829950.611732:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787829950.611734:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829950.611738:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5114
00000100:00080000:1.0:1787829950.611743:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829950.611747:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829950.611750:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787829950.611753:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829950/real 1787829950]  req@ffff9ee0056a12c0 x1874670273316480/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829975 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787829950.611765:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a21c0 x1874670273316992/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829950.611774:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1787829950.611779:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a12c0 x1874670273316480/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829975 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787829950.611781:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787829950.611785:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829950.611797:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5114
00000100:00080000:1.0:1787829950.611807:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829950.611812:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00080000:0.0:1787829950.611814:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000008:00100000:1.0:1787829950.611818:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:0.0:1787829950.611820:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829950.611834:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273316480:192.168.203.121@tcp:250:kworker.0
00000100:00100000:1.0:1787829950.611842:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a2940 x1874670273317120/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829950.611854:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829950.611857:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787829950.611859:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829950.611866:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5114
00000100:00100000:0.0:1787829950.611867:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273316608:192.168.203.121@tcp:38:kworker.0
00000100:00080000:1.0:1787829950.611873:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829950.611886:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829950.611892:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:0.0:1787829950.611898:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829950.611905:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a3c00 x1874670273317248/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787829950.611915:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829950/real 1787829950]  req@ffff9ee0056a1a40 x1874670273316608/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829975 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829950.611931:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1a40 x1874670273316608/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829975 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829950.611939:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829950.611943:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829950.611946:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273316608:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787829950.611952:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273316736:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829950.611966:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829950.611972:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829950/real 1787829950]  req@ffff9ee0056a03c0 x1874670273316736/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829975 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829950.611980:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a03c0 x1874670273316736/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829975 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829950.611985:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829950.611987:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829950.611989:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273316736:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829950.611993:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273316864:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829950.612003:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829950.612009:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829950/real 1787829950]  req@ffff9ee0056a1680 x1874670273316864/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829975 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829950.612016:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1680 x1874670273316864/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829975 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829950.612021:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829950.612023:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829950.612025:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273316864:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829950.612028:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273316992:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787829950.612038:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829950.612043:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829950/real 1787829950]  req@ffff9ee0056a21c0 x1874670273316992/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829975 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829950.612050:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a21c0 x1874670273316992/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829975 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829950.612059:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829950.612061:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829950.612063:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273316992:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787829950.612067:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273317120:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829950.612076:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829950.612082:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829950/real 1787829950]  req@ffff9ee0056a2940 x1874670273317120/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829975 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829950.612088:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a2940 x1874670273317120/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829975 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829950.612093:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829950.612095:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829950.612097:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273317120:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829950.612109:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273317248:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829950.612119:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829950.612125:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829950/real 1787829950]  req@ffff9ee0056a3c00 x1874670273317248/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829975 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829950.612132:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a3c00 x1874670273317248/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829975 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829950.612137:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829950.612139:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829950.612141:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273317248:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787829951.443557:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787829951.636283:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829952.467564:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787829952.659432:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829953.491517:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787829953.683437:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829954.515515:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787829954.707431:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829955.539463:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787829955.731389:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787829955.731405:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829955.731411:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787829955.731414:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829955.731421:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 5119
00000100:00080000:3.0:1787829955.731428:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829955.731434:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787829955.731468:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707840 x1874670273317376/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829955.731487:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829955.731489:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787829955.731491:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829955.731493:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5119
00000100:00080000:3.0:1787829955.731495:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829955.731498:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829955.731505:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787829955.731512:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705680 x1874670273317504/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829955.731519:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829955.731521:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787829955.731522:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829955.731527:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5119
00000100:00100000:0.0:1787829955.731528:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273317376:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787829955.731529:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829955.731535:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829955.731538:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829955.731546:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704780 x1874670273317632/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829955.731551:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829955.731554:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787829955.731555:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829955.731557:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5119
00000100:00080000:3.0:1787829955.731559:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829955.731561:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829955.731563:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829955.731569:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057043c0 x1874670273317760/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829955.731575:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829955.731577:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787829955.731578:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:0.0:1787829955.731582:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787829955.731585:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5119
00000100:00080000:3.0:1787829955.731589:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829955.731592:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829955.731595:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787829955.731602:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705a40 x1874670273317888/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829955.731607:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829955.731609:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787829955.731610:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829955.731613:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5119
00000100:00100000:0.0:1787829955.731617:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829955/real 1787829955]  req@ffff9ee005707840 x1874670273317376/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829980 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829955.731618:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829955.731623:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829955.731629:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787829955.731638:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707840 x1874670273317376/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829980 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829955.731639:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704b40 x1874670273318016/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829955.731676:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829955.731679:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829955.731679:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787829955.731682:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829955.731686:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:3.0:1787829955.731689:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5119
00000100:00100000:0.0:1787829955.731693:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273317376:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787829955.731694:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829955.731700:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829955.731703:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829955.731710:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706580 x1874670273318144/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787829955.731716:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273317504:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787829955.731735:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829955.731743:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829955/real 1787829955]  req@ffff9ee005705680 x1874670273317504/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829980 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829955.731751:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705680 x1874670273317504/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829980 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829955.731756:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829955.731758:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829955.731760:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273317504:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787829955.731763:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273317632:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829955.731774:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829955.731779:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829955/real 1787829955]  req@ffff9ee005704780 x1874670273317632/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829980 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829955.731785:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704780 x1874670273317632/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829980 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829955.731790:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829955.731791:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829955.731793:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273317632:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829955.731796:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273317760:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829955.731804:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829955.731809:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829955/real 1787829955]  req@ffff9ee0057043c0 x1874670273317760/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829980 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829955.731815:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057043c0 x1874670273317760/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829980 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829955.731819:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829955.731821:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829955.731822:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273317760:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829955.731825:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273317888:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787829955.731834:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829955.731838:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829955/real 1787829955]  req@ffff9ee005705a40 x1874670273317888/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829980 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829955.731845:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705a40 x1874670273317888/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829980 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829955.731849:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829955.731850:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829955.731852:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273317888:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787829955.731855:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273318016:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829955.731862:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829955.731867:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829955/real 1787829955]  req@ffff9ee005704b40 x1874670273318016/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829980 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829955.731872:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704b40 x1874670273318016/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829980 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829955.731876:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829955.731878:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829955.731880:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273318016:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829955.731890:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273318144:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829955.731898:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829955.731903:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829955/real 1787829955]  req@ffff9ee005706580 x1874670273318144/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829980 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829955.731913:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706580 x1874670273318144/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829980 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829955.731917:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829955.731919:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829955.731921:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273318144:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787829956.563516:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787829956.755426:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829957.587480:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787829957.779424:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829958.611472:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787829958.803422:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829959.635516:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787829959.827429:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829960.659504:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787829960.851442:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:1.0:1787829960.852223:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829960.852228:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1787829960.852231:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829960.852238:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 5124
00000100:00080000:1.0:1787829960.852247:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829960.852252:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787829960.852278:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0000 x1874670273318272/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829960.852300:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829960.852302:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787829960.852303:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829960.852306:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5124
00000100:00080000:1.0:1787829960.852308:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829960.852310:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829960.852331:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787829960.852339:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a2580 x1874670273318400/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829960.852345:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829960.852347:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787829960.852348:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829960.852351:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5124
00000100:00080000:1.0:1787829960.852353:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829960.852355:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829960.852358:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787829960.852362:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0b40 x1874670273318528/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829960.852367:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829960.852369:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787829960.852370:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829960.852372:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5124
00000100:00080000:1.0:1787829960.852373:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829960.852375:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829960.852377:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787829960.852382:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1e00 x1874670273318656/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829960.852386:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829960.852388:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787829960.852389:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829960.852391:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5124
00000100:00080000:1.0:1787829960.852393:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829960.852395:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829960.852397:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787829960.852407:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a3480 x1874670273318784/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829960.852416:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1787829960.852419:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273318272:192.168.203.121@tcp:250:kworker.0
00000100:00080000:1.0:1787829960.852420:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787829960.852423:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829960.852431:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5124
00000100:00080000:1.0:1787829960.852435:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829960.852438:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829960.852443:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787829960.852454:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a30c0 x1874670273318912/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787829960.852461:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829960.852464:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787829960.852465:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829960.852467:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5124
00000100:00080000:1.0:1787829960.852472:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829960.852474:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829960.852477:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:0.0:1787829960.852483:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787829960.852487:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0f00 x1874670273319040/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787829960.852528:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829960/real 1787829960]  req@ffff9ee0056a0000 x1874670273318272/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829985 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829960.852546:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0000 x1874670273318272/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829985 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829960.852561:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829960.852567:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829960.852571:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273318272:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787829960.852579:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273318400:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787829960.852601:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829960.852631:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829960/real 1787829960]  req@ffff9ee0056a2580 x1874670273318400/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829985 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829960.852645:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a2580 x1874670273318400/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829985 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829960.852654:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829960.852657:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829960.852661:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273318400:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787829960.852666:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273318528:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829960.852686:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829960.852697:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829960/real 1787829960]  req@ffff9ee0056a0b40 x1874670273318528/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829985 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829960.852707:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0b40 x1874670273318528/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829985 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829960.852715:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829960.852718:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829960.852721:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273318528:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829960.852727:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273318656:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829960.852744:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829960.852754:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829960/real 1787829960]  req@ffff9ee0056a1e00 x1874670273318656/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829985 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829960.852765:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1e00 x1874670273318656/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829985 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829960.852772:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829960.852775:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829960.852778:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273318656:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829960.852803:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273318784:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787829960.852821:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829960.852832:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829960/real 1787829960]  req@ffff9ee0056a3480 x1874670273318784/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829985 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829960.852842:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a3480 x1874670273318784/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829985 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829960.852849:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829960.852852:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829960.852854:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273318784:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787829960.852860:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273318912:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829960.852878:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829960.852889:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829960/real 1787829960]  req@ffff9ee0056a30c0 x1874670273318912/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829985 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829960.852899:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a30c0 x1874670273318912/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829985 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829960.852906:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829960.852909:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829960.852913:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273318912:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829960.852919:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273319040:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829960.852936:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829960.852946:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829960/real 1787829960]  req@ffff9ee0056a0f00 x1874670273319040/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829985 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829960.852957:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0f00 x1874670273319040/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829985 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829960.852964:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829960.852966:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829960.852969:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273319040:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787829961.683460:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787829961.875725:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829962.707574:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787829962.899448:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829963.731523:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787829963.923500:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829964.755776:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787829964.947433:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829965.779798:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787829965.971438:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:2.0:1787829965.971771:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829965.971777:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787829965.971781:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829965.971789:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 5129
00000100:00080000:2.0:1787829965.971798:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829965.971804:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787829965.971835:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729680 x1874670273319168/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829965.971862:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829965.971865:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787829965.971867:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829965.971871:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5129
00000100:00080000:2.0:1787829965.971874:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829965.971878:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829965.971886:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787829965.971897:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a1c0 x1874670273319296/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829965.971906:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829965.971909:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787829965.971910:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829965.971914:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5129
00000100:00080000:2.0:1787829965.971916:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829965.971919:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829965.971923:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787829965.971931:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728000 x1874670273319424/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829965.971938:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829965.971941:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787829965.971943:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829965.971946:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5129
00000100:00080000:2.0:1787829965.971948:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829965.971951:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829965.971954:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787829965.971961:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057283c0 x1874670273319552/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829965.971969:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829965.971971:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787829965.972686:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829965.972692:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5129
00000100:00080000:2.0:1787829965.972696:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829965.972700:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829965.972705:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787829965.972719:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057292c0 x1874670273319680/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829965.972728:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829965.972731:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787829965.972733:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829965.972736:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5129
00000100:00080000:2.0:1787829965.972739:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829965.972742:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829965.972745:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787829965.972751:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728780 x1874670273319808/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829965.972759:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829965.972762:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787829965.972763:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829965.972766:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5129
00000100:00080000:2.0:1787829965.972769:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829965.972772:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829965.972776:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787829965.972783:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729e00 x1874670273319936/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787829965.972850:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273319168:192.168.203.121@tcp:250:kworker.0
00000800:00000100:0.0:1787829965.972903:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829965.972935:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829965/real 1787829965]  req@ffff9ee005729680 x1874670273319168/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829990 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829965.972950:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729680 x1874670273319168/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829990 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829965.972959:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829965.972963:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829965.972967:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273319168:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787829965.972984:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273319296:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787829965.973057:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829965.973070:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829965/real 1787829965]  req@ffff9ee00572a1c0 x1874670273319296/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829990 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829965.973081:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a1c0 x1874670273319296/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829990 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829965.973089:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829965.973092:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829965.973095:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273319296:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787829965.973100:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273319424:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829965.973117:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829965.973125:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829965/real 1787829965]  req@ffff9ee005728000 x1874670273319424/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829990 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829965.973135:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728000 x1874670273319424/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829990 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829965.973142:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829965.973145:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829965.973148:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273319424:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829965.973153:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273319552:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829965.973167:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829965.973174:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829965/real 1787829965]  req@ffff9ee0057283c0 x1874670273319552/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829990 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829965.973185:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057283c0 x1874670273319552/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829990 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829965.973191:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829965.973194:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829965.973197:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273319552:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829965.973202:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057292c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273319680:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787829965.973215:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829965.973222:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829965/real 1787829965]  req@ffff9ee0057292c0 x1874670273319680/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829990 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829965.973232:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057292c0 x1874670273319680/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829990 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829965.973239:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829965.973242:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829965.973245:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057292c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273319680:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787829965.973249:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273319808:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829965.973262:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829965.973270:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829965/real 1787829965]  req@ffff9ee005728780 x1874670273319808/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829990 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829965.973286:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728780 x1874670273319808/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829990 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829965.973293:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829965.973296:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829965.973299:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273319808:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829965.973304:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273319936:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829965.973333:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829965.973343:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829965/real 1787829965]  req@ffff9ee005729e00 x1874670273319936/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829990 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829965.973354:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729e00 x1874670273319936/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829990 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829965.973361:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829965.973364:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829965.973367:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273319936:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787829966.803514:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787829966.995423:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829967.827512:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787829968.019472:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829968.851543:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787829969.043499:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829969.875626:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787829970.067458:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829970.899516:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787829971.091420:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:2.0:1787829971.091420:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829971.091428:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787829971.091432:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829971.091441:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 5134
00000100:00080000:2.0:1787829971.091452:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829971.091460:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787829971.091493:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a940 x1874670273320064/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829971.091518:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829971.091531:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787829971.091534:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829971.091550:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5134
00000100:00080000:2.0:1787829971.091555:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1787829971.091556:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273320064:192.168.203.121@tcp:250:kworker.0
00000100:00080000:2.0:1787829971.091563:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829971.091573:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787829971.091586:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572bc00 x1874670273320192/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829971.091597:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829971.091600:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787829971.091603:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829971.091606:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5134
00000100:00080000:2.0:1787829971.091610:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829971.091614:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829971.091619:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787829971.091629:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a580 x1874670273320320/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829971.091638:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829971.091640:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787829971.091642:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829971.091645:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5134
00000100:00080000:2.0:1787829971.091648:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829971.091652:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829971.091656:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787829971.091666:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729e00 x1874670273320448/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829971.091676:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:3.0:1787829971.091676:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:2.0:1787829971.091682:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787829971.091684:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829971.091688:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5134
00000100:00080000:2.0:1787829971.091692:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829971.091697:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829971.091703:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787829971.091714:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728780 x1874670273320576/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829971.091728:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829971.091732:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787829971.091736:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1787829971.091737:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829971/real 1787829971]  req@ffff9ee00572a940 x1874670273320064/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829996 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829971.091742:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5134
00000100:00080000:2.0:1787829971.091750:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829971.091756:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829971.091760:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829971.091763:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a940 x1874670273320064/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787829996 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787829971.091775:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057292c0 x1874670273320704/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829971.091775:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829971.091785:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:2.0:1787829971.091792:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1787829971.091794:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273320064:192.168.203.121@tcp:250:kworker.0
00000100:00080000:2.0:1787829971.091797:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787829971.091801:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829971.091805:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5134
00000100:00080000:2.0:1787829971.091809:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829971.091812:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829971.091817:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829971.091819:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273320192:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787829971.091830:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057283c0 x1874670273320832/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1787829971.091849:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829971.091863:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829971/real 1787829971]  req@ffff9ee00572bc00 x1874670273320192/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829996 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829971.091875:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572bc00 x1874670273320192/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829996 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829971.091884:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829971.091888:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829971.091892:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273320192:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787829971.091899:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273320320:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829971.091918:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829971.091925:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829971/real 1787829971]  req@ffff9ee00572a580 x1874670273320320/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829996 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829971.091944:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a580 x1874670273320320/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829996 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829971.091950:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829971.091951:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829971.091953:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273320320:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829971.091957:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273320448:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829971.091968:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829971.092025:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829971/real 1787829971]  req@ffff9ee005729e00 x1874670273320448/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829996 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829971.092165:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729e00 x1874670273320448/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829996 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829971.092174:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829971.092178:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829971.092182:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273320448:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829971.092189:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273320576:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787829971.092257:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829971.092273:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829971/real 1787829971]  req@ffff9ee005728780 x1874670273320576/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829996 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829971.092286:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728780 x1874670273320576/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787829996 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829971.092294:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829971.092296:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829971.092300:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273320576:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787829971.092305:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057292c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273320704:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829971.092348:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829971.092359:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829971/real 1787829971]  req@ffff9ee0057292c0 x1874670273320704/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829996 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829971.092370:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057292c0 x1874670273320704/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829996 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829971.092384:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829971.092387:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829971.092390:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057292c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273320704:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829971.092410:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273320832:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829971.092431:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829971.092442:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829971/real 1787829971]  req@ffff9ee0057283c0 x1874670273320832/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829996 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829971.092453:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057283c0 x1874670273320832/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787829996 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829971.092460:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829971.092464:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829971.092467:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273320832:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787829971.923571:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787829972.115481:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829972.947619:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787829973.139469:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829973.971476:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787829974.163568:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829974.995557:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787829975.187470:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829976.019561:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787829976.211439:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:0.0:1787829976.211892:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829976.211898:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1787829976.211902:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829976.211910:0:27707:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 5139
00000100:00080000:0.0:1787829976.211919:0:27707:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829976.211925:0:27707:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787829976.211956:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8b40 x1874670273320960/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829976.211987:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829976.211990:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787829976.211992:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829976.211995:0:27707:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5139
00000100:00080000:0.0:1787829976.211998:0:27707:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829976.212002:0:27707:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829976.212010:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787829976.212020:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e92c0 x1874670273321088/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829976.212029:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829976.212032:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787829976.212035:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829976.212038:0:27707:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5139
00000100:00080000:0.0:1787829976.212040:0:27707:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829976.212044:0:27707:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829976.212048:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787829976.212055:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb480 x1874670273321216/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829976.212063:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829976.212066:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787829976.212068:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829976.212071:0:27707:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5139
00000100:00080000:0.0:1787829976.212074:0:27707:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829976.212077:0:27707:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829976.212080:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787829976.212086:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb840 x1874670273321344/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829976.212094:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829976.212097:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787829976.212098:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829976.212101:0:27707:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5139
00000100:00080000:0.0:1787829976.212104:0:27707:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829976.212107:0:27707:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829976.212110:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787829976.212117:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8f00 x1874670273321472/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829976.212125:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829976.212128:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787829976.212129:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829976.212132:0:27707:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5139
00000100:00080000:0.0:1787829976.212135:0:27707:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829976.212138:0:27707:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829976.212141:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787829976.212148:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e83c0 x1874670273321600/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829976.212155:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829976.212158:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787829976.212159:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787829976.212162:0:27707:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5139
00000100:00080000:0.0:1787829976.212165:0:27707:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787829976.212167:0:27707:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787829976.212170:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787829976.212177:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ebc00 x1874670273321728/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787829976.212250:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273320960:192.168.203.121@tcp:250:kworker.0
00000800:00000100:3.0:1787829976.212302:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829976.212360:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829976/real 1787829976]  req@ffff9ee0056e8b40 x1874670273320960/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787830001 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829976.212375:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8b40 x1874670273320960/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787830001 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829976.212390:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829976.212394:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829976.212397:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273320960:192.168.203.121@tcp:250:kworker.0
00000100:00100000:3.0:1787829976.212404:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273321088:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787829976.212422:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829976.212432:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829976/real 1787829976]  req@ffff9ee0056e92c0 x1874670273321088/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830001 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829976.212442:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e92c0 x1874670273321088/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830001 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829976.212449:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829976.212452:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829976.212455:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273321088:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787829976.212460:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273321216:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829976.212475:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829976.212483:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829976/real 1787829976]  req@ffff9ee0056eb480 x1874670273321216/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830001 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829976.212493:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb480 x1874670273321216/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830001 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829976.212500:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829976.212546:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829976.212550:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273321216:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829976.212556:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273321344:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829976.212574:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829976.212583:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829976/real 1787829976]  req@ffff9ee0056eb840 x1874670273321344/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830001 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829976.212593:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb840 x1874670273321344/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830001 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829976.212601:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829976.212604:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829976.212607:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273321344:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829976.212612:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273321472:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787829976.212626:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829976.212634:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829976/real 1787829976]  req@ffff9ee0056e8f00 x1874670273321472/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830001 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829976.212645:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8f00 x1874670273321472/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830001 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829976.212652:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829976.212655:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829976.212658:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273321472:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787829976.212663:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273321600:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829976.212676:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829976.212684:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829976/real 1787829976]  req@ffff9ee0056e83c0 x1874670273321600/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830001 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829976.212695:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e83c0 x1874670273321600/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830001 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829976.212702:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829976.212705:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829976.212707:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273321600:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829976.212711:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273321728:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829976.212725:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829976.212732:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829976/real 1787829976]  req@ffff9ee0056ebc00 x1874670273321728/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830001 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829976.212743:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ebc00 x1874670273321728/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830001 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829976.212750:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829976.212752:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829976.212756:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273321728:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787829977.044211:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787829977.235462:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829978.067914:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829978.259756:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829979.091542:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829979.283415:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829980.115565:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829980.307470:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829981.139601:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829981.331413:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:1.0:1787829981.331460:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829981.331464:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1787829981.331476:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829981.331485:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 5145
00000100:00080000:1.0:1787829981.331495:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829981.331502:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787829981.331541:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0780 x1874670273321856/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787829981.331621:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273321856:192.168.203.121@tcp:250:kworker.0
00000100:00080000:1.0:1787829981.331759:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829981.331763:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787829981.331765:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829981.331770:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5145
00000100:00080000:1.0:1787829981.331774:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829981.331779:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829981.331788:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787829981.331803:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0f00 x1874670273321984/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787829981.331842:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273321984:192.168.203.121@tcp:38:kworker.0
00000100:00080000:1.0:1787829981.331954:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829981.331958:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787829981.331961:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829981.331965:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5145
00000100:00080000:1.0:1787829981.331969:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829981.331973:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829981.331979:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787829981.331993:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a30c0 x1874670273322112/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787829981.333842:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273322112:192.168.203.121@tcp:8:kworker.0
00000100:00080000:1.0:1787829981.334199:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829981.334203:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787829981.334206:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829981.334211:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5145
00000100:00080000:1.0:1787829981.334217:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829981.334225:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829981.334235:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787829981.334256:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a3480 x1874670273322240/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787829981.334299:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273322240:192.168.203.121@tcp:8:kworker.0
00000100:00080000:1.0:1787829981.334461:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829981.334465:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787829981.334475:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829981.334482:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5145
00000100:00080000:1.0:1787829981.334487:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829981.334491:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829981.334496:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787829981.334509:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1e00 x1874670273322368/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787829981.334552:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273322368:192.168.203.121@tcp:38:kworker.0
00000100:00080000:1.0:1787829981.334593:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829981.334596:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787829981.334598:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829981.334602:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5145
00000100:00080000:1.0:1787829981.334606:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829981.334609:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829981.334614:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787829981.334625:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0b40 x1874670273322496/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787829981.334662:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273322496:192.168.203.121@tcp:8:kworker.0
00000100:00080000:1.0:1787829981.334812:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787829981.334816:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787829981.334818:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787829981.334822:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5145
00000100:00080000:1.0:1787829981.334826:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787829981.334830:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787829981.334835:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787829981.334849:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a2580 x1874670273322624/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787829981.334894:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273322624:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787829982.163807:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829982.355606:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829983.187513:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829983.379382:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829984.212101:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829984.403441:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000400:00000100:2.0:1787829984.403595:0:2353:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.203.121:988
00000400:00000100:2.0:1787829984.403627:0:2353:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.203.121@tcp at host 192.168.203.121 was unreachable: the network or that node may be down, or Lustre may be misconfigured.
00000800:00000100:2.0:1787829984.403643:0:2353:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:2.0:1787829984.403674:0:2353:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:2.0:1787829984.403681:0:2353:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:2.0:1787829984.403688:0:2353:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:2.0:1787829984.403695:0:2353:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:2.0:1787829984.403703:0:2353:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:2.0:1787829984.403713:0:2353:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000100:00100000:3.0:1787829984.403726:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829981/real 1787829984]  req@ffff9ee0056a0b40 x1874670273322496/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830006 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829984.403751:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0b40 x1874670273322496/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830006 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829984.403762:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829984.403767:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829984.403771:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273322496:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829984.403778:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829981/real 1787829984]  req@ffff9ee0056a1e00 x1874670273322368/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830006 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829984.403790:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1e00 x1874670273322368/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830006 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829984.403797:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829984.403801:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829984.403804:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273322368:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787829984.403812:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829981/real 1787829984]  req@ffff9ee0056a3480 x1874670273322240/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830006 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829984.403825:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a3480 x1874670273322240/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830006 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829984.403832:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829984.403835:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829984.403838:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273322240:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829984.403844:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829981/real 1787829984]  req@ffff9ee0056a30c0 x1874670273322112/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830006 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829984.403855:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a30c0 x1874670273322112/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830006 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829984.403862:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829984.403865:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829984.403868:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273322112:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829984.403874:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829981/real 1787829984]  req@ffff9ee0056a0f00 x1874670273321984/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830006 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829984.403884:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0f00 x1874670273321984/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830006 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829984.403892:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829984.403895:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829984.403898:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273321984:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787829984.403905:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829981/real 1787829984]  req@ffff9ee0056a0780 x1874670273321856/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787830006 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829984.403916:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0780 x1874670273321856/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787830006 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829984.403923:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829984.403926:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829984.403929:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273321856:192.168.203.121@tcp:250:kworker.0
00000100:00100000:3.0:1787829984.403957:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829981/real 1787829984]  req@ffff9ee0056a2580 x1874670273322624/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830006 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829984.403969:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a2580 x1874670273322624/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830006 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829984.403976:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829984.403979:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829984.403983:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273322624:192.168.203.121@tcp:8:kworker.0
00010000:00010000:0.0:1787829985.235885:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829985.427429:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829986.259583:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829986.451443:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:2.0:1787829986.451471:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829986.451477:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787829986.451481:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829986.451491:0:27707:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 5150
00000100:00080000:2.0:1787829986.451500:0:27707:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829986.451506:0:27707:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787829986.451546:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728000 x1874670273322752/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829986.451567:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829986.451570:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787829986.451572:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829986.451576:0:27707:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5150
00000100:00080000:2.0:1787829986.451580:0:27707:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829986.451584:0:27707:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829986.451593:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787829986.451606:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a1c0 x1874670273322880/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829986.451617:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1787829986.451619:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273322752:192.168.203.121@tcp:250:kworker.0
00000100:00080000:2.0:1787829986.451622:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787829986.451635:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829986.451641:0:27707:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5150
00000100:00080000:2.0:1787829986.451649:0:27707:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829986.451654:0:27707:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829986.451659:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787829986.451671:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729680 x1874670273323008/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829986.451680:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:3.0:1787829986.451685:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:2.0:1787829986.451686:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787829986.451690:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829986.451695:0:27707:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5150
00000100:00080000:2.0:1787829986.451710:0:27707:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829986.451715:0:27707:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829986.451720:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787829986.451733:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728b40 x1874670273323136/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787829986.451742:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829986/real 1787829986]  req@ffff9ee005728000 x1874670273322752/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787830011 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829986.451744:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829986.451752:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787829986.451756:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829986.451765:0:27707:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5150
00000100:00080000:2.0:1787829986.451769:0:27707:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:3.0:1787829986.451770:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728000 x1874670273322752/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787830011 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829986.451776:0:27707:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829986.451784:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00080000:3.0:1787829986.451798:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:2.0:1787829986.451800:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728f00 x1874670273323264/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829986.451806:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829986.451814:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273322752:192.168.203.121@tcp:250:kworker.0
00000100:00080000:2.0:1787829986.451818:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829986.451822:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787829986.451825:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829986.451830:0:27707:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5150
00000100:00080000:2.0:1787829986.451834:0:27707:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829986.451840:0:27707:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787829986.451840:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273322880:192.168.203.121@tcp:38:kworker.0
00000008:00100000:2.0:1787829986.451849:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787829986.451864:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b840 x1874670273323392/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1787829986.451873:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:2.0:1787829986.451875:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829986.451880:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787829986.451881:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829986.451886:0:27707:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5150
00000100:00100000:3.0:1787829986.451891:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829986/real 1787829986]  req@ffff9ee00572a1c0 x1874670273322880/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830011 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829986.451892:0:27707:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829986.451900:0:27707:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829986.451908:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829986.451913:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a1c0 x1874670273322880/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830011 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829986.451924:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:2.0:1787829986.451925:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729a40 x1874670273323520/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829986.451932:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829986.451938:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273322880:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787829986.451947:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273323008:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829986.451968:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829986.451979:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829986/real 1787829986]  req@ffff9ee005729680 x1874670273323008/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830011 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829986.451990:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729680 x1874670273323008/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830011 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829986.451998:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829986.452001:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829986.452004:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273323008:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829986.452010:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273323136:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829986.452028:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829986.452038:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829986/real 1787829986]  req@ffff9ee005728b40 x1874670273323136/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830011 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829986.452062:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728b40 x1874670273323136/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830011 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829986.452070:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829986.452073:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829986.452075:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273323136:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829986.452081:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273323264:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787829986.452099:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829986.452109:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829986/real 1787829986]  req@ffff9ee005728f00 x1874670273323264/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830011 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829986.452119:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728f00 x1874670273323264/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830011 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829986.452127:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829986.452129:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829986.452132:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273323264:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787829986.452149:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273323392:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829986.452167:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829986.452177:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829986/real 1787829986]  req@ffff9ee00572b840 x1874670273323392/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830011 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829986.452187:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b840 x1874670273323392/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830011 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829986.452194:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829986.452197:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829986.452200:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273323392:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829986.452205:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273323520:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829986.452222:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829986.452232:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829986/real 1787829986]  req@ffff9ee005729a40 x1874670273323520/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830011 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829986.452242:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729a40 x1874670273323520/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830011 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829986.452250:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829986.452252:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829986.452255:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273323520:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787829987.283973:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829987.475460:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829988.307563:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829988.499437:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829989.331520:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829989.523453:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829990.355753:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787829990.547433:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829991.379536:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1787829991.571429:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1787829991.571430:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:2.0:1787829991.571439:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787829991.571443:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829991.571452:0:27707:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 5155
00000100:00080000:2.0:1787829991.571461:0:27707:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829991.571468:0:27707:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787829991.571509:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572ad00 x1874670273323648/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829991.571538:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829991.571542:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787829991.571544:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829991.571548:0:27707:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5155
00000100:00080000:2.0:1787829991.571551:0:27707:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829991.571556:0:27707:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829991.571564:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787829991.571577:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b480 x1874670273323776/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787829991.571588:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273323648:192.168.203.121@tcp:250:kworker.0
00000100:00080000:2.0:1787829991.571590:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829991.571597:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787829991.571599:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829991.571603:0:27707:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5155
00000100:00080000:2.0:1787829991.571606:0:27707:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829991.571611:0:27707:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829991.571615:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787829991.571628:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b0c0 x1874670273323904/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829991.571638:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829991.571642:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787829991.571644:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829991.571650:0:27707:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5155
00000800:00000100:3.0:1787829991.571650:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:2.0:1787829991.571657:0:27707:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829991.571661:0:27707:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829991.571666:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829991.571686:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829991/real 1787829991]  req@ffff9ee00572ad00 x1874670273323648/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787830016 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829991.571709:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572ad00 x1874670273323648/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787830016 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829991.571718:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829991.571723:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829991.571726:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273323648:192.168.203.121@tcp:250:kworker.0
00000100:00100000:3.0:1787829991.571746:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273323776:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787829991.571762:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829991.571772:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829991/real 1787829991]  req@ffff9ee00572b480 x1874670273323776/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830016 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829991.571782:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b480 x1874670273323776/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830016 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829991.571798:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829991.571804:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829991.571807:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273323776:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787829991.571812:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273323904:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829991.571827:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829991.571835:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829991/real 1787829991]  req@ffff9ee00572b0c0 x1874670273323904/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830016 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829991.571846:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b0c0 x1874670273323904/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830016 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829991.571859:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829991.571862:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829991.571865:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273323904:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787829991.571895:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b0c0 x1874670273324032/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787829991.571926:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829991.571931:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787829991.571933:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1787829991.571938:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273324032:192.168.203.121@tcp:8:kworker.0
00000100:00080000:2.0:1787829991.571939:0:27707:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5155
00000100:00080000:2.0:1787829991.571947:0:27707:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829991.571953:0:27707:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829991.571958:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000800:00000100:3.0:1787829991.571963:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787829991.571973:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b480 x1874670273324160/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787829991.571977:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829991/real 1787829991]  req@ffff9ee00572b0c0 x1874670273324032/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830016 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829991.572000:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1787829991.572004:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b0c0 x1874670273324032/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830016 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829991.572005:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787829991.572009:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787829991.572018:0:27707:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5155
00000100:00080000:3.0:1787829991.572020:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787829991.572026:0:27707:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829991.572026:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829991.572032:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273324032:192.168.203.121@tcp:8:kworker.0
00000100:00080000:2.0:1787829991.572034:0:27707:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787829991.572042:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829991.572047:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273324160:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787829991.572061:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572ad00 x1874670273324288/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1787829991.572070:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:2.0:1787829991.572079:0:27707:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787829991.572083:0:27707:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787829991.572086:0:27707:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1787829991.572087:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829991/real 1787829991]  req@ffff9ee00572b480 x1874670273324160/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830016 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787829991.572093:0:27707:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5155
00000100:00080000:2.0:1787829991.572100:0:27707:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787829991.572105:0:27707:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787829991.572109:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b480 x1874670273324160/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830016 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:2.0:1787829991.572112:0:27707:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:3.0:1787829991.572123:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829991.572126:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829991.572129:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273324160:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787829991.572140:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273324288:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787829991.572144:0:27707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729a40 x1874670273324416/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1787829991.572162:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829991.572173:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829991/real 1787829991]  req@ffff9ee00572ad00 x1874670273324288/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830016 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829991.572185:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572ad00 x1874670273324288/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830016 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829991.572192:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829991.572194:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829991.572197:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273324288:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787829991.572205:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273324416:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787829991.572218:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829991.572226:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829991/real 1787829991]  req@ffff9ee005729a40 x1874670273324416/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830016 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829991.572236:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729a40 x1874670273324416/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830016 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829991.572243:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829991.572245:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787829991.572248:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273324416:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787829992.403522:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787829992.595727:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829993.427910:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787829993.619451:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829994.451484:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787829994.643427:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787829995.475490:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787829995.667402:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829996.499439:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787829996.691417:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787829996.691438:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829996.691443:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787829996.691448:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829996.691456:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 5160
00000100:00080000:3.0:1787829996.691465:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829996.691472:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787829996.691503:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706d00 x1874670273324544/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829996.691525:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829996.691528:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787829996.691529:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829996.691531:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5160
00000100:00080000:3.0:1787829996.691534:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829996.691536:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829996.691543:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787829996.691551:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705e00 x1874670273324672/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787829996.691555:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273324544:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787829996.691566:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829996.691568:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787829996.691569:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829996.691572:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5160
00000100:00080000:3.0:1787829996.691574:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829996.691576:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829996.691580:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829996.691588:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706580 x1874670273324800/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829996.691594:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829996.691595:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787829996.691597:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829996.691599:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5160
00000100:00080000:3.0:1787829996.691601:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829996.691603:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829996.691605:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:0.0:1787829996.691609:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787829996.691613:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704b40 x1874670273324928/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787829996.691620:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829996.691622:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787829996.691624:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829996.691626:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5160
00000100:00080000:3.0:1787829996.691628:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829996.691630:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829996.691632:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787829996.691640:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705a40 x1874670273325056/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787829996.691643:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829996/real 1787829996]  req@ffff9ee005706d00 x1874670273324544/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787830021 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787829996.691651:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787829996.691653:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787829996.691654:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787829996.691662:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5160
00000100:00080000:3.0:1787829996.691665:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829996.691668:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829996.691670:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787829996.691672:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706d00 x1874670273324544/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787830021 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787829996.691678:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057043c0 x1874670273325184/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787829996.691684:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787829996.691687:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787829996.691690:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:3.0:1787829996.691691:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787829996.691694:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1787829996.691696:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273324544:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787829996.691699:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5160
00000100:00080000:3.0:1787829996.691704:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787829996.691707:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787829996.691709:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787829996.691714:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704780 x1874670273325312/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787829996.691719:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273324672:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787829996.691738:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829996.691745:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829996/real 1787829996]  req@ffff9ee005705e00 x1874670273324672/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830021 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829996.691752:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705e00 x1874670273324672/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830021 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829996.691757:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829996.691760:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829996.691762:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273324672:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787829996.691765:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273324800:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829996.691775:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829996.691780:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829996/real 1787829996]  req@ffff9ee005706580 x1874670273324800/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830021 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829996.691787:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706580 x1874670273324800/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830021 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829996.691791:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829996.691793:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829996.691794:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273324800:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829996.691798:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273324928:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829996.691806:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829996.691811:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829996/real 1787829996]  req@ffff9ee005704b40 x1874670273324928/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830021 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829996.691817:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704b40 x1874670273324928/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830021 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829996.691821:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829996.691823:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829996.691824:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273324928:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829996.691827:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273325056:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787829996.691838:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829996.691847:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829996/real 1787829996]  req@ffff9ee005705a40 x1874670273325056/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830021 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829996.691857:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705a40 x1874670273325056/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830021 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829996.691865:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829996.691868:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829996.691871:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273325056:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787829996.691877:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273325184:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829996.691895:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829996.691906:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829996/real 1787829996]  req@ffff9ee0057043c0 x1874670273325184/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830021 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829996.691917:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057043c0 x1874670273325184/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830021 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829996.691924:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829996.691927:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829996.691931:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273325184:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787829996.691947:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273325312:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787829996.691965:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787829996.691976:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787829996/real 1787829996]  req@ffff9ee005704780 x1874670273325312/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830021 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787829996.691986:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704780 x1874670273325312/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830021 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787829996.691993:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787829996.691996:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787829996.691999:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273325312:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787829997.523475:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787829997.715476:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829998.547449:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787829998.739425:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787829999.571521:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787829999.763465:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787830000.595617:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787830000.787578:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787830001.619509:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1787830001.811460:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787830001.811470:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787830001.811475:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787830001.811487:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 5165
00000100:00100000:0.0:1787830001.811494:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787830001.811498:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787830001.811507:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787830001.811542:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705680 x1874670273325440/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787830001.811568:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787830001.811571:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787830001.811573:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787830001.811576:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5165
00000100:00080000:3.0:1787830001.811580:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787830001.811584:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787830001.811593:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787830001.811605:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273325440:192.168.203.121@tcp:250:kworker.0
00000100:00100000:3.0:1787830001.811606:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707840 x1874670273325568/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787830001.811619:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787830001.811623:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787830001.811624:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787830001.811628:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5165
00000100:00080000:3.0:1787830001.811631:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787830001.811635:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787830001.811640:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787830001.811653:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704000 x1874670273325696/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787830001.811661:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787830001.811664:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787830001.811666:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:0.0:1787830001.811670:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787830001.811674:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5165
00000100:00080000:3.0:1787830001.811679:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787830001.811683:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787830001.811687:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787830001.811697:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707480 x1874670273325824/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787830001.811705:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787830001.811708:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787830001.811710:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787830001.811717:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5165
00000100:00100000:0.0:1787830001.811718:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830001/real 1787830001]  req@ffff9ee005705680 x1874670273325440/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787830026 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787830001.811720:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787830001.811728:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787830001.811735:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787830001.811741:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705680 x1874670273325440/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787830026 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787830001.811747:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707c00 x1874670273325952/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787830001.811754:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787830001.811760:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787830001.811762:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:3.0:1787830001.811768:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00100000:0.0:1787830001.811769:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273325440:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787830001.811772:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787830001.811779:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5165
00000100:00080000:3.0:1787830001.811783:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787830001.811787:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787830001.811791:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787830001.811796:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273325568:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787830001.811804:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057052c0 x1874670273326080/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787830001.811815:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787830001.811818:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787830001.811820:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:0.0:1787830001.811825:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787830001.811827:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5165
00000100:00080000:3.0:1787830001.811832:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787830001.811836:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787830001.811841:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787830001.811843:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830001/real 1787830001]  req@ffff9ee005707840 x1874670273325568/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830026 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787830001.811865:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057070c0 x1874670273326208/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787830001.811888:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707840 x1874670273325568/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830026 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787830001.811898:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787830001.811903:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787830001.811906:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273325568:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787830001.811913:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273325696:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787830001.812200:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787830001.812213:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830001/real 1787830001]  req@ffff9ee005704000 x1874670273325696/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830026 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787830001.812225:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704000 x1874670273325696/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830026 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787830001.812233:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787830001.812236:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787830001.812239:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273325696:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787830001.812245:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273325824:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787830001.812279:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787830001.812291:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830001/real 1787830001]  req@ffff9ee005707480 x1874670273325824/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830026 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787830001.812303:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707480 x1874670273325824/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830026 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787830001.812310:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787830001.812314:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787830001.812353:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273325824:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787830001.812359:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273325952:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787830001.812378:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787830001.812397:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830001/real 1787830001]  req@ffff9ee005707c00 x1874670273325952/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830026 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787830001.812409:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707c00 x1874670273325952/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830026 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787830001.812417:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787830001.812420:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787830001.812423:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273325952:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787830001.812439:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273326080:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787830001.812455:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787830001.812465:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830001/real 1787830001]  req@ffff9ee0057052c0 x1874670273326080/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830026 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787830001.812475:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057052c0 x1874670273326080/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830026 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787830001.812483:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787830001.812486:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787830001.812489:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273326080:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787830001.812494:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273326208:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787830001.812509:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787830001.812517:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830001/real 1787830001]  req@ffff9ee0057070c0 x1874670273326208/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830026 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787830001.812534:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057070c0 x1874670273326208/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830026 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787830001.812541:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787830001.812544:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787830001.812547:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273326208:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787830002.643661:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787830002.835671:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787830003.667837:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787830003.859541:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787830004.691679:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787830004.883887:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787830005.716016:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787830005.907453:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787830006.740123:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787830006.931474:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787830006.931599:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787830006.931605:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787830006.931609:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787830006.931618:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 5170
00000100:00080000:3.0:1787830006.931628:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787830006.931635:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787830006.931670:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057061c0 x1874670273326336/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787830006.931739:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273326336:192.168.203.121@tcp:250:kworker.0
00000800:00000100:0.0:1787830006.931796:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787830006.931826:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787830006.931830:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787830006.931832:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787830006.931838:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5170
00000100:00080000:3.0:1787830006.931841:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787830006.931846:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787830006.931855:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787830006.931868:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706940 x1874670273326464/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787830006.931957:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830006/real 1787830006]  req@ffff9ee0057061c0 x1874670273326336/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787830031 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787830006.931974:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057061c0 x1874670273326336/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787830031 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787830006.931984:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787830006.931989:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787830006.931993:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273326336:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787830006.932013:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273326464:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787830006.932037:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787830006.932050:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830006/real 1787830006]  req@ffff9ee005706940 x1874670273326464/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830031 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787830006.932060:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706940 x1874670273326464/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830031 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787830006.932069:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787830006.932073:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787830006.932077:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273326464:192.168.203.121@tcp:38:kworker.0
00000100:00080000:3.0:1787830006.933042:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787830006.933047:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787830006.933050:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787830006.933055:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5170
00000100:00080000:3.0:1787830006.933059:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787830006.933064:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787830006.933071:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787830006.933306:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706940 x1874670273326592/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787830006.933351:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787830006.933354:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787830006.933356:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787830006.933360:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5170
00000100:00080000:3.0:1787830006.933363:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1787830006.933524:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273326592:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787830006.933556:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787830006.933571:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830006/real 1787830006]  req@ffff9ee005706940 x1874670273326592/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830031 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787830006.933584:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706940 x1874670273326592/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830031 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787830006.933592:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787830006.933596:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787830006.933599:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273326592:192.168.203.121@tcp:8:kworker.0
00000100:00080000:3.0:1787830006.933640:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787830006.933646:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787830006.933659:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057061c0 x1874670273326720/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787830006.933677:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787830006.933680:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787830006.933682:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787830006.933686:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5170
00000100:00080000:3.0:1787830006.933690:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787830006.933693:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787830006.933697:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787830006.933707:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057070c0 x1874670273326848/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787830006.933714:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787830006.933718:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787830006.933719:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787830006.933722:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5170
00000100:00080000:3.0:1787830006.933725:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787830006.933727:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787830006.933731:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787830006.933739:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057052c0 x1874670273326976/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787830006.933746:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787830006.933748:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787830006.933750:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787830006.933752:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5170
00000100:00080000:3.0:1787830006.933755:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787830006.933758:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787830006.933762:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787830006.933768:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707c00 x1874670273327104/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787830006.933825:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273326720:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787830006.933848:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787830006.933860:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830006/real 1787830006]  req@ffff9ee0057061c0 x1874670273326720/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830031 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787830006.933872:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057061c0 x1874670273326720/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830031 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787830006.933879:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787830006.933883:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787830006.933886:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273326720:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787830006.933892:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273326848:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787830006.933977:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787830006.933989:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830006/real 1787830006]  req@ffff9ee0057070c0 x1874670273326848/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830031 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787830006.934001:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057070c0 x1874670273326848/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830031 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787830006.934008:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787830006.934011:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787830006.934015:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273326848:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787830006.934020:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273326976:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787830006.934037:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787830006.934046:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830006/real 1787830006]  req@ffff9ee0057052c0 x1874670273326976/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830031 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787830006.934057:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057052c0 x1874670273326976/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830031 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787830006.934064:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787830006.934067:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787830006.934070:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273326976:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787830006.934076:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273327104:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787830006.934105:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787830006.934219:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830006/real 1787830006]  req@ffff9ee005707c00 x1874670273327104/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830031 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787830006.934232:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707c00 x1874670273327104/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830031 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787830006.934240:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787830006.934243:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787830006.934246:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273327104:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787830007.763828:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787830007.955553:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787830008.787502:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787830008.979428:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787830009.813171:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787830010.003444:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787830010.835511:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787830011.027409:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787830011.860520:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787830012.052752:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:1.0:1787830012.052889:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787830012.052895:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1787830012.052899:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787830012.052908:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 5175
00000100:00080000:1.0:1787830012.052916:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787830012.052924:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787830012.052955:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0000 x1874670273327232/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787830012.052982:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787830012.052985:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787830012.052987:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787830012.052990:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5175
00000100:00080000:1.0:1787830012.052994:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787830012.052998:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787830012.053007:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787830012.053018:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a3c00 x1874670273327360/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787830012.053033:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787830012.053036:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787830012.053038:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787830012.053041:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5175
00000100:00080000:1.0:1787830012.053044:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787830012.053048:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787830012.053052:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787830012.053062:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a2940 x1874670273327488/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787830012.053070:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787830012.053073:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787830012.053074:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787830012.053077:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5175
00000100:00080000:1.0:1787830012.053080:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787830012.053083:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787830012.053087:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787830012.053095:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a21c0 x1874670273327616/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787830012.053103:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787830012.053106:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787830012.053107:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787830012.053110:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5175
00000100:00080000:1.0:1787830012.053113:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787830012.053116:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787830012.053120:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787830012.053127:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1680 x1874670273327744/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787830012.053134:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787830012.053137:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787830012.053139:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787830012.053142:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5175
00000100:00080000:1.0:1787830012.053145:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787830012.053147:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787830012.053150:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787830012.053157:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a03c0 x1874670273327872/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787830012.053164:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787830012.053167:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787830012.053168:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787830012.053170:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5175
00000100:00080000:1.0:1787830012.053173:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787830012.053176:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787830012.053180:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787830012.053188:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1a40 x1874670273328000/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787830012.054037:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273327232:192.168.203.121@tcp:250:kworker.0
00000800:00000100:0.0:1787830012.054117:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787830012.054155:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830012/real 1787830012]  req@ffff9ee0056a0000 x1874670273327232/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787830037 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787830012.054172:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0000 x1874670273327232/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787830037 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787830012.054182:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787830012.054186:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787830012.054189:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273327232:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787830012.054196:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273327360:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787830012.054219:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787830012.054231:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830012/real 1787830012]  req@ffff9ee0056a3c00 x1874670273327360/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830037 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787830012.054243:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a3c00 x1874670273327360/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830037 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787830012.054251:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787830012.054266:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787830012.054270:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273327360:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787830012.054276:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273327488:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787830012.054297:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787830012.054308:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830012/real 1787830012]  req@ffff9ee0056a2940 x1874670273327488/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830037 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787830012.054350:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a2940 x1874670273327488/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830037 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787830012.054370:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787830012.054374:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787830012.054377:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273327488:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787830012.054383:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273327616:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787830012.054413:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787830012.054426:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830012/real 1787830012]  req@ffff9ee0056a21c0 x1874670273327616/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830037 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787830012.054444:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a21c0 x1874670273327616/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830037 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787830012.054451:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787830012.054455:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787830012.054458:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273327616:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787830012.054464:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273327744:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787830012.054483:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787830012.054494:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830012/real 1787830012]  req@ffff9ee0056a1680 x1874670273327744/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830037 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787830012.054518:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1680 x1874670273327744/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830037 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787830012.054526:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787830012.054537:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787830012.054540:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273327744:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787830012.054547:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273327872:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787830012.054566:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787830012.054574:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830012/real 1787830012]  req@ffff9ee0056a03c0 x1874670273327872/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830037 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787830012.054581:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a03c0 x1874670273327872/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830037 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787830012.054590:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787830012.054592:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787830012.054594:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273327872:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787830012.054597:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273328000:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787830012.054608:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787830012.054613:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830012/real 1787830012]  req@ffff9ee0056a1a40 x1874670273328000/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830037 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787830012.054619:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1a40 x1874670273328000/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830037 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787830012.054624:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787830012.054625:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787830012.054627:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273328000:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787830012.883763:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1787830013.075433:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787830013.908712:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787830014.099452:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787830014.931672:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787830015.123376:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787830015.955858:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787830016.148339:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787830016.979516:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1787830017.171770:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787830017.171780:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1787830017.171785:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00100000:2.0:1787830017.171788:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:1.0:1787830017.171794:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 5180
00000100:00080000:1.0:1787830017.171802:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787830017.171808:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787830017.171836:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a12c0 x1874670273328128/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787830017.171859:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787830017.171863:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787830017.171866:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787830017.171870:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5180
00000100:00080000:1.0:1787830017.171874:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787830017.171879:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787830017.171887:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787830017.171899:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1a40 x1874670273328256/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787830017.171911:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273328128:192.168.203.121@tcp:250:kworker.0
00000100:00080000:1.0:1787830017.171911:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787830017.171920:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787830017.171922:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787830017.171928:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5180
00000100:00080000:1.0:1787830017.171933:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787830017.171936:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787830017.171941:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787830017.171953:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a03c0 x1874670273328384/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787830017.171962:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787830017.171965:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787830017.171966:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787830017.171969:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5180
00000100:00080000:1.0:1787830017.171973:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787830017.171976:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787830017.171980:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:0.0:1787830017.171985:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787830017.171993:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1680 x1874670273328512/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787830017.172003:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787830017.172006:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787830017.172008:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787830017.172012:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5180
00000100:00080000:1.0:1787830017.172015:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787830017.172020:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787830017.172024:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787830017.172034:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830017/real 1787830017]  req@ffff9ee0056a12c0 x1874670273328128/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787830042 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787830017.172036:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a21c0 x1874670273328640/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787830017.172064:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787830017.172067:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00100000:0.0:1787830017.172072:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a12c0 x1874670273328128/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787830042 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787830017.172072:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787830017.172081:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5180
00000100:00080000:1.0:1787830017.172087:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787830017.172091:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787830017.172093:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00080000:0.0:1787830017.172100:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000008:00100000:1.0:1787830017.172101:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787830017.172107:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273328128:192.168.203.121@tcp:250:kworker.0
00000100:00100000:1.0:1787830017.172126:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a2940 x1874670273328768/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787830017.172131:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273328256:192.168.203.121@tcp:38:kworker.0
00000100:00080000:1.0:1787830017.172142:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787830017.172146:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787830017.172147:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787830017.172151:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5180
00000100:00080000:1.0:1787830017.172156:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000800:00000100:0.0:1787830017.172162:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:1.0:1787830017.172162:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787830017.172169:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787830017.172181:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830017/real 1787830017]  req@ffff9ee0056a1a40 x1874670273328256/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830042 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787830017.172183:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a3c00 x1874670273328896/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787830017.172210:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1a40 x1874670273328256/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830042 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787830017.172228:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787830017.172232:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787830017.172235:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273328256:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787830017.172240:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273328384:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787830017.172259:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787830017.172269:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830017/real 1787830017]  req@ffff9ee0056a03c0 x1874670273328384/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830042 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787830017.172280:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a03c0 x1874670273328384/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830042 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787830017.172287:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787830017.172289:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787830017.172292:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273328384:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787830017.172298:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273328512:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787830017.172348:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787830017.172361:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830017/real 1787830017]  req@ffff9ee0056a1680 x1874670273328512/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830042 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787830017.172373:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1680 x1874670273328512/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830042 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787830017.172380:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787830017.172384:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787830017.172387:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273328512:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787830017.172392:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273328640:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787830017.172409:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787830017.172418:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830017/real 1787830017]  req@ffff9ee0056a21c0 x1874670273328640/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830042 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787830017.172427:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a21c0 x1874670273328640/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830042 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787830017.172440:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787830017.172443:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787830017.172446:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273328640:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787830017.172462:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273328768:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787830017.172481:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787830017.172492:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830017/real 1787830017]  req@ffff9ee0056a2940 x1874670273328768/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830042 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787830017.172508:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a2940 x1874670273328768/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830042 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787830017.172514:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787830017.172516:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787830017.172519:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273328768:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787830017.172524:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273328896:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787830017.172540:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787830017.172549:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830017/real 1787830017]  req@ffff9ee0056a3c00 x1874670273328896/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830042 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787830017.172563:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a3c00 x1874670273328896/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830042 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787830017.172570:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787830017.172574:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787830017.172577:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273328896:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787830018.003589:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787830018.195582:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787830019.027776:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787830019.219468:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787830020.051538:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787830020.244860:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787830021.075516:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787830021.267396:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787830022.099975:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787830022.291620:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:2.0:1787830022.291787:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787830022.291793:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787830022.291796:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787830022.291805:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 5186
00000100:00080000:2.0:1787830022.291934:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787830022.291942:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787830022.291973:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b840 x1874670273329024/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787830022.291996:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787830022.291999:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787830022.292001:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787830022.292005:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5186
00000100:00080000:2.0:1787830022.292008:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787830022.292011:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787830022.292021:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787830022.292031:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728f00 x1874670273329152/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787830022.292043:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1787830022.292045:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273329024:192.168.203.121@tcp:250:kworker.0
00000100:00080000:2.0:1787830022.292047:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787830022.292051:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787830022.292056:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5186
00000100:00080000:2.0:1787830022.292060:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787830022.292063:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787830022.292068:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787830022.292080:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728b40 x1874670273329280/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787830022.292089:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787830022.292093:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787830022.292095:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787830022.292098:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5186
00000100:00080000:2.0:1787830022.292102:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787830022.292106:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000800:00000100:0.0:1787830022.292110:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000008:00100000:2.0:1787830022.292114:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787830022.292127:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729680 x1874670273329408/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787830022.292136:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787830022.292140:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787830022.292142:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787830022.292146:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5186
00000100:00080000:2.0:1787830022.292150:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1787830022.292152:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830022/real 1787830022]  req@ffff9ee00572b840 x1874670273329024/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787830047 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787830022.292156:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787830022.292164:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787830022.292173:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b840 x1874670273329024/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787830047 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787830022.292197:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787830022.292201:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787830022.292205:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273329024:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787830022.292225:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273329152:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787830022.292245:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787830022.292257:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830022/real 1787830022]  req@ffff9ee005728f00 x1874670273329152/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830047 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787830022.292270:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728f00 x1874670273329152/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830047 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787830022.292279:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787830022.292283:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787830022.292287:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273329152:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787830022.292292:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273329280:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787830022.292308:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787830022.292357:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830022/real 1787830022]  req@ffff9ee005728b40 x1874670273329280/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830047 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787830022.292368:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728b40 x1874670273329280/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830047 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787830022.292374:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787830022.292377:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787830022.292380:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273329280:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787830022.292385:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273329408:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787830022.292402:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787830022.292411:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830022/real 1787830022]  req@ffff9ee005729680 x1874670273329408/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830047 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787830022.292420:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729680 x1874670273329408/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830047 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787830022.292427:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787830022.292430:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787830022.292432:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273329408:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787830022.292739:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a1c0 x1874670273329536/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787830022.292760:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787830022.292763:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787830022.292765:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787830022.292770:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5186
00000100:00080000:2.0:1787830022.292775:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787830022.292780:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787830022.292785:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787830022.292788:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273329536:192.168.203.121@tcp:38:kworker.0
00000100:00100000:2.0:1787830022.292800:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728000 x1874670273329664/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1787830022.292814:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787830022.292827:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830022/real 1787830022]  req@ffff9ee00572a1c0 x1874670273329536/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830047 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787830022.292839:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a1c0 x1874670273329536/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830047 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787830022.292846:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787830022.292848:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787830022.292851:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273329536:192.168.203.121@tcp:38:kworker.0
00000100:00080000:2.0:1787830022.292875:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787830022.292880:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787830022.292882:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1787830022.292885:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273329664:192.168.203.121@tcp:8:kworker.0
00000100:00080000:2.0:1787830022.292889:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5186
00000100:00080000:2.0:1787830022.292895:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787830022.292899:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787830022.292905:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:0.0:1787830022.292913:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787830022.292920:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057283c0 x1874670273329792/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787830022.292929:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830022/real 1787830022]  req@ffff9ee005728000 x1874670273329664/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830047 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787830022.292945:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728000 x1874670273329664/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830047 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787830022.292953:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787830022.292956:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787830022.292959:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273329664:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787830022.292970:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273329792:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787830022.292989:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787830022.292997:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830022/real 1787830022]  req@ffff9ee0057283c0 x1874670273329792/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830047 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787830022.293003:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057283c0 x1874670273329792/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830047 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787830022.293008:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787830022.293010:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787830022.293012:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273329792:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787830023.123849:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787830023.315493:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787830024.147991:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787830024.339757:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787830025.171683:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787830025.364269:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787830026.195492:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787830026.387625:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787830027.220173:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1787830027.411892:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787830027.411902:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1787830027.411908:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787830027.411920:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 5191
00000100:00080000:1.0:1787830027.411935:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00100000:2.0:1787830027.411939:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:1.0:1787830027.411944:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787830027.411996:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0000 x1874670273329920/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787830027.412015:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787830027.412018:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787830027.412019:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787830027.412022:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5191
00000100:00080000:1.0:1787830027.412024:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787830027.412026:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787830027.412035:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787830027.412042:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a2580 x1874670273330048/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787830027.412047:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787830027.412050:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787830027.412051:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787830027.412053:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5191
00000100:00080000:1.0:1787830027.412055:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787830027.412057:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787830027.412060:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787830027.412066:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0780 x1874670273330176/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787830027.412071:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787830027.412073:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787830027.412074:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787830027.412076:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5191
00000100:00080000:1.0:1787830027.412077:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787830027.412079:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787830027.412081:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787830027.412086:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0f00 x1874670273330304/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787830027.412091:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787830027.412092:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787830027.412093:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787830027.412096:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5191
00000100:00080000:1.0:1787830027.412097:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787830027.412099:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787830027.412101:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787830027.412109:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a30c0 x1874670273330432/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787830027.412114:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787830027.412116:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787830027.412117:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787830027.412120:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5191
00000100:00080000:1.0:1787830027.412122:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787830027.412124:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787830027.412127:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787830027.412132:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a3480 x1874670273330560/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787830027.412136:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787830027.412138:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787830027.412139:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787830027.412140:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5191
00000100:00080000:1.0:1787830027.412142:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787830027.412145:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787830027.412159:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787830027.412168:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1e00 x1874670273330688/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787830027.412264:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273329920:192.168.203.121@tcp:250:kworker.0
00000800:00000100:0.0:1787830027.412363:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787830027.412419:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830027/real 1787830027]  req@ffff9ee0056a0000 x1874670273329920/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787830052 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787830027.412437:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0000 x1874670273329920/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787830052 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787830027.412448:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787830027.412452:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787830027.412456:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273329920:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787830027.412464:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273330048:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787830027.412488:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787830027.412501:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830027/real 1787830027]  req@ffff9ee0056a2580 x1874670273330048/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830052 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787830027.412513:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a2580 x1874670273330048/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830052 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787830027.412521:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787830027.412524:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787830027.412527:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273330048:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787830027.412533:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273330176:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787830027.412554:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787830027.412566:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830027/real 1787830027]  req@ffff9ee0056a0780 x1874670273330176/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830052 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787830027.412577:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0780 x1874670273330176/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830052 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787830027.412585:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787830027.412588:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787830027.412592:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273330176:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787830027.412599:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273330304:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787830027.412622:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787830027.412635:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830027/real 1787830027]  req@ffff9ee0056a0f00 x1874670273330304/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830052 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787830027.412647:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0f00 x1874670273330304/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830052 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787830027.412654:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787830027.412657:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787830027.412660:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273330304:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787830027.412666:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273330432:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787830027.412685:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787830027.412696:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830027/real 1787830027]  req@ffff9ee0056a30c0 x1874670273330432/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830052 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787830027.412708:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a30c0 x1874670273330432/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830052 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787830027.412715:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787830027.412717:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787830027.412720:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273330432:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787830027.412726:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273330560:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787830027.412744:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787830027.412754:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830027/real 1787830027]  req@ffff9ee0056a3480 x1874670273330560/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830052 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787830027.412765:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a3480 x1874670273330560/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830052 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787830027.412772:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787830027.412775:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787830027.412778:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273330560:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787830027.412783:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273330688:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787830027.412802:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787830027.412812:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830027/real 1787830027]  req@ffff9ee0056a1e00 x1874670273330688/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830052 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787830027.412822:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1e00 x1874670273330688/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830052 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787830027.412830:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787830027.412834:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787830027.412837:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273330688:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787830028.243518:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787830028.435540:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787830029.267544:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787830029.459826:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787830030.291822:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787830030.483505:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787830031.315713:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787830031.507449:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787830032.339549:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787830032.531491:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:0.0:1787830032.531929:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787830032.531934:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1787830032.531938:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787830032.531947:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 5196
00000100:00080000:0.0:1787830032.531958:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787830032.531965:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787830032.531999:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9e00 x1874670273330816/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787830032.532060:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273330816:192.168.203.121@tcp:250:kworker.0
00000800:00000100:1.0:1787830032.532133:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:0.0:1787830032.532163:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787830032.532166:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787830032.532168:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787830032.532173:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5196
00000100:00080000:0.0:1787830032.532177:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787830032.532181:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787830032.532190:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787830032.532203:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8000 x1874670273330944/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787830032.532263:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830032/real 1787830032]  req@ffff9ee0056e9e00 x1874670273330816/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787830057 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787830032.532293:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9e00 x1874670273330816/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787830057 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787830032.532302:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787830032.532306:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787830032.532310:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273330816:192.168.203.121@tcp:250:kworker.0
00000100:00100000:1.0:1787830032.532350:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273330944:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787830032.532374:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787830032.532386:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830032/real 1787830032]  req@ffff9ee0056e8000 x1874670273330944/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830057 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787830032.532397:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8000 x1874670273330944/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830057 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787830032.532405:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787830032.532408:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787830032.532411:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273330944:192.168.203.121@tcp:38:kworker.0
00000100:00080000:0.0:1787830032.532519:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787830032.532523:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787830032.532525:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787830032.532528:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5196
00000100:00080000:0.0:1787830032.532532:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787830032.532536:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787830032.532542:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787830032.532554:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8000 x1874670273331072/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787830032.532599:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273331072:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787830032.532622:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:0.0:1787830032.532644:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787830032.532648:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787830032.532650:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787830032.532654:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5196
00000100:00080000:0.0:1787830032.532658:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787830032.532662:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787830032.532667:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787830032.532678:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9e00 x1874670273331200/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787830032.532717:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830032/real 1787830032]  req@ffff9ee0056e8000 x1874670273331072/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830057 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787830032.532729:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8000 x1874670273331072/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830057 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787830032.532737:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787830032.532740:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787830032.532743:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273331072:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787830032.532755:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273331200:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787830032.532775:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787830032.532786:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830032/real 1787830032]  req@ffff9ee0056e9e00 x1874670273331200/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830057 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787830032.532798:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9e00 x1874670273331200/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830057 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787830032.532805:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787830032.532808:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787830032.532811:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273331200:192.168.203.121@tcp:8:kworker.0
00000100:00080000:0.0:1787830032.532891:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787830032.532895:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787830032.532897:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787830032.532902:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5196
00000100:00080000:0.0:1787830032.532906:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787830032.532909:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787830032.532915:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787830032.532927:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ebc00 x1874670273331328/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787830032.532970:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273331328:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787830032.532993:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:0.0:1787830032.533014:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787830032.533018:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787830032.533019:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787830032.533023:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5196
00000100:00080000:0.0:1787830032.533027:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787830032.533031:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787830032.533036:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787830032.533048:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e83c0 x1874670273331456/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787830032.533229:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830032/real 1787830032]  req@ffff9ee0056ebc00 x1874670273331328/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830057 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787830032.533242:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ebc00 x1874670273331328/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830057 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787830032.533250:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787830032.533253:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787830032.533256:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273331328:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787830032.533268:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273331456:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787830032.533289:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787830032.533300:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830032/real 1787830032]  req@ffff9ee0056e83c0 x1874670273331456/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830057 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787830032.533312:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e83c0 x1874670273331456/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830057 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787830032.533346:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787830032.533350:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787830032.533353:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273331456:192.168.203.121@tcp:8:kworker.0
00000100:00080000:0.0:1787830032.533451:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787830032.533455:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787830032.533457:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787830032.533461:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5196
00000100:00080000:0.0:1787830032.533465:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787830032.533468:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787830032.533475:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787830032.533487:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8f00 x1874670273331584/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787830032.533531:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273331584:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787830032.533553:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787830032.533618:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830032/real 1787830032]  req@ffff9ee0056e8f00 x1874670273331584/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830057 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787830032.533629:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8f00 x1874670273331584/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830057 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787830032.533637:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787830032.533640:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787830032.533643:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273331584:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787830033.364310:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787830033.555477:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787830034.387618:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787830034.579443:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787830035.411795:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787830035.603428:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787830036.436341:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787830036.627434:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787830037.460129:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1787830037.651458:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787830037.651468:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787830037.651473:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787830037.651482:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 5201
00000100:00080000:3.0:1787830037.651493:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787830037.651500:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787830037.651536:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707480 x1874670273331712/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787830037.651627:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273331712:192.168.203.121@tcp:250:kworker.0
00000100:00100000:2.0:1787830037.651663:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000800:00000100:1.0:1787830037.651686:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787830037.651720:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787830037.651725:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787830037.651727:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787830037.651731:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5201
00000100:00080000:3.0:1787830037.651735:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787830037.651739:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787830037.651748:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787830037.651761:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704000 x1874670273331840/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787830037.652221:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830037/real 1787830037]  req@ffff9ee005707480 x1874670273331712/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787830062 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787830037.652247:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707480 x1874670273331712/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787830062 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787830037.652256:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787830037.652260:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787830037.652264:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273331712:192.168.203.121@tcp:250:kworker.0
00000100:00100000:1.0:1787830037.652285:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273331840:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787830037.652310:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787830037.652363:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830037/real 1787830037]  req@ffff9ee005704000 x1874670273331840/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830062 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787830037.652375:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704000 x1874670273331840/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830062 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787830037.652382:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787830037.652385:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787830037.652388:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273331840:192.168.203.121@tcp:38:kworker.0
00000100:00080000:3.0:1787830037.652582:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787830037.652586:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787830037.652588:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787830037.652592:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5201
00000100:00080000:3.0:1787830037.652597:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787830037.652601:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787830037.652607:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787830037.652619:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707840 x1874670273331968/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787830037.652660:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273331968:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787830037.652682:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787830037.652701:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787830037.652704:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787830037.652706:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787830037.652710:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5201
00000100:00080000:3.0:1787830037.652713:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787830037.652716:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787830037.652721:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787830037.652732:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705680 x1874670273332096/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787830037.654401:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830037/real 1787830037]  req@ffff9ee005707840 x1874670273331968/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830062 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787830037.654419:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707840 x1874670273331968/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830062 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787830037.654428:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787830037.654432:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787830037.654436:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273331968:192.168.203.121@tcp:8:kworker.0
00000100:00080000:3.0:1787830037.654464:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1787830037.654465:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273332096:192.168.203.121@tcp:8:kworker.0
00000100:00080000:3.0:1787830037.654472:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787830037.654476:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787830037.654483:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5201
00000100:00080000:3.0:1787830037.654490:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787830037.654495:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787830037.654503:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000800:00000100:1.0:1787830037.654505:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787830037.654520:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830037/real 1787830037]  req@ffff9ee005705680 x1874670273332096/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830062 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787830037.654525:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704780 x1874670273332224/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787830037.654546:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705680 x1874670273332096/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830062 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787830037.654548:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787830037.654557:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787830037.654559:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787830037.654564:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787830037.654567:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00080000:3.0:1787830037.654571:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5201
00000100:00100000:1.0:1787830037.654576:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273332096:192.168.203.121@tcp:8:kworker.0
00000100:00080000:3.0:1787830037.654578:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787830037.654586:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787830037.654592:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787830037.654593:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273332224:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787830037.654610:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057043c0 x1874670273332352/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1787830037.654621:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787830037.654625:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787830037.654630:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787830037.654633:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1787830037.654635:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830037/real 1787830037]  req@ffff9ee005704780 x1874670273332224/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830062 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787830037.654639:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5201
00000100:00080000:3.0:1787830037.654645:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787830037.654651:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787830037.654656:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704780 x1874670273332224/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830062 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:3.0:1787830037.654658:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:1.0:1787830037.654669:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:3.0:1787830037.654674:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705a40 x1874670273332480/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787830037.654675:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787830037.654682:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273332224:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787830037.654700:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273332352:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787830037.654718:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787830037.654728:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830037/real 1787830037]  req@ffff9ee0057043c0 x1874670273332352/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830062 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787830037.654739:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057043c0 x1874670273332352/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830062 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787830037.654752:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787830037.654755:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787830037.654757:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273332352:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787830037.654762:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273332480:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787830037.654776:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787830037.654785:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830037/real 1787830037]  req@ffff9ee005705a40 x1874670273332480/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830062 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787830037.654807:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705a40 x1874670273332480/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830062 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787830037.654814:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787830037.654817:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787830037.654820:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273332480:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787830038.483768:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787830038.676632:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787830039.507690:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787830039.699452:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787830040.531576:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787830040.723461:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787830041.555663:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787830041.747445:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787830042.579523:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1787830042.771429:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787830042.771439:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787830042.771443:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787830042.771454:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 5206
00000100:00080000:3.0:1787830042.771464:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787830042.771470:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787830042.771503:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704b40 x1874670273332608/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787830042.771527:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787830042.771530:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787830042.771532:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787830042.771538:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5206
00000100:00080000:3.0:1787830042.771541:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787830042.771545:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787830042.771554:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787830042.771566:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706580 x1874670273332736/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787830042.771575:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787830042.771578:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787830042.771579:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787830042.771582:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5206
00000100:00080000:3.0:1787830042.771585:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787830042.771588:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787830042.771593:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787830042.771602:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705e00 x1874670273332864/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787830042.771611:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787830042.771614:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787830042.771615:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787830042.771618:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5206
00000100:00080000:3.0:1787830042.771621:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787830042.771625:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787830042.771629:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787830042.771638:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706d00 x1874670273332992/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787830042.771648:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787830042.771651:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787830042.771653:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787830042.771656:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5206
00000100:00080000:3.0:1787830042.771659:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787830042.771663:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787830042.771667:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787830042.771677:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273332608:192.168.203.121@tcp:250:kworker.0
00000100:00100000:3.0:1787830042.771681:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705a40 x1874670273333120/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787830042.771693:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787830042.771696:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787830042.771698:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787830042.771702:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5206
00000100:00080000:3.0:1787830042.771706:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787830042.771709:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787830042.771713:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787830042.771723:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057043c0 x1874670273333248/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787830042.771731:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787830042.771736:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000800:00000100:1.0:1787830042.771737:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787830042.771738:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787830042.771744:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5206
00000100:00080000:3.0:1787830042.771748:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787830042.771752:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787830042.771757:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787830042.771767:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704780 x1874670273333376/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787830042.771787:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830042/real 1787830042]  req@ffff9ee005704b40 x1874670273332608/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787830067 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787830042.771805:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704b40 x1874670273332608/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787830067 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787830042.771822:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787830042.771826:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787830042.771830:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273332608:192.168.203.121@tcp:250:kworker.0
00000100:00100000:1.0:1787830042.771838:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273332736:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787830042.771859:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787830042.771869:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830042/real 1787830042]  req@ffff9ee005706580 x1874670273332736/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830067 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787830042.771881:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706580 x1874670273332736/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830067 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787830042.771888:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787830042.771891:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787830042.771894:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273332736:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787830042.771900:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273332864:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787830042.771914:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787830042.771923:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830042/real 1787830042]  req@ffff9ee005705e00 x1874670273332864/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830067 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787830042.771933:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705e00 x1874670273332864/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830067 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787830042.771940:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787830042.771943:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787830042.771946:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273332864:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787830042.771952:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273332992:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787830042.771966:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787830042.771973:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830042/real 1787830042]  req@ffff9ee005706d00 x1874670273332992/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830067 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787830042.771984:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706d00 x1874670273332992/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830067 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787830042.771991:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787830042.771994:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787830042.771997:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273332992:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787830042.772020:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273333120:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787830042.772034:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787830042.772054:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830042/real 1787830042]  req@ffff9ee005705a40 x1874670273333120/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830067 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787830042.772066:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705a40 x1874670273333120/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830067 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787830042.772073:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787830042.772076:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787830042.772079:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273333120:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787830042.772085:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273333248:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787830042.772100:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787830042.772109:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830042/real 1787830042]  req@ffff9ee0057043c0 x1874670273333248/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830067 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787830042.772119:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057043c0 x1874670273333248/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830067 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787830042.772127:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787830042.772129:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787830042.772132:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273333248:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787830042.772137:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273333376:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787830042.772151:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787830042.772161:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830042/real 1787830042]  req@ffff9ee005704780 x1874670273333376/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830067 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787830042.772171:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704780 x1874670273333376/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830067 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787830042.772178:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787830042.772181:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787830042.772183:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273333376:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787830042.772312:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787830043.603543:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787830043.795850:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787830044.627480:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787830044.819599:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787830045.651698:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787830045.843686:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787830046.675557:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787830046.868788:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787830047.700479:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787830047.891408:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:0.0:1787830047.891475:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787830047.891489:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1787830047.891493:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787830047.891501:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 5211
00000100:00080000:0.0:1787830047.891510:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787830047.891517:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787830047.891549:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb840 x1874670273333504/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787830047.891575:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787830047.891579:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787830047.891581:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787830047.891586:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5211
00000100:00080000:0.0:1787830047.891589:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787830047.891593:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787830047.891602:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787830047.891613:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb480 x1874670273333632/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787830047.891622:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787830047.891625:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787830047.891626:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787830047.891629:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5211
00000100:00080000:0.0:1787830047.891633:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787830047.891636:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787830047.891641:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787830047.891650:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e92c0 x1874670273333760/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787830047.891659:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787830047.891662:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787830047.891663:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787830047.891667:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5211
00000100:00080000:0.0:1787830047.891670:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787830047.891676:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787830047.891677:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273333504:192.168.203.121@tcp:250:kworker.0
00000008:00100000:0.0:1787830047.891681:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787830047.891695:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8b40 x1874670273333888/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787830047.891705:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787830047.891708:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787830047.891710:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787830047.891714:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5211
00000100:00080000:0.0:1787830047.891727:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787830047.891732:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787830047.891736:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787830047.891747:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb0c0 x1874670273334016/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787830047.891755:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787830047.891758:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787830047.891760:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787830047.891763:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5211
00000100:00080000:0.0:1787830047.891766:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1787830047.891769:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273333632:192.168.203.121@tcp:38:kworker.0
00000100:00080000:0.0:1787830047.891773:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787830047.891781:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787830047.891794:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9a40 x1874670273334144/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787830047.891804:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787830047.891809:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:1.0:1787830047.891809:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273333760:192.168.203.121@tcp:8:kworker.0
00000100:00080000:0.0:1787830047.891814:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787830047.891819:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5211
00000100:00080000:0.0:1787830047.891838:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787830047.891843:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787830047.891849:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787830047.891861:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273333888:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787830047.891863:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ea580 x1874670273334272/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787830047.891897:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273334016:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787830047.891921:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273334144:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787830047.891945:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273334272:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787830048.723489:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787830048.915803:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787830049.747611:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787830049.939492:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787830050.771608:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000400:00000100:2.0:1787830050.963692:0:2354:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.203.121:988
00000400:00000100:2.0:1787830050.963729:0:2354:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.203.121@tcp at host 192.168.203.121 was unreachable: the network or that node may be down, or Lustre may be misconfigured.
00000800:00000100:2.0:1787830050.963746:0:2354:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:2.0:1787830050.963777:0:2354:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:2.0:1787830050.963785:0:2354:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:2.0:1787830050.963792:0:2354:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:2.0:1787830050.963799:0:2354:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:2.0:1787830050.963806:0:2354:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:2.0:1787830050.963814:0:2354:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000100:00100000:1.0:1787830050.965789:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830047/real 1787830050]  req@ffff9ee0056ea580 x1874670273334272/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830072 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787830050.965812:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ea580 x1874670273334272/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830072 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787830050.965820:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787830050.965824:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787830050.965827:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273334272:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787830050.965832:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830047/real 1787830050]  req@ffff9ee0056e8b40 x1874670273333888/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830072 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787830050.965839:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8b40 x1874670273333888/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830072 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787830050.965843:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787830050.965845:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787830050.965847:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273333888:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787830050.965850:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830047/real 1787830050]  req@ffff9ee0056eb0c0 x1874670273334016/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830072 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787830050.965857:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb0c0 x1874670273334016/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830072 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787830050.965863:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787830050.965865:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787830050.965867:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273334016:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787830050.965870:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830047/real 1787830050]  req@ffff9ee0056e9a40 x1874670273334144/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830072 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787830050.965876:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9a40 x1874670273334144/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830072 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787830050.965881:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787830050.965884:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787830050.965886:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273334144:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787830050.965889:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830047/real 1787830050]  req@ffff9ee0056eb840 x1874670273333504/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787830072 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787830050.965896:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb840 x1874670273333504/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787830072 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787830050.965900:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787830050.965902:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787830050.965904:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273333504:192.168.203.121@tcp:250:kworker.0
00000100:00100000:1.0:1787830050.965907:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830047/real 1787830050]  req@ffff9ee0056eb480 x1874670273333632/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830072 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787830050.965914:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb480 x1874670273333632/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830072 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787830050.965919:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:1.0:1787830050.965920:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787830050.965926:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787830050.965928:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273333632:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787830050.965934:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830047/real 1787830050]  req@ffff9ee0056e92c0 x1874670273333760/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830072 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787830050.965940:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e92c0 x1874670273333760/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830072 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787830050.965944:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787830050.965946:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787830050.965948:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273333760:192.168.203.121@tcp:8:kworker.0
00010000:00010000:0.0:1787830051.798254:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787830051.987518:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787830052.819742:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1787830053.011427:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787830053.011434:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1787830053.011437:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787830053.011445:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 5216
00000100:00080000:0.0:1787830053.011454:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787830053.011460:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787830053.011473:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00100000:0.0:1787830053.011489:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9680 x1874670273334400/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787830053.011511:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787830053.011514:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787830053.011515:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787830053.011517:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5216
00000100:00080000:0.0:1787830053.011519:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787830053.011521:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787830053.011528:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787830053.011538:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8780 x1874670273334528/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787830053.011548:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787830053.011551:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787830053.011553:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787830053.011557:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5216
00000100:00080000:0.0:1787830053.011559:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787830053.011563:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787830053.011567:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787830053.011571:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273334400:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787830053.011579:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ea940 x1874670273334656/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787830053.011589:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787830053.011592:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787830053.011594:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787830053.011597:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5216
00000100:00080000:0.0:1787830053.011600:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787830053.011603:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787830053.011607:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787830053.011617:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ead00 x1874670273334784/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787830053.011625:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:1.0:1787830053.011629:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:0.0:1787830053.011630:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787830053.011640:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787830053.011645:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5216
00000100:00080000:0.0:1787830053.011649:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787830053.011653:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787830053.011658:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787830053.011670:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830053/real 1787830053]  req@ffff9ee0056e9680 x1874670273334400/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787830078 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787830053.011671:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e92c0 x1874670273334912/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787830053.011700:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9680 x1874670273334400/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787830078 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787830053.011702:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787830053.011710:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787830053.011714:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787830053.011720:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787830053.011721:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5216
00000100:00080000:0.0:1787830053.011730:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787830053.011730:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:0.0:1787830053.011738:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787830053.011740:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273334400:192.168.203.121@tcp:250:kworker.0
00000008:00100000:0.0:1787830053.011746:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787830053.011756:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273334528:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787830053.011762:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb480 x1874670273335040/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787830053.011774:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787830053.011777:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787830053.011779:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787830053.011783:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5216
00000100:00080000:0.0:1787830053.011787:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787830053.011793:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000800:00000100:1.0:1787830053.011793:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000008:00100000:0.0:1787830053.011801:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787830053.011813:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830053/real 1787830053]  req@ffff9ee0056e8780 x1874670273334528/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830078 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787830053.011815:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb840 x1874670273335168/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787830053.012437:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8780 x1874670273334528/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830078 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787830053.012449:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787830053.012452:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787830053.012455:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273334528:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787830053.012483:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273334656:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787830053.012514:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787830053.012526:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830053/real 1787830053]  req@ffff9ee0056ea940 x1874670273334656/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830078 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787830053.012536:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ea940 x1874670273334656/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830078 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787830053.012544:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787830053.012548:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787830053.012551:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273334656:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787830053.012556:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273334784:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787830053.012576:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787830053.013100:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830053/real 1787830053]  req@ffff9ee0056ead00 x1874670273334784/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830078 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787830053.013118:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ead00 x1874670273334784/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830078 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787830053.013125:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787830053.013128:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787830053.013131:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273334784:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787830053.013138:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273334912:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787830053.013160:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787830053.013171:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830053/real 1787830053]  req@ffff9ee0056e92c0 x1874670273334912/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830078 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787830053.013181:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e92c0 x1874670273334912/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830078 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787830053.013188:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787830053.013191:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787830053.013193:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273334912:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787830053.013198:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273335040:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787830053.013214:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787830053.013223:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830053/real 1787830053]  req@ffff9ee0056eb480 x1874670273335040/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830078 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787830053.013233:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb480 x1874670273335040/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830078 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787830053.013244:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787830053.013247:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787830053.013249:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273335040:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787830053.013254:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273335168:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787830053.013268:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787830053.013284:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830053/real 1787830053]  req@ffff9ee0056eb840 x1874670273335168/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830078 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787830053.013295:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb840 x1874670273335168/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830078 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787830053.013301:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787830053.013304:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787830053.013307:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273335168:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787830053.843440:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787830054.035572:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787830054.867581:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787830055.060069:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787830055.891519:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787830056.083512:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787830056.915655:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787830057.107432:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787830057.939719:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787830058.131400:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787830058.131512:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787830058.131518:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787830058.131521:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787830058.131529:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 5221
00000100:00080000:3.0:1787830058.131538:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787830058.131544:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787830058.131576:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705680 x1874670273335296/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787830058.131603:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787830058.131607:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787830058.131609:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787830058.131612:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5221
00000100:00080000:3.0:1787830058.131616:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787830058.131620:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787830058.131628:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787830058.131640:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707840 x1874670273335424/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787830058.131650:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787830058.131653:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787830058.131655:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787830058.131657:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5221
00000100:00080000:3.0:1787830058.131660:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787830058.131663:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787830058.131668:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787830058.131677:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704000 x1874670273335552/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787830058.131684:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787830058.131696:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787830058.131697:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787830058.131701:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5221
00000100:00080000:3.0:1787830058.131704:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787830058.131708:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787830058.131712:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787830058.131721:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707480 x1874670273335680/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787830058.131733:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787830058.131736:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787830058.131737:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787830058.131740:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5221
00000100:00080000:3.0:1787830058.131744:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787830058.131747:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787830058.131752:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787830058.131762:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707c00 x1874670273335808/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787830058.131770:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787830058.131773:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787830058.131775:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787830058.131778:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5221
00000100:00080000:3.0:1787830058.131782:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787830058.131785:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787830058.131790:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787830058.131799:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057052c0 x1874670273335936/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787830058.131807:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787830058.131809:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787830058.131811:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787830058.131814:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5221
00000100:00080000:3.0:1787830058.131818:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787830058.131821:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787830058.131825:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787830058.131834:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057070c0 x1874670273336064/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787830058.131974:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273335296:192.168.203.121@tcp:250:kworker.0
00000800:00000100:1.0:1787830058.132026:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787830058.132063:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830058/real 1787830058]  req@ffff9ee005705680 x1874670273335296/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787830083 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787830058.132086:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705680 x1874670273335296/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787830083 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787830058.132095:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787830058.132099:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787830058.132103:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273335296:192.168.203.121@tcp:250:kworker.0
00000100:00100000:1.0:1787830058.132110:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273335424:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787830058.132199:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787830058.132211:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830058/real 1787830058]  req@ffff9ee005707840 x1874670273335424/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830083 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787830058.132222:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707840 x1874670273335424/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830083 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787830058.132229:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787830058.132232:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787830058.132236:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273335424:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787830058.132242:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273335552:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787830058.132966:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787830058.132980:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830058/real 1787830058]  req@ffff9ee005704000 x1874670273335552/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830083 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787830058.132992:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704000 x1874670273335552/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830083 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787830058.132999:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787830058.133002:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787830058.133005:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273335552:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787830058.133011:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273335680:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787830058.133029:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787830058.133040:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830058/real 1787830058]  req@ffff9ee005707480 x1874670273335680/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830083 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787830058.133050:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707480 x1874670273335680/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830083 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787830058.133057:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787830058.133060:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787830058.133064:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273335680:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787830058.133069:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273335808:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787830058.133097:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787830058.133109:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830058/real 1787830058]  req@ffff9ee005707c00 x1874670273335808/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830083 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787830058.133120:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707c00 x1874670273335808/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830083 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787830058.133127:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787830058.133210:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787830058.133215:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273335808:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787830058.133221:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273335936:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787830058.133242:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787830058.133253:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830058/real 1787830058]  req@ffff9ee0057052c0 x1874670273335936/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830083 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787830058.133264:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057052c0 x1874670273335936/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830083 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787830058.133271:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787830058.133273:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787830058.133276:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273335936:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787830058.133281:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273336064:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787830058.133296:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787830058.133306:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830058/real 1787830058]  req@ffff9ee0057070c0 x1874670273336064/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830083 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787830058.133365:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057070c0 x1874670273336064/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830083 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787830058.133375:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787830058.133378:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787830058.133381:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273336064:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787830058.963486:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787830059.155602:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787830059.989452:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787830060.179438:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787830061.011535:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787830061.203440:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787830062.036341:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787830062.227439:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787830063.071563:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1787830063.251414:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787830063.251423:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787830063.251427:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787830063.251436:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 5226
00000100:00080000:3.0:1787830063.251447:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787830063.251455:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787830063.251489:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057061c0 x1874670273336192/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787830063.251511:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787830063.251515:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787830063.251517:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787830063.251529:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5226
00000100:00080000:3.0:1787830063.251533:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787830063.251537:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787830063.251546:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787830063.251558:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706940 x1874670273336320/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787830063.251700:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787830063.251704:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787830063.251707:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787830063.251711:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5226
00000100:00080000:3.0:1787830063.251715:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787830063.251719:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787830063.251724:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787830063.251738:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057070c0 x1874670273336448/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787830063.251748:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787830063.251751:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787830063.251753:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787830063.251756:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5226
00000100:00080000:3.0:1787830063.251760:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787830063.251763:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787830063.251768:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787830063.251779:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057052c0 x1874670273336576/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787830063.251787:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787830063.251790:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787830063.251792:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787830063.251795:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5226
00000100:00080000:3.0:1787830063.251798:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787830063.251802:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787830063.251805:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787830063.251815:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707c00 x1874670273336704/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787830063.251824:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787830063.251827:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787830063.251829:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787830063.251832:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5226
00000100:00080000:3.0:1787830063.251835:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787830063.251838:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787830063.251843:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787830063.251852:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707480 x1874670273336832/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787830063.251860:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787830063.251863:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787830063.251865:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787830063.251868:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5226
00000100:00080000:3.0:1787830063.251872:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787830063.251875:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787830063.251879:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787830063.251889:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704000 x1874670273336960/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787830063.253339:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273336192:192.168.203.121@tcp:250:kworker.0
00000100:00100000:2.0:1787830063.253378:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000800:00000100:1.0:1787830063.253396:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787830063.253429:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830063/real 1787830063]  req@ffff9ee0057061c0 x1874670273336192/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787830088 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787830063.253444:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057061c0 x1874670273336192/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787830088 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787830063.253460:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787830063.253463:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787830063.253467:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273336192:192.168.203.121@tcp:250:kworker.0
00000100:00100000:1.0:1787830063.253474:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273336320:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787830063.253495:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787830063.253507:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830063/real 1787830063]  req@ffff9ee005706940 x1874670273336320/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830088 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787830063.253519:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706940 x1874670273336320/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830088 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787830063.253526:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787830063.253530:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787830063.253533:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273336320:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787830063.253538:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273336448:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787830063.253554:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787830063.253563:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830063/real 1787830063]  req@ffff9ee0057070c0 x1874670273336448/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830088 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787830063.253572:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057070c0 x1874670273336448/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830088 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787830063.253580:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787830063.253583:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787830063.253585:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273336448:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787830063.253591:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273336576:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787830063.253604:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787830063.253612:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830063/real 1787830063]  req@ffff9ee0057052c0 x1874670273336576/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830088 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787830063.253622:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057052c0 x1874670273336576/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830088 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787830063.253630:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787830063.253632:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787830063.253635:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273336576:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787830063.253640:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273336704:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787830063.253657:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787830063.253668:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830063/real 1787830063]  req@ffff9ee005707c00 x1874670273336704/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830088 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787830063.253678:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707c00 x1874670273336704/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830088 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787830063.253685:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787830063.253688:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787830063.253691:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273336704:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787830063.253697:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273336832:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787830063.253713:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787830063.253721:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830063/real 1787830063]  req@ffff9ee005707480 x1874670273336832/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830088 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787830063.253732:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707480 x1874670273336832/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830088 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787830063.253739:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787830063.253742:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787830063.253745:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273336832:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787830063.253750:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273336960:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787830063.253768:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787830063.253778:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830063/real 1787830063]  req@ffff9ee005704000 x1874670273336960/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830088 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787830063.253788:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704000 x1874670273336960/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830088 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787830063.253796:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787830063.253798:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787830063.253801:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273336960:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787830064.083533:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787830064.275576:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787830065.108673:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787830065.299433:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787830066.131531:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787830066.323686:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787830067.156544:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787830067.347440:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787830068.181901:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1787830068.371504:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787830068.371513:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1787830068.371518:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787830068.371536:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 5232
00000100:00080000:0.0:1787830068.371546:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787830068.371553:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787830068.371587:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9a40 x1874670273337088/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787830068.371611:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787830068.371614:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787830068.371616:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787830068.371620:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5232
00000100:00080000:0.0:1787830068.371623:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787830068.371627:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787830068.371636:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787830068.371652:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb0c0 x1874670273337216/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787830068.371663:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787830068.371666:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787830068.371668:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787830068.371671:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5232
00000100:00080000:0.0:1787830068.371673:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787830068.371679:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787830068.371683:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787830068.371691:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8b40 x1874670273337344/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787830068.371698:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787830068.371701:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787830068.371702:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787830068.371704:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5232
00000100:00080000:0.0:1787830068.371707:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787830068.371709:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787830068.371712:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787830068.371718:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ea580 x1874670273337472/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787830068.371726:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787830068.371728:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787830068.371730:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787830068.371733:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5232
00000100:00080000:0.0:1787830068.371735:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787830068.371738:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787830068.371741:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787830068.371748:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8f00 x1874670273337600/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787830068.371756:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787830068.371758:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787830068.371760:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787830068.371764:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5232
00000100:00080000:0.0:1787830068.371766:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787830068.371769:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787830068.371772:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787830068.371779:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e83c0 x1874670273337728/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787830068.371788:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787830068.371792:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:1.0:1787830068.371792:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273337088:192.168.203.121@tcp:250:kworker.0
00000100:00080000:0.0:1787830068.371795:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787830068.371801:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5232
00000100:00080000:0.0:1787830068.371803:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787830068.371806:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787830068.371809:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787830068.371819:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ebc00 x1874670273337856/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1787830068.371844:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787830068.371959:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00100000:1.0:1787830068.372010:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830068/real 1787830068]  req@ffff9ee0056e9a40 x1874670273337088/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787830093 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787830068.372032:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9a40 x1874670273337088/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787830093 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787830068.372041:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787830068.372044:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787830068.372047:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273337088:192.168.203.121@tcp:250:kworker.0
00000100:00100000:1.0:1787830068.372053:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273337216:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787830068.372075:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787830068.372085:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830068/real 1787830068]  req@ffff9ee0056eb0c0 x1874670273337216/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830093 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787830068.372095:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb0c0 x1874670273337216/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830093 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787830068.372102:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787830068.372105:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787830068.372108:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273337216:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787830068.372114:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273337344:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787830068.372132:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787830068.372142:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830068/real 1787830068]  req@ffff9ee0056e8b40 x1874670273337344/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830093 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787830068.372154:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8b40 x1874670273337344/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830093 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787830068.372242:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787830068.372247:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787830068.372251:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273337344:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787830068.372257:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273337472:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787830068.372278:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787830068.372291:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830068/real 1787830068]  req@ffff9ee0056ea580 x1874670273337472/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830093 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787830068.372301:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ea580 x1874670273337472/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830093 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787830068.372308:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787830068.372312:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787830068.372333:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273337472:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787830068.372339:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273337600:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787830068.372358:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787830068.372368:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830068/real 1787830068]  req@ffff9ee0056e8f00 x1874670273337600/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830093 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787830068.372379:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8f00 x1874670273337600/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830093 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787830068.372386:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787830068.372389:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787830068.372392:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273337600:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787830068.372417:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273337728:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787830068.372435:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787830068.372446:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830068/real 1787830068]  req@ffff9ee0056e83c0 x1874670273337728/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830093 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787830068.372457:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e83c0 x1874670273337728/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830093 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787830068.372465:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787830068.372468:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787830068.372470:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273337728:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787830068.372476:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273337856:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787830068.372492:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787830068.372502:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830068/real 1787830068]  req@ffff9ee0056ebc00 x1874670273337856/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830093 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787830068.372513:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ebc00 x1874670273337856/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830093 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787830068.372519:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787830068.372522:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787830068.372524:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273337856:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787830069.203658:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787830069.396928:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787830070.227813:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787830070.419676:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787830071.253280:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787830071.443451:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787830072.275892:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787830072.473127:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787830073.409033:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787830073.492134:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787830073.493122:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787830073.493129:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787830073.493132:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787830073.493141:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 5237
00000100:00080000:3.0:1787830073.493151:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787830073.493157:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787830073.493189:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707840 x1874670273337984/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787830073.493218:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787830073.493221:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787830073.493223:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787830073.493226:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5237
00000100:00080000:3.0:1787830073.493230:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787830073.493233:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787830073.493241:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787830073.493252:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705680 x1874670273338112/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787830073.493260:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787830073.493263:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787830073.493265:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787830073.493268:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5237
00000100:00080000:3.0:1787830073.493271:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787830073.493274:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787830073.493278:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787830073.493286:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704780 x1874670273338240/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787830073.493295:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787830073.493298:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787830073.493299:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787830073.493302:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5237
00000100:00080000:3.0:1787830073.493304:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787830073.493307:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787830073.493310:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787830073.493401:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273337984:192.168.203.121@tcp:250:kworker.0
00000800:00000100:1.0:1787830073.493454:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787830073.493487:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830073/real 1787830073]  req@ffff9ee005707840 x1874670273337984/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787830098 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787830073.493502:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707840 x1874670273337984/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787830098 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787830073.493512:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787830073.493515:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787830073.493518:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273337984:192.168.203.121@tcp:250:kworker.0
00000100:00100000:1.0:1787830073.493525:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273338112:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787830073.493542:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787830073.493561:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830073/real 1787830073]  req@ffff9ee005705680 x1874670273338112/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830098 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787830073.493572:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705680 x1874670273338112/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830098 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787830073.493580:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787830073.493583:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787830073.493586:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273338112:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787830073.493592:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273338240:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787830073.493607:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787830073.493616:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830073/real 1787830073]  req@ffff9ee005704780 x1874670273338240/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830098 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787830073.493627:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704780 x1874670273338240/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830098 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787830073.493634:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787830073.493636:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787830073.493640:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273338240:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787830073.493908:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057043c0 x1874670273338368/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787830073.493925:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787830073.493929:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787830073.493931:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787830073.493935:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5237
00000100:00080000:3.0:1787830073.493938:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787830073.493943:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787830073.493948:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787830073.493957:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705a40 x1874670273338496/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787830073.493965:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787830073.493968:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787830073.493970:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787830073.493973:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5237
00000100:00080000:3.0:1787830073.493975:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787830073.493978:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787830073.493981:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787830073.493988:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706d00 x1874670273338624/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787830073.493996:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787830073.493998:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787830073.494000:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787830073.494003:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5237
00000100:00080000:3.0:1787830073.494006:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787830073.494009:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787830073.494012:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787830073.494018:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705e00 x1874670273338752/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787830073.494153:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273338368:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787830073.494179:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787830073.494190:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830073/real 1787830073]  req@ffff9ee0057043c0 x1874670273338368/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830098 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787830073.494202:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057043c0 x1874670273338368/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830098 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787830073.494215:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787830073.494218:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787830073.494222:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273338368:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787830073.494228:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273338496:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787830073.494244:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787830073.494253:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830073/real 1787830073]  req@ffff9ee005705a40 x1874670273338496/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830098 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787830073.494263:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705a40 x1874670273338496/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830098 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787830073.494270:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787830073.494273:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787830073.494276:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273338496:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787830073.494281:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273338624:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787830073.494294:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787830073.494302:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830073/real 1787830073]  req@ffff9ee005706d00 x1874670273338624/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830098 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787830073.494313:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706d00 x1874670273338624/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830098 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787830073.494337:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787830073.494340:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787830073.494344:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273338624:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787830073.494349:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273338752:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787830073.494364:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787830073.494373:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830073/real 1787830073]  req@ffff9ee005705e00 x1874670273338752/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830098 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787830073.494394:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705e00 x1874670273338752/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830098 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787830073.494402:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787830073.494404:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787830073.494408:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273338752:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787830074.451521:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787830074.515999:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787830075.475512:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787830075.539544:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787830076.499656:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787830076.564566:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787830077.524114:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787830077.587426:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787830078.547684:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787830078.611563:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:1.0:1787830078.611722:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787830078.611728:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1787830078.611732:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787830078.611740:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 5242
00000100:00080000:1.0:1787830078.611750:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787830078.611757:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787830078.611810:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0b40 x1874670273338880/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787830078.611834:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787830078.611837:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787830078.611839:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787830078.611843:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5242
00000100:00080000:1.0:1787830078.611847:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787830078.611851:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787830078.611860:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787830078.611874:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1e00 x1874670273339008/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787830078.611889:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787830078.611892:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787830078.611894:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787830078.611897:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5242
00000100:00080000:1.0:1787830078.611901:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787830078.611905:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787830078.611910:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787830078.611920:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a3480 x1874670273339136/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787830078.611928:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787830078.611930:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787830078.611932:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787830078.611935:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5242
00000100:00080000:1.0:1787830078.611938:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787830078.611941:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787830078.611944:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787830078.611952:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a30c0 x1874670273339264/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787830078.611961:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787830078.611964:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787830078.611966:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787830078.611970:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5242
00000100:00080000:1.0:1787830078.611975:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787830078.611979:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787830078.611984:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787830078.611993:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0f00 x1874670273339392/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787830078.612003:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787830078.612006:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787830078.612010:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1787830078.612011:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273338880:192.168.203.121@tcp:250:kworker.0
00000100:00080000:1.0:1787830078.612016:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5242
00000100:00080000:1.0:1787830078.612021:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787830078.612024:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787830078.612030:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787830078.612041:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0780 x1874670273339520/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787830078.612050:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787830078.612053:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787830078.612054:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787830078.612057:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5242
00000100:00080000:1.0:1787830078.612060:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787830078.612064:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787830078.612068:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:0.0:1787830078.612079:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787830078.612080:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a2580 x1874670273339648/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787830078.612173:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830078/real 1787830078]  req@ffff9ee0056a0b40 x1874670273338880/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787830103 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787830078.612189:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0b40 x1874670273338880/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787830103 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787830078.612199:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787830078.612203:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787830078.612206:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273338880:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787830078.612213:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273339008:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787830078.612234:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787830078.612243:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830078/real 1787830078]  req@ffff9ee0056a1e00 x1874670273339008/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830103 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787830078.612254:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1e00 x1874670273339008/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830103 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787830078.612261:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787830078.612264:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787830078.612267:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273339008:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787830078.612272:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273339136:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787830078.612285:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787830078.612293:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830078/real 1787830078]  req@ffff9ee0056a3480 x1874670273339136/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830103 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787830078.612303:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a3480 x1874670273339136/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830103 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787830078.612310:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787830078.612313:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787830078.612449:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273339136:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787830078.612456:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273339264:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787830078.612475:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787830078.612486:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830078/real 1787830078]  req@ffff9ee0056a30c0 x1874670273339264/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830103 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787830078.612503:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a30c0 x1874670273339264/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830103 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787830078.612509:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787830078.612512:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787830078.612515:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273339264:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787830078.612540:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273339392:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787830078.612559:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787830078.612569:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830078/real 1787830078]  req@ffff9ee0056a0f00 x1874670273339392/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830103 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787830078.612580:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0f00 x1874670273339392/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830103 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787830078.612587:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787830078.612590:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787830078.612593:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273339392:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787830078.612598:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273339520:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787830078.612615:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787830078.612625:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830078/real 1787830078]  req@ffff9ee0056a0780 x1874670273339520/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830103 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787830078.612637:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0780 x1874670273339520/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830103 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787830078.612649:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787830078.612652:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787830078.612655:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273339520:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787830078.612660:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273339648:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787830078.612675:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787830078.612684:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830078/real 1787830078]  req@ffff9ee0056a2580 x1874670273339648/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830103 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787830078.612693:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a2580 x1874670273339648/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830103 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787830078.612700:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787830078.612703:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787830078.612706:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273339648:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787830079.571780:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787830079.635614:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787830080.598249:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787830080.659582:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787830081.625071:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787830081.683497:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787830082.647000:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787830082.707694:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787830083.670986:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787830083.731460:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787830083.731565:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787830083.731570:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787830083.731574:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787830083.731582:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 5247
00000100:00080000:3.0:1787830083.731592:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787830083.731600:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787830083.731633:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706580 x1874670273339776/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787830083.731664:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787830083.731668:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787830083.731670:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787830083.731673:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5247
00000100:00080000:3.0:1787830083.731677:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787830083.731681:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787830083.731691:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787830083.731702:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704b40 x1874670273339904/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787830083.731712:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787830083.731715:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787830083.731716:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787830083.731719:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5247
00000100:00080000:3.0:1787830083.731723:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787830083.731727:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787830083.731731:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787830083.731742:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705e00 x1874670273340032/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787830083.731750:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787830083.731753:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787830083.731754:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787830083.731769:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5247
00000100:00080000:3.0:1787830083.731772:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787830083.731776:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787830083.731781:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787830083.731791:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706d00 x1874670273340160/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787830083.731799:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787830083.731802:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787830083.731803:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787830083.731806:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5247
00000100:00080000:3.0:1787830083.731810:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787830083.731814:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787830083.731818:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787830083.731826:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705a40 x1874670273340288/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787830083.731839:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787830083.731842:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787830083.731844:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787830083.731847:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5247
00000100:00080000:3.0:1787830083.731849:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787830083.731852:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787830083.731856:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787830083.731865:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057043c0 x1874670273340416/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787830083.731872:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787830083.731875:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787830083.731876:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787830083.731879:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5247
00000100:00080000:3.0:1787830083.731882:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787830083.731885:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787830083.731888:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787830083.731897:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704780 x1874670273340544/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787830083.731978:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273339776:192.168.203.121@tcp:250:kworker.0
00000800:00000100:0.0:1787830083.732038:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787830083.732078:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830083/real 1787830083]  req@ffff9ee005706580 x1874670273339776/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787830108 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787830083.732093:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706580 x1874670273339776/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787830108 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787830083.732102:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787830083.732106:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787830083.732110:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273339776:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787830083.732117:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273339904:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787830083.732138:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787830083.732150:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830083/real 1787830083]  req@ffff9ee005704b40 x1874670273339904/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830108 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787830083.732161:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704b40 x1874670273339904/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830108 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787830083.732168:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787830083.732171:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787830083.732174:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273339904:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787830083.732179:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273340032:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787830083.732196:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787830083.732205:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830083/real 1787830083]  req@ffff9ee005705e00 x1874670273340032/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830108 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787830083.732216:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705e00 x1874670273340032/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830108 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787830083.732223:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787830083.732226:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787830083.732229:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273340032:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787830083.732233:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273340160:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787830083.732260:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787830083.732271:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830083/real 1787830083]  req@ffff9ee005706d00 x1874670273340160/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830108 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787830083.732282:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706d00 x1874670273340160/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830108 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787830083.732288:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787830083.732291:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787830083.732294:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273340160:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787830083.732300:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273340288:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787830083.732345:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787830083.732357:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830083/real 1787830083]  req@ffff9ee005705a40 x1874670273340288/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830108 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787830083.732368:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705a40 x1874670273340288/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830108 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787830083.732376:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787830083.732379:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787830083.732382:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273340288:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787830083.732387:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273340416:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787830083.732405:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787830083.732415:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830083/real 1787830083]  req@ffff9ee0057043c0 x1874670273340416/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830108 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787830083.732426:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057043c0 x1874670273340416/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830108 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787830083.732434:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787830083.732437:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787830083.732440:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273340416:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787830083.732445:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273340544:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787830083.732463:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787830083.732474:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830083/real 1787830083]  req@ffff9ee005704780 x1874670273340544/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830108 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787830083.732484:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704780 x1874670273340544/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830108 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787830083.732490:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787830083.732493:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787830083.732496:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273340544:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787830084.691673:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1787830084.757065:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787830085.716385:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787830085.782507:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787830086.741678:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787830086.803430:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787830087.763535:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787830087.827848:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787830088.789256:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1787830088.851555:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787830088.851564:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787830088.851568:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787830088.851577:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 5252
00000100:00080000:3.0:1787830088.851587:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787830088.851594:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787830088.851628:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705680 x1874670273340672/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787830088.852490:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00100000:0.0:1787830088.852781:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273340672:192.168.203.121@tcp:250:kworker.0
00000800:00000100:0.0:1787830088.852840:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:3.0:1787830088.853465:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787830088.853471:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787830088.853473:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787830088.853479:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5252
00000100:00080000:3.0:1787830088.853484:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787830088.853489:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787830088.853499:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787830088.853518:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707840 x1874670273340800/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787830088.853616:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830088/real 1787830088]  req@ffff9ee005705680 x1874670273340672/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787830113 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787830088.853635:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705680 x1874670273340672/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787830113 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787830088.853644:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787830088.853648:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787830088.853652:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273340672:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787830088.853672:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273340800:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787830088.853697:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787830088.853708:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830088/real 1787830088]  req@ffff9ee005707840 x1874670273340800/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830113 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787830088.853741:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787830088.853745:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787830088.853747:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787830088.853751:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5252
00000100:00080000:3.0:1787830088.853755:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787830088.853758:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787830088.853764:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787830088.853776:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704000 x1874670273340928/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787830088.853785:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787830088.853788:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787830088.853789:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787830088.853792:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5252
00000100:00080000:3.0:1787830088.853795:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787830088.853798:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787830088.853802:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787830088.853809:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707480 x1874670273341056/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787830088.853817:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787830088.853820:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787830088.853821:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787830088.853824:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5252
00000100:00080000:3.0:1787830088.853827:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787830088.853830:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787830088.853833:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787830088.853839:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707c00 x1874670273341184/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787830088.853847:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787830088.853850:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787830088.853852:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787830088.853855:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5252
00000100:00080000:3.0:1787830088.853858:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787830088.853861:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787830088.853864:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787830088.853871:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057052c0 x1874670273341312/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787830088.853878:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787830088.853881:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787830088.853883:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787830088.853886:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5252
00000100:00080000:3.0:1787830088.853888:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787830088.853891:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787830088.853894:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787830088.853901:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057070c0 x1874670273341440/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787830088.853986:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707840 x1874670273340800/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830113 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787830088.853996:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787830088.853999:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787830088.854003:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273340800:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787830088.854015:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273340928:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787830088.854035:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787830088.854046:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830088/real 1787830088]  req@ffff9ee005704000 x1874670273340928/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830113 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787830088.854056:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704000 x1874670273340928/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830113 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787830088.854064:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787830088.854067:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787830088.854070:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273340928:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787830088.854075:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273341056:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787830088.854089:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787830088.854097:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830088/real 1787830088]  req@ffff9ee005707480 x1874670273341056/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830113 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787830088.854107:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707480 x1874670273341056/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830113 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787830088.854114:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787830088.854117:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787830088.854120:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273341056:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787830088.854124:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273341184:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787830088.854137:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787830088.854145:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830088/real 1787830088]  req@ffff9ee005707c00 x1874670273341184/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830113 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787830088.854155:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707c00 x1874670273341184/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830113 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787830088.854163:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787830088.854165:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787830088.854168:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273341184:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787830088.854173:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273341312:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787830088.854186:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787830088.854194:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830088/real 1787830088]  req@ffff9ee0057052c0 x1874670273341312/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830113 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787830088.854204:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057052c0 x1874670273341312/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830113 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787830088.854211:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787830088.854213:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787830088.854217:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273341312:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787830088.854222:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273341440:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787830088.854235:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787830088.854242:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830088/real 1787830088]  req@ffff9ee0057070c0 x1874670273341440/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830113 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787830088.854252:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057070c0 x1874670273341440/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830113 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787830088.854259:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787830088.854261:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787830088.854264:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273341440:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787830089.813353:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787830089.876893:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787830090.835627:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787830090.902006:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787830091.859857:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787830091.923457:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787830092.883679:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787830092.949012:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787830093.911854:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787830093.971470:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:1.0:1787830093.972526:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787830093.972533:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1787830093.972538:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787830093.972547:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 5257
00000100:00080000:1.0:1787830093.972557:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787830093.972563:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787830093.972598:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0000 x1874670273341568/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787830093.972628:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787830093.972631:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787830093.972633:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787830093.972637:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5257
00000100:00080000:1.0:1787830093.972640:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787830093.972644:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787830093.972653:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787830093.972663:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a3c00 x1874670273341696/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787830093.972672:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787830093.972676:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787830093.972678:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787830093.972681:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5257
00000100:00080000:1.0:1787830093.972694:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787830093.972698:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787830093.972703:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787830093.972709:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273341568:192.168.203.121@tcp:250:kworker.0
00000100:00100000:1.0:1787830093.972716:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a2940 x1874670273341824/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787830093.972725:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787830093.972728:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787830093.972729:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787830093.972732:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5257
00000100:00080000:1.0:1787830093.972735:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787830093.972739:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787830093.972743:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787830093.972752:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a21c0 x1874670273341952/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787830093.972760:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787830093.972763:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787830093.972765:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787830093.972768:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5257
00000100:00080000:1.0:1787830093.972773:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787830093.972776:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787830093.972781:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000800:00000100:0.0:1787830093.972786:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787830093.972792:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1680 x1874670273342080/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787830093.972802:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787830093.972805:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787830093.972807:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787830093.972810:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5257
00000100:00080000:1.0:1787830093.972813:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787830093.972817:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787830093.972821:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787830093.972831:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830093/real 1787830093]  req@ffff9ee0056a0000 x1874670273341568/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787830118 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787830093.972832:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a03c0 x1874670273342208/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787830093.972859:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787830093.972862:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787830093.972864:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:0.0:1787830093.972867:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0000 x1874670273341568/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787830118 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787830093.972871:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5257
00000100:00080000:1.0:1787830093.972877:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787830093.972884:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00080000:0.0:1787830093.972888:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000008:00100000:1.0:1787830093.972890:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787830093.972899:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1a40 x1874670273342336/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787830093.974417:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787830093.974424:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273341568:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787830093.974435:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273341696:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787830093.974484:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787830093.974501:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830093/real 1787830093]  req@ffff9ee0056a3c00 x1874670273341696/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830118 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787830093.974516:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a3c00 x1874670273341696/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830118 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787830093.974526:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787830093.974529:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787830093.974532:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273341696:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787830093.974558:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273341824:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787830093.974577:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787830093.974587:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830093/real 1787830093]  req@ffff9ee0056a2940 x1874670273341824/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830118 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787830093.974598:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a2940 x1874670273341824/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830118 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787830093.974606:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787830093.974610:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787830093.974613:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273341824:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787830093.974620:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273341952:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787830093.974637:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787830093.974646:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830093/real 1787830093]  req@ffff9ee0056a21c0 x1874670273341952/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830118 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787830093.974655:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a21c0 x1874670273341952/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830118 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787830093.974663:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787830093.974666:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787830093.974669:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273341952:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787830093.974675:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273342080:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787830093.974707:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787830093.974718:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830093/real 1787830093]  req@ffff9ee0056a1680 x1874670273342080/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830118 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787830093.974728:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1680 x1874670273342080/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830118 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787830093.974735:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787830093.974738:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787830093.974741:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273342080:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787830093.974746:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273342208:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787830093.974764:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787830093.974775:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830093/real 1787830093]  req@ffff9ee0056a03c0 x1874670273342208/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830118 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787830093.974785:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a03c0 x1874670273342208/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830118 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787830093.974793:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787830093.974796:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787830093.974799:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273342208:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787830093.974804:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273342336:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787830093.974820:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787830093.974828:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830093/real 1787830093]  req@ffff9ee0056a1a40 x1874670273342336/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830118 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787830093.974838:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1a40 x1874670273342336/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830118 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787830093.974845:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787830093.974848:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787830093.974852:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273342336:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787830094.932111:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787830094.995448:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787830095.955598:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787830096.019595:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787830096.979912:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787830097.045507:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787830098.003548:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787830098.067390:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787830099.027546:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787830099.091476:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787830099.091558:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787830099.091565:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787830099.091569:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787830099.091580:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 5262
00000100:00080000:3.0:1787830099.091591:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787830099.091598:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787830099.091633:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706940 x1874670273342464/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787830099.091673:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787830099.091676:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787830099.091678:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787830099.091681:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5262
00000100:00080000:3.0:1787830099.091685:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787830099.091689:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787830099.091699:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787830099.091712:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057061c0 x1874670273342592/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787830099.091715:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273342464:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787830099.091728:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787830099.091731:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787830099.091733:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787830099.091736:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5262
00000100:00080000:3.0:1787830099.091739:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787830099.091742:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787830099.091746:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787830099.091757:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057070c0 x1874670273342720/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787830099.091765:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787830099.091767:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787830099.091769:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787830099.091771:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5262
00000100:00080000:3.0:1787830099.091774:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787830099.091777:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787830099.091781:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787830099.091789:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057052c0 x1874670273342848/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787830099.091797:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787830099.091800:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787830099.091802:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787830099.091805:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5262
00000100:00080000:3.0:1787830099.091808:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787830099.091812:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787830099.091816:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787830099.091827:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707c00 x1874670273342976/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787830099.091838:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787830099.091841:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787830099.091844:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787830099.091848:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5262
00000100:00080000:3.0:1787830099.091853:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787830099.091858:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787830099.091863:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:0.0:1787830099.091874:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787830099.091876:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707480 x1874670273343104/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787830099.091889:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787830099.091892:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787830099.091894:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787830099.091897:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5262
00000100:00080000:3.0:1787830099.091900:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787830099.091905:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787830099.091909:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787830099.091919:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704000 x1874670273343232/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787830099.091960:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830099/real 1787830099]  req@ffff9ee005706940 x1874670273342464/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787830124 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787830099.091976:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706940 x1874670273342464/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787830124 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787830099.091986:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787830099.091990:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787830099.091994:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273342464:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787830099.092012:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273342592:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787830099.092031:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787830099.092041:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830099/real 1787830099]  req@ffff9ee0057061c0 x1874670273342592/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830124 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787830099.092051:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057061c0 x1874670273342592/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830124 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787830099.092058:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787830099.092060:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787830099.092063:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057061c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273342592:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787830099.092068:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273342720:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787830099.092080:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787830099.092090:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830099/real 1787830099]  req@ffff9ee0057070c0 x1874670273342720/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830124 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787830099.092099:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057070c0 x1874670273342720/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830124 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787830099.092106:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787830099.092108:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787830099.092110:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273342720:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787830099.092115:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273342848:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787830099.092126:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787830099.092133:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830099/real 1787830099]  req@ffff9ee0057052c0 x1874670273342848/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830124 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787830099.092142:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057052c0 x1874670273342848/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830124 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787830099.092148:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787830099.092150:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787830099.092152:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273342848:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787830099.092156:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273342976:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787830099.092167:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787830099.092174:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830099/real 1787830099]  req@ffff9ee005707c00 x1874670273342976/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830124 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787830099.092182:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707c00 x1874670273342976/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830124 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787830099.092188:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787830099.092191:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787830099.092193:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273342976:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787830099.092197:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273343104:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787830099.092207:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787830099.092214:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830099/real 1787830099]  req@ffff9ee005707480 x1874670273343104/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830124 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787830099.092222:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707480 x1874670273343104/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830124 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787830099.092228:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787830099.092231:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787830099.092234:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273343104:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787830099.092238:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273343232:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787830099.092248:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787830099.092255:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830099/real 1787830099]  req@ffff9ee005704000 x1874670273343232/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830124 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787830099.092263:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704000 x1874670273343232/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830124 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787830099.092268:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787830099.092271:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787830099.092273:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273343232:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787830100.051556:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787830100.115609:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787830101.076185:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787830101.139542:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787830102.099544:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787830102.163450:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787830103.123485:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787830103.187740:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787830104.147668:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787830104.211462:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:1.0:1787830104.211534:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787830104.211538:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1787830104.211542:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787830104.211548:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 5267
00000100:00080000:1.0:1787830104.211557:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787830104.211562:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787830104.211592:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a12c0 x1874670273343360/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787830104.211623:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787830104.211626:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787830104.211628:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787830104.211631:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5267
00000100:00080000:1.0:1787830104.211633:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787830104.211635:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787830104.211643:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787830104.211654:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1a40 x1874670273343488/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787830104.211662:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1787830104.211665:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273343360:192.168.203.121@tcp:250:kworker.0
00000100:00080000:1.0:1787830104.211666:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787830104.211669:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787830104.211675:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5267
00000100:00080000:1.0:1787830104.211677:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787830104.211679:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787830104.211687:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787830104.211700:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a03c0 x1874670273343616/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1787830104.211718:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:1.0:1787830104.211727:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787830104.211730:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787830104.211732:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787830104.211737:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5267
00000100:00080000:1.0:1787830104.211741:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787830104.211745:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787830104.211749:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787830104.211752:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830104/real 1787830104]  req@ffff9ee0056a12c0 x1874670273343360/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787830129 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787830104.211761:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1680 x1874670273343744/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787830104.211768:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1787830104.211770:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a12c0 x1874670273343360/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787830129 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787830104.211771:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787830104.211774:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787830104.211781:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5267
00000100:00080000:1.0:1787830104.211786:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787830104.211789:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787830104.211791:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00080000:0.0:1787830104.211797:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00100000:1.0:1787830104.211798:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a21c0 x1874670273343872/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787830104.211807:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:1.0:1787830104.211808:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787830104.211814:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00100000:0.0:1787830104.211817:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273343360:192.168.203.121@tcp:250:kworker.0
00000100:00080000:1.0:1787830104.211818:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787830104.211826:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5267
00000100:00080000:1.0:1787830104.211831:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787830104.211834:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787830104.211838:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787830104.211844:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273343488:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787830104.211851:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a2940 x1874670273344000/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787830104.211863:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787830104.211867:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000800:00000100:0.0:1787830104.211868:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:1.0:1787830104.211870:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787830104.211876:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5267
00000100:00080000:1.0:1787830104.211881:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1787830104.211888:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830104/real 1787830104]  req@ffff9ee0056a1a40 x1874670273343488/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830129 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787830104.211898:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787830104.211904:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1a40 x1874670273343488/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830129 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:1.0:1787830104.211907:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00080000:0.0:1787830104.211918:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00100000:1.0:1787830104.211923:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a3c00 x1874670273344128/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787830104.211925:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787830104.211934:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273343488:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787830104.211945:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273343616:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787830104.211967:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787830104.211977:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830104/real 1787830104]  req@ffff9ee0056a03c0 x1874670273343616/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830129 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787830104.211989:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a03c0 x1874670273343616/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830129 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787830104.211997:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787830104.212000:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787830104.212004:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273343616:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787830104.212010:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273343744:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787830104.212026:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787830104.212037:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830104/real 1787830104]  req@ffff9ee0056a1680 x1874670273343744/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830129 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787830104.212149:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1680 x1874670273343744/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830129 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787830104.212158:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787830104.212161:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787830104.212165:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273343744:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787830104.212172:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273343872:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787830104.212196:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787830104.212216:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830104/real 1787830104]  req@ffff9ee0056a21c0 x1874670273343872/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830129 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787830104.212229:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a21c0 x1874670273343872/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830129 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787830104.212236:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787830104.212239:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787830104.212242:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273343872:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787830104.212260:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273344000:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787830104.212280:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787830104.212290:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830104/real 1787830104]  req@ffff9ee0056a2940 x1874670273344000/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830129 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787830104.212301:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a2940 x1874670273344000/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830129 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787830104.212308:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787830104.212311:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787830104.212339:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273344000:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787830104.212346:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273344128:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787830104.212375:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787830104.212386:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830104/real 1787830104]  req@ffff9ee0056a3c00 x1874670273344128/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830129 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787830104.212395:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a3c00 x1874670273344128/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830129 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787830104.212402:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787830104.212405:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787830104.212408:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273344128:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787830105.171882:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787830105.235467:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787830106.195584:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787830106.259421:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787830107.220627:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787830107.283463:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787830108.243521:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787830108.307905:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787830109.267543:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1787830109.331664:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787830109.331675:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787830109.331680:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787830109.331692:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 5273
00000100:00080000:2.0:1787830109.331705:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787830109.331714:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787830109.331764:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057292c0 x1874670273344256/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787830109.331808:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787830109.331812:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787830109.331813:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787830109.331817:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5273
00000100:00080000:2.0:1787830109.331821:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787830109.331825:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787830109.331836:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787830109.331849:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728780 x1874670273344384/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787830109.331859:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787830109.331862:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787830109.331864:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787830109.331867:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5273
00000100:00080000:2.0:1787830109.331870:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787830109.331874:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787830109.331879:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787830109.331889:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729e00 x1874670273344512/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787830109.331898:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787830109.331901:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787830109.331903:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787830109.331912:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5273
00000100:00080000:2.0:1787830109.331917:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787830109.331921:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787830109.331926:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787830109.331935:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a580 x1874670273344640/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787830109.331945:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787830109.331948:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787830109.331950:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787830109.331954:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5273
00000100:00080000:2.0:1787830109.331957:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787830109.331961:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787830109.331965:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787830109.331975:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572bc00 x1874670273344768/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787830109.331983:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787830109.331987:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787830109.331989:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787830109.331993:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5273
00000100:00080000:2.0:1787830109.331996:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787830109.331999:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787830109.332004:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787830109.332013:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a940 x1874670273344896/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787830109.332036:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787830109.332040:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787830109.332041:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787830109.332045:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5273
00000100:00080000:2.0:1787830109.332049:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787830109.332052:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787830109.332057:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787830109.332079:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057283c0 x1874670273345024/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787830109.332266:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057292c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273344256:192.168.203.121@tcp:250:kworker.0
00000800:00000100:0.0:1787830109.332370:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787830109.332431:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830109/real 1787830109]  req@ffff9ee0057292c0 x1874670273344256/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787830134 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787830109.332450:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057292c0 x1874670273344256/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787830134 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787830109.332461:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787830109.332466:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787830109.332471:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057292c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273344256:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787830109.332480:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273344384:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787830109.332503:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787830109.332516:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830109/real 1787830109]  req@ffff9ee005728780 x1874670273344384/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830134 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787830109.332529:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728780 x1874670273344384/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830134 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787830109.332538:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787830109.332542:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787830109.332545:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273344384:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787830109.332551:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273344512:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787830109.332724:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787830109.332740:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830109/real 1787830109]  req@ffff9ee005729e00 x1874670273344512/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830134 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787830109.332753:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729e00 x1874670273344512/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830134 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787830109.332761:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787830109.332764:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787830109.332767:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273344512:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787830109.332773:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273344640:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787830109.332794:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787830109.332804:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830109/real 1787830109]  req@ffff9ee00572a580 x1874670273344640/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830134 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787830109.332815:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a580 x1874670273344640/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830134 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787830109.332824:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787830109.332827:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787830109.332830:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273344640:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787830109.332836:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273344768:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787830109.332856:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787830109.332869:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830109/real 1787830109]  req@ffff9ee00572bc00 x1874670273344768/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830134 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787830109.332880:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572bc00 x1874670273344768/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830134 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787830109.332888:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787830109.332892:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787830109.332896:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273344768:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787830109.332900:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00100000:0.0:1787830109.332903:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273344896:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787830109.332926:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787830109.332937:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830109/real 1787830109]  req@ffff9ee00572a940 x1874670273344896/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830134 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787830109.332946:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a940 x1874670273344896/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830134 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787830109.332954:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787830109.332956:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787830109.332959:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273344896:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787830109.332964:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273345024:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787830109.332980:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787830109.332989:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830109/real 1787830109]  req@ffff9ee0057283c0 x1874670273345024/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830134 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787830109.332998:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057283c0 x1874670273345024/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830134 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787830109.333005:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787830109.333008:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787830109.333011:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273345024:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787830110.291603:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787830110.355793:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787830111.315575:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787830111.379411:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787830112.340213:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787830112.403489:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787830113.363756:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787830113.427467:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787830114.387535:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:3.0:1787830114.451978:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787830114.451988:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787830114.451992:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787830114.452003:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 5278
00000100:00080000:3.0:1787830114.452014:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787830114.452021:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787830114.452069:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707840 x1874670273345152/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787830114.452098:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787830114.452101:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787830114.452103:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787830114.452106:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5278
00000100:00080000:3.0:1787830114.452110:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787830114.452113:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787830114.452121:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787830114.452132:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705680 x1874670273345280/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787830114.452142:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787830114.452145:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787830114.452146:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787830114.452150:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5278
00000100:00080000:3.0:1787830114.452154:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787830114.452158:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787830114.452163:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787830114.452182:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704780 x1874670273345408/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787830114.452190:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787830114.452193:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787830114.452195:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787830114.452197:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5278
00000100:00080000:3.0:1787830114.452200:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787830114.452203:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787830114.452206:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787830114.452216:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057043c0 x1874670273345536/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787830114.452224:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787830114.452227:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787830114.452229:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787830114.452233:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5278
00000100:00080000:3.0:1787830114.452236:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787830114.452240:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787830114.452244:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787830114.452253:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705a40 x1874670273345664/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787830114.452261:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787830114.452264:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787830114.452265:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787830114.452268:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5278
00000100:00080000:3.0:1787830114.452272:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787830114.452274:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787830114.452278:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787830114.452287:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706d00 x1874670273345792/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787830114.452294:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787830114.452297:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787830114.452299:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787830114.452302:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5278
00000100:00080000:3.0:1787830114.452304:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787830114.452307:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787830114.452311:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787830114.452355:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705e00 x1874670273345920/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787830114.452451:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273345152:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787830114.452558:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273345280:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787830114.452590:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273345408:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787830114.452598:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00100000:0.0:1787830114.452620:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273345536:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787830114.452647:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273345664:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787830114.452666:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273345792:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787830114.452686:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273345920:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787830115.411526:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787830115.475419:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787830116.435503:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787830116.499846:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787830117.459598:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787830117.523544:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000400:00000100:3.0:1787830117.523937:0:2352:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.203.121:988
00000400:00000100:3.0:1787830117.523982:0:2352:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.203.121@tcp at host 192.168.203.121 was unreachable: the network or that node may be down, or Lustre may be misconfigured.
00000800:00000100:3.0:1787830117.523999:0:2352:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:3.0:1787830117.524046:0:2352:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:3.0:1787830117.524065:0:2352:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:3.0:1787830117.524072:0:2352:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:3.0:1787830117.524078:0:2352:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:3.0:1787830117.524085:0:2352:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:3.0:1787830117.524092:0:2352:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000100:00100000:0.0:1787830117.524382:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830114/real 1787830117]  req@ffff9ee005707840 x1874670273345152/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787830139 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787830117.524406:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707840 x1874670273345152/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787830139 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787830117.524416:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787830117.524421:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787830117.524425:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273345152:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787830117.524433:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830114/real 1787830117]  req@ffff9ee005705680 x1874670273345280/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830139 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787830117.524446:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705680 x1874670273345280/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830139 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787830117.524453:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787830117.524457:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787830117.524460:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273345280:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787830117.524466:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830114/real 1787830117]  req@ffff9ee005704780 x1874670273345408/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830139 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787830117.524476:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704780 x1874670273345408/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830139 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787830117.524482:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787830117.524485:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787830117.524488:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273345408:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787830117.524493:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830114/real 1787830117]  req@ffff9ee0057043c0 x1874670273345536/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830139 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787830117.524502:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057043c0 x1874670273345536/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830139 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787830117.524509:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787830117.524512:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787830117.524515:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273345536:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787830117.524531:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830114/real 1787830117]  req@ffff9ee005705a40 x1874670273345664/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830139 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787830117.524544:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705a40 x1874670273345664/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830139 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787830117.524551:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787830117.524554:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787830117.524558:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273345664:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787830117.524563:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830114/real 1787830117]  req@ffff9ee005706d00 x1874670273345792/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830139 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787830117.524574:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706d00 x1874670273345792/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830139 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787830117.524581:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787830117.524585:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787830117.524588:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273345792:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787830117.524594:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830114/real 1787830117]  req@ffff9ee005705e00 x1874670273345920/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830139 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787830117.524604:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705e00 x1874670273345920/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830139 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787830117.524610:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787830117.524613:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787830117.524616:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273345920:192.168.203.121@tcp:8:kworker.0
00010000:00010000:0.0:1787830118.483530:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787830118.548084:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787830119.507688:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787830119.571490:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:0.0:1787830119.578309:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787830119.578350:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1787830119.578356:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787830119.578369:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 5283
00000100:00080000:0.0:1787830119.578383:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787830119.578397:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787830119.578844:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9e00 x1874670273346048/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787830119.578943:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273346048:192.168.203.121@tcp:250:kworker.0
00000800:00000100:1.0:1787830119.579028:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:0.0:1787830119.579066:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787830119.579070:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787830119.579072:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787830119.579077:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5283
00000100:00080000:0.0:1787830119.579081:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787830119.579086:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787830119.579098:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787830119.579175:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8000 x1874670273346176/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787830119.579250:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830119/real 1787830119]  req@ffff9ee0056e9e00 x1874670273346048/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787830144 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787830119.579269:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9e00 x1874670273346048/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787830144 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787830119.579280:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787830119.579285:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787830119.579289:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273346048:192.168.203.121@tcp:250:kworker.0
00000100:00100000:1.0:1787830119.579342:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273346176:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787830119.579367:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787830119.579379:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830119/real 1787830119]  req@ffff9ee0056e8000 x1874670273346176/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830144 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787830119.579391:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8000 x1874670273346176/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830144 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787830119.579398:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787830119.579401:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787830119.579404:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273346176:192.168.203.121@tcp:38:kworker.0
00000100:00080000:0.0:1787830119.579908:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787830119.579914:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787830119.579916:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787830119.579920:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5283
00000100:00080000:0.0:1787830119.579925:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787830119.579932:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787830119.579940:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787830119.579959:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8000 x1874670273346304/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787830119.580006:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273346304:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787830119.580039:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:0.0:1787830119.580062:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787830119.580066:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787830119.580068:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787830119.580073:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5283
00000100:00080000:0.0:1787830119.580077:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787830119.580081:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787830119.580087:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787830119.580099:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9e00 x1874670273346432/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787830119.580200:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830119/real 1787830119]  req@ffff9ee0056e8000 x1874670273346304/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830144 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787830119.580214:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8000 x1874670273346304/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830144 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787830119.580223:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787830119.580236:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787830119.580240:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273346304:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787830119.580256:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273346432:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787830119.580278:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787830119.580288:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830119/real 1787830119]  req@ffff9ee0056e9e00 x1874670273346432/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830144 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787830119.580299:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9e00 x1874670273346432/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830144 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787830119.580306:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787830119.580309:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787830119.580312:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273346432:192.168.203.121@tcp:8:kworker.0
00000100:00080000:0.0:1787830119.580946:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787830119.580953:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787830119.580956:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787830119.580962:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5283
00000100:00080000:0.0:1787830119.580969:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787830119.580975:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787830119.580982:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787830119.581002:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ebc00 x1874670273346560/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787830119.581052:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273346560:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787830119.581089:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:0.0:1787830119.581119:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787830119.581122:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787830119.581124:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787830119.581129:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5283
00000100:00080000:0.0:1787830119.581132:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787830119.581137:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787830119.581142:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787830119.581153:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e83c0 x1874670273346688/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787830119.581313:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830119/real 1787830119]  req@ffff9ee0056ebc00 x1874670273346560/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830144 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787830119.581342:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ebc00 x1874670273346560/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830144 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787830119.581351:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787830119.581354:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787830119.581357:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ebc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273346560:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787830119.581376:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273346688:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787830119.581397:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787830119.581409:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830119/real 1787830119]  req@ffff9ee0056e83c0 x1874670273346688/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830144 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787830119.581692:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787830119.581698:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787830119.581700:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787830119.581705:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5283
00000100:00080000:0.0:1787830119.581710:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787830119.581715:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787830119.581722:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787830119.581738:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8f00 x1874670273346816/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787830119.581846:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e83c0 x1874670273346688/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830144 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787830119.581863:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787830119.581868:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787830119.581872:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e83c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273346688:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787830119.581888:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273346816:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787830119.581919:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787830119.581932:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830119/real 1787830119]  req@ffff9ee0056e8f00 x1874670273346816/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830144 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787830119.581942:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8f00 x1874670273346816/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830144 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787830119.581949:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787830119.581952:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787830119.581955:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273346816:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787830120.531598:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787830120.595600:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787830121.556398:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787830121.619488:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787830122.579592:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787830122.643860:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787830123.603500:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787830123.667416:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787830124.627510:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787830124.691443:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787830124.691849:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787830124.691854:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787830124.691858:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787830124.691867:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 5288
00000100:00080000:3.0:1787830124.691876:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787830124.691883:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787830124.691917:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704b40 x1874670273346944/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787830124.691951:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787830124.691955:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787830124.691956:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787830124.691960:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5288
00000100:00080000:3.0:1787830124.691963:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787830124.691967:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787830124.691977:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787830124.691989:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706580 x1874670273347072/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787830124.691999:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787830124.692002:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787830124.692004:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787830124.692008:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5288
00000100:00080000:3.0:1787830124.692011:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787830124.692015:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787830124.692019:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787830124.692031:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705e00 x1874670273347200/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787830124.692041:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787830124.692044:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787830124.692046:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787830124.692049:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5288
00000100:00080000:3.0:1787830124.692053:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787830124.692056:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787830124.692061:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787830124.692070:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005706d00 x1874670273347328/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787830124.692078:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787830124.692081:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787830124.692082:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787830124.692086:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5288
00000100:00080000:3.0:1787830124.692089:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787830124.692093:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787830124.692097:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787830124.692106:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705a40 x1874670273347456/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787830124.692114:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787830124.692117:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787830124.692119:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787830124.692122:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5288
00000100:00080000:3.0:1787830124.692125:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787830124.692128:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787830124.692132:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787830124.692152:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273346944:192.168.203.121@tcp:250:kworker.0
00000100:00100000:3.0:1787830124.692157:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057043c0 x1874670273347584/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787830124.692174:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787830124.692177:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787830124.692179:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787830124.692183:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5288
00000100:00080000:3.0:1787830124.692187:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787830124.692191:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787830124.692195:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787830124.692205:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704780 x1874670273347712/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1787830124.692226:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787830124.692274:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830124/real 1787830124]  req@ffff9ee005704b40 x1874670273346944/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787830149 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787830124.692291:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704b40 x1874670273346944/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787830149 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787830124.692302:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787830124.692306:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787830124.692310:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273346944:192.168.203.121@tcp:250:kworker.0
00000100:00100000:1.0:1787830124.692342:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273347072:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787830124.692362:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787830124.692374:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830124/real 1787830124]  req@ffff9ee005706580 x1874670273347072/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830149 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787830124.692385:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706580 x1874670273347072/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830149 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787830124.692390:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787830124.692392:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787830124.692394:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273347072:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787830124.692404:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273347200:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787830124.692435:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787830124.692447:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830124/real 1787830124]  req@ffff9ee005705e00 x1874670273347200/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830149 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787830124.692459:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705e00 x1874670273347200/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830149 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787830124.692466:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787830124.692469:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787830124.692485:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273347200:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787830124.692492:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005706d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273347328:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787830124.692516:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787830124.692527:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830124/real 1787830124]  req@ffff9ee005706d00 x1874670273347328/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830149 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787830124.692544:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005706d00 x1874670273347328/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830149 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787830124.692562:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787830124.692566:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787830124.692569:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005706d00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273347328:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787830124.692575:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273347456:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787830124.692593:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787830124.692603:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830124/real 1787830124]  req@ffff9ee005705a40 x1874670273347456/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830149 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787830124.692613:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705a40 x1874670273347456/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830149 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787830124.692620:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787830124.692623:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787830124.692625:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273347456:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787830124.692649:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273347584:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787830124.692665:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787830124.692674:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830124/real 1787830124]  req@ffff9ee0057043c0 x1874670273347584/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830149 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787830124.692801:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057043c0 x1874670273347584/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830149 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787830124.692814:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787830124.692817:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787830124.692820:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057043c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273347584:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787830124.692826:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273347712:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787830124.692860:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787830124.692873:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830124/real 1787830124]  req@ffff9ee005704780 x1874670273347712/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830149 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787830124.692884:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704780 x1874670273347712/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830149 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787830124.692892:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787830124.692895:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787830124.692898:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273347712:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787830125.652939:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787830125.715441:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787830126.675603:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787830126.739438:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787830127.699748:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787830127.763812:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787830128.723613:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787830128.787708:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787830129.749242:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787830129.811470:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:2.0:1787830129.811482:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787830129.811489:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787830129.811493:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787830129.811503:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 5293
00000100:00080000:2.0:1787830129.811514:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787830129.811521:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787830129.811556:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728000 x1874670273347840/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787830129.811633:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273347840:192.168.203.121@tcp:250:kworker.0
00000800:00000100:1.0:1787830129.811695:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:2.0:1787830129.811725:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787830129.811729:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787830129.811731:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787830129.811735:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5293
00000100:00080000:2.0:1787830129.811740:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787830129.811744:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787830129.811753:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787830129.811767:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a1c0 x1874670273347968/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787830129.811892:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830129/real 1787830129]  req@ffff9ee005728000 x1874670273347840/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787830154 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787830129.811909:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728000 x1874670273347840/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787830154 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787830129.811918:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787830129.811923:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787830129.811926:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273347840:192.168.203.121@tcp:250:kworker.0
00000100:00100000:1.0:1787830129.811948:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273347968:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787830129.811971:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787830129.811984:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830129/real 1787830129]  req@ffff9ee00572a1c0 x1874670273347968/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830154 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787830129.811994:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a1c0 x1874670273347968/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830154 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787830129.812002:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787830129.812005:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787830129.812008:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273347968:192.168.203.121@tcp:38:kworker.0
00000100:00080000:2.0:1787830129.812752:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787830129.812758:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787830129.812760:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787830129.812766:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5293
00000100:00080000:2.0:1787830129.812772:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787830129.812777:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787830129.812785:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787830129.812803:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729680 x1874670273348096/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787830129.812850:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273348096:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787830129.812883:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:2.0:1787830129.812905:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787830129.812909:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787830129.812911:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787830129.812915:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5293
00000100:00080000:2.0:1787830129.812919:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787830129.812933:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787830129.812938:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787830129.812951:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728b40 x1874670273348224/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787830129.813075:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830129/real 1787830129]  req@ffff9ee005729680 x1874670273348096/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830154 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787830129.813087:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729680 x1874670273348096/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830154 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787830129.813096:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787830129.813099:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787830129.813102:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273348096:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787830129.813117:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273348224:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787830129.813137:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787830129.813147:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830129/real 1787830129]  req@ffff9ee005728b40 x1874670273348224/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830154 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787830129.813158:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728b40 x1874670273348224/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830154 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787830129.813165:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787830129.813167:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787830129.813171:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273348224:192.168.203.121@tcp:8:kworker.0
00000100:00080000:2.0:1787830129.813253:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787830129.813258:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787830129.813260:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787830129.813264:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5293
00000100:00080000:2.0:1787830129.813268:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787830129.813272:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787830129.813278:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787830129.813290:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728f00 x1874670273348352/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787830129.813337:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273348352:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787830129.813361:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:2.0:1787830129.813491:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787830129.813494:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787830129.813496:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787830129.813499:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5293
00000100:00080000:2.0:1787830129.813502:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787830129.813505:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787830129.813509:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787830129.813518:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b840 x1874670273348480/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787830129.813551:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830129/real 1787830129]  req@ffff9ee005728f00 x1874670273348352/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830154 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787830129.813559:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728f00 x1874670273348352/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830154 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787830129.813565:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787830129.813567:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787830129.813569:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273348352:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787830129.813579:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273348480:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787830129.813595:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787830129.813606:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830129/real 1787830129]  req@ffff9ee00572b840 x1874670273348480/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830154 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787830129.813616:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b840 x1874670273348480/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830154 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787830129.813629:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787830129.813632:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787830129.813635:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273348480:192.168.203.121@tcp:8:kworker.0
00000100:00080000:2.0:1787830129.813678:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787830129.813682:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787830129.813684:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787830129.813688:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5293
00000100:00080000:2.0:1787830129.813692:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787830129.813696:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787830129.813701:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787830129.813713:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729a40 x1874670273348608/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787830129.813778:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273348608:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787830129.813800:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787830129.813812:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830129/real 1787830129]  req@ffff9ee005729a40 x1874670273348608/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830154 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787830129.813823:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729a40 x1874670273348608/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830154 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787830129.813830:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787830129.813833:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787830129.813836:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273348608:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787830130.771713:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787830130.835440:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787830131.795716:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787830131.859527:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787830132.820483:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787830132.883467:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787830133.843536:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787830133.907456:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787830134.870227:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787830134.931439:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:2.0:1787830134.932467:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787830134.932474:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787830134.932478:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787830134.932487:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 5298
00000100:00080000:2.0:1787830134.932497:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787830134.932505:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787830134.932539:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572ad00 x1874670273348736/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787830134.932569:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787830134.932573:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787830134.932574:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787830134.932578:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5298
00000100:00080000:2.0:1787830134.932582:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787830134.932587:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787830134.932596:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787830134.932607:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b480 x1874670273348864/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787830134.932616:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787830134.932619:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787830134.932621:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787830134.932624:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5298
00000100:00080000:2.0:1787830134.932641:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787830134.932645:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787830134.932650:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787830134.932661:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b0c0 x1874670273348992/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787830134.932666:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273348736:192.168.203.121@tcp:250:kworker.0
00000100:00080000:2.0:1787830134.932676:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787830134.932680:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787830134.932681:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787830134.932686:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5298
00000100:00080000:2.0:1787830134.932690:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787830134.932693:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787830134.932699:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787830134.932711:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729a40 x1874670273349120/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787830134.932720:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787830134.932724:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787830134.932725:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000800:00000100:1.0:1787830134.932731:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:2.0:1787830134.932732:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5298
00000100:00080000:2.0:1787830134.932737:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787830134.932742:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787830134.932747:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787830134.932759:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b840 x1874670273349248/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787830134.932769:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787830134.932772:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787830134.932774:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1787830134.932778:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830134/real 1787830134]  req@ffff9ee00572ad00 x1874670273348736/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787830159 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787830134.932781:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5298
00000100:00080000:2.0:1787830134.932788:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787830134.932795:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787830134.932800:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787830134.932802:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572ad00 x1874670273348736/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787830159 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787830134.932814:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728f00 x1874670273349376/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787830134.932815:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787830134.932824:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:2.0:1787830134.932831:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1787830134.932832:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273348736:192.168.203.121@tcp:250:kworker.0
00000100:00080000:2.0:1787830134.932840:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787830134.932843:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:1.0:1787830134.932846:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273348864:192.168.203.121@tcp:38:kworker.0
00000100:00080000:2.0:1787830134.932850:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5298
00000100:00080000:2.0:1787830134.932855:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787830134.932858:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787830134.932865:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1787830134.932873:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787830134.932877:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728b40 x1874670273349504/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787830134.932888:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830134/real 1787830134]  req@ffff9ee00572b480 x1874670273348864/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830159 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787830134.932903:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b480 x1874670273348864/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830159 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787830134.932913:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787830134.932917:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787830134.932920:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273348864:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787830134.932946:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273348992:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787830134.932963:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787830134.932985:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830134/real 1787830134]  req@ffff9ee00572b0c0 x1874670273348992/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830159 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787830134.932998:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b0c0 x1874670273348992/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830159 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787830134.933016:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787830134.933020:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787830134.933023:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273348992:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787830134.933029:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273349120:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787830134.933047:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787830134.933057:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830134/real 1787830134]  req@ffff9ee005729a40 x1874670273349120/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830159 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787830134.933070:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729a40 x1874670273349120/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830159 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787830134.933077:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787830134.933080:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787830134.933083:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273349120:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787830134.933088:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273349248:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787830134.933105:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787830134.933115:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830134/real 1787830134]  req@ffff9ee00572b840 x1874670273349248/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830159 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787830134.933125:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b840 x1874670273349248/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830159 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787830134.933132:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787830134.933134:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787830134.933137:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273349248:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787830134.933142:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273349376:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787830134.933155:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787830134.933163:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830134/real 1787830134]  req@ffff9ee005728f00 x1874670273349376/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830159 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787830134.933171:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728f00 x1874670273349376/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830159 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787830134.933182:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787830134.933185:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787830134.933187:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273349376:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787830134.933191:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273349504:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787830134.933204:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787830134.933211:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830134/real 1787830134]  req@ffff9ee005728b40 x1874670273349504/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830159 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787830134.933220:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728b40 x1874670273349504/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830159 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787830134.933226:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787830134.933228:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787830134.933230:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273349504:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787830135.891914:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787830135.957551:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787830136.915626:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787830136.980056:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787830137.940542:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787830138.004197:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787830138.964114:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787830139.027445:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787830139.987909:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1787830140.051679:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787830140.051701:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787830140.051705:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787830140.051715:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 5303
00000100:00080000:2.0:1787830140.051725:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787830140.051732:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787830140.051767:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729680 x1874670273349632/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787830140.051798:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787830140.051802:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787830140.051804:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787830140.051808:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5303
00000100:00080000:2.0:1787830140.051811:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787830140.051815:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787830140.051824:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787830140.051835:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a1c0 x1874670273349760/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787830140.051850:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787830140.051853:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787830140.051855:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787830140.051859:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5303
00000100:00080000:2.0:1787830140.051862:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787830140.051865:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787830140.051870:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787830140.051879:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728000 x1874670273349888/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787830140.051887:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787830140.051890:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787830140.051891:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787830140.051894:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5303
00000100:00080000:2.0:1787830140.051897:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787830140.051900:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787830140.051903:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787830140.051910:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057283c0 x1874670273350016/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787830140.051919:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787830140.051921:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787830140.051923:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787830140.051926:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5303
00000100:00080000:2.0:1787830140.051930:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787830140.051933:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787830140.051937:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787830140.051944:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a940 x1874670273350144/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787830140.051952:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787830140.051955:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787830140.051957:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787830140.051960:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5303
00000100:00080000:2.0:1787830140.051963:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787830140.051966:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787830140.051969:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787830140.051979:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572bc00 x1874670273350272/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787830140.051987:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787830140.051990:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787830140.051991:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787830140.051994:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5303
00000100:00080000:2.0:1787830140.051998:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787830140.052001:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787830140.052005:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787830140.052015:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a580 x1874670273350400/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787830140.052030:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273349632:192.168.203.121@tcp:250:kworker.0
00000800:00000100:1.0:1787830140.052112:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787830140.052138:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00100000:1.0:1787830140.052172:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830140/real 1787830140]  req@ffff9ee005729680 x1874670273349632/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787830165 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787830140.052190:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729680 x1874670273349632/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787830165 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787830140.052200:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787830140.052205:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787830140.052210:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273349632:192.168.203.121@tcp:250:kworker.0
00000100:00100000:1.0:1787830140.052218:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273349760:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787830140.052239:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787830140.052252:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830140/real 1787830140]  req@ffff9ee00572a1c0 x1874670273349760/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830165 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787830140.052265:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a1c0 x1874670273349760/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830165 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787830140.052272:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787830140.052276:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787830140.052279:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273349760:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787830140.052285:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273349888:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787830140.052303:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787830140.052338:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830140/real 1787830140]  req@ffff9ee005728000 x1874670273349888/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830165 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787830140.052352:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728000 x1874670273349888/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830165 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787830140.052359:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787830140.052376:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787830140.052380:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273349888:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787830140.052386:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273350016:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787830140.052406:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787830140.052417:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830140/real 1787830140]  req@ffff9ee0057283c0 x1874670273350016/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830165 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787830140.052429:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057283c0 x1874670273350016/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830165 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787830140.052436:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787830140.052439:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787830140.052442:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273350016:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787830140.052447:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273350144:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787830140.052465:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787830140.052475:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830140/real 1787830140]  req@ffff9ee00572a940 x1874670273350144/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830165 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787830140.052487:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a940 x1874670273350144/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830165 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787830140.052494:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787830140.052497:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787830140.052500:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273350144:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787830140.052506:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273350272:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787830140.052524:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787830140.052534:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830140/real 1787830140]  req@ffff9ee00572bc00 x1874670273350272/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830165 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787830140.052545:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572bc00 x1874670273350272/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830165 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787830140.052557:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787830140.052560:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787830140.052564:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273350272:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787830140.052594:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273350400:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787830140.052613:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787830140.052623:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830140/real 1787830140]  req@ffff9ee00572a580 x1874670273350400/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830165 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787830140.052634:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a580 x1874670273350400/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830165 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787830140.052641:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787830140.052645:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787830140.052648:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273350400:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787830141.011596:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787830141.075455:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787830142.035574:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787830142.099648:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787830143.059605:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787830143.123451:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787830144.083529:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787830144.147404:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787830145.107523:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787830145.171453:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:1.0:1787830145.171475:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787830145.171481:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1787830145.171485:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787830145.171494:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 5308
00000100:00080000:1.0:1787830145.171504:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787830145.171511:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787830145.171541:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0000 x1874670273350528/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787830145.171570:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787830145.171574:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787830145.171576:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787830145.171579:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5308
00000100:00080000:1.0:1787830145.171582:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787830145.171585:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787830145.171593:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787830145.171603:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a2580 x1874670273350656/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787830145.171612:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787830145.171615:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787830145.171617:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787830145.171620:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5308
00000100:00080000:1.0:1787830145.171623:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1787830145.171628:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273350528:192.168.203.121@tcp:250:kworker.0
00000100:00080000:1.0:1787830145.171629:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787830145.171636:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787830145.171645:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0780 x1874670273350784/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787830145.171653:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787830145.171656:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787830145.171658:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787830145.171661:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5308
00000100:00080000:1.0:1787830145.171665:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787830145.171668:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787830145.171673:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787830145.171682:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0f00 x1874670273350912/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787830145.171691:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000800:00000100:0.0:1787830145.171694:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:1.0:1787830145.171696:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787830145.171698:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787830145.171702:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5308
00000100:00080000:1.0:1787830145.171706:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787830145.171711:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787830145.171715:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787830145.171724:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a30c0 x1874670273351040/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787830145.171732:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787830145.171735:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787830145.171737:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787830145.171740:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5308
00000100:00080000:1.0:1787830145.171743:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787830145.171746:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787830145.171750:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787830145.171754:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830145/real 1787830145]  req@ffff9ee0056a0000 x1874670273350528/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787830170 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787830145.171762:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a3480 x1874670273351168/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787830145.171771:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0000 x1874670273350528/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787830170 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787830145.171772:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787830145.171780:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787830145.171784:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787830145.171787:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787830145.171791:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5308
00000100:00080000:0.0:1787830145.171793:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:1.0:1787830145.171795:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:0.0:1787830145.171797:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273350528:192.168.203.121@tcp:250:kworker.0
00000100:00080000:1.0:1787830145.171802:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787830145.171806:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273350656:192.168.203.121@tcp:38:kworker.0
00000008:00100000:1.0:1787830145.171807:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787830145.171820:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1e00 x1874670273351296/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1787830145.171838:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787830145.171849:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830145/real 1787830145]  req@ffff9ee0056a2580 x1874670273350656/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830170 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787830145.171861:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a2580 x1874670273350656/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830170 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787830145.171867:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787830145.171869:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787830145.171871:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273350656:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787830145.171889:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273350784:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787830145.171902:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787830145.171908:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830145/real 1787830145]  req@ffff9ee0056a0780 x1874670273350784/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830170 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787830145.171915:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0780 x1874670273350784/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830170 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787830145.171919:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787830145.171921:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787830145.171923:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273350784:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787830145.171926:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273350912:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787830145.171934:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787830145.171939:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830145/real 1787830145]  req@ffff9ee0056a0f00 x1874670273350912/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830170 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787830145.171945:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0f00 x1874670273350912/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830170 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787830145.171949:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787830145.171951:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787830145.171953:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273350912:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787830145.171955:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273351040:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787830145.171964:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787830145.171969:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830145/real 1787830145]  req@ffff9ee0056a30c0 x1874670273351040/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830170 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787830145.171975:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a30c0 x1874670273351040/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830170 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787830145.171979:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787830145.171980:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787830145.171982:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273351040:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787830145.171985:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273351168:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787830145.171993:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787830145.171997:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830145/real 1787830145]  req@ffff9ee0056a3480 x1874670273351168/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830170 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787830145.172003:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a3480 x1874670273351168/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830170 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787830145.172007:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787830145.172008:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787830145.172010:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273351168:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787830145.172013:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273351296:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787830145.172021:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787830145.172025:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830145/real 1787830145]  req@ffff9ee0056a1e00 x1874670273351296/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830170 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787830145.172035:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1e00 x1874670273351296/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830170 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787830145.172039:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787830145.172050:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787830145.172052:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273351296:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787830146.131671:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787830146.195671:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787830147.155558:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787830147.219500:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787830148.179536:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787830148.243896:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787830149.203532:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787830149.267487:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787830150.227887:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1787830150.291877:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787830150.291887:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1787830150.291891:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787830150.291901:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 5314
00000100:00080000:1.0:1787830150.291912:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787830150.291919:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787830150.291954:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0b40 x1874670273351424/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787830150.291982:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787830150.291986:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787830150.291988:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787830150.291992:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5314
00000100:00080000:1.0:1787830150.291996:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787830150.291999:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787830150.292009:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787830150.292023:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1e00 x1874670273351552/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787830150.292038:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273351424:192.168.203.121@tcp:250:kworker.0
00000100:00080000:1.0:1787830150.292043:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787830150.292047:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787830150.292049:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787830150.292053:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5314
00000100:00080000:1.0:1787830150.292057:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000800:00000100:0.0:1787830150.292103:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787830150.292138:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830150/real 1787830150]  req@ffff9ee0056a0b40 x1874670273351424/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787830175 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787830150.292154:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0b40 x1874670273351424/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787830175 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787830150.292164:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787830150.292167:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787830150.292171:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273351424:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787830150.292191:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273351552:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787830150.292208:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787830150.292218:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830150/real 1787830150]  req@ffff9ee0056a1e00 x1874670273351552/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830175 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787830150.292228:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1e00 x1874670273351552/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830175 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787830150.292241:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787830150.292244:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787830150.292247:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273351552:192.168.203.121@tcp:38:kworker.0
00000100:00080000:1.0:1787830150.292639:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787830150.292646:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787830150.292661:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a3480 x1874670273351680/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787830150.292678:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787830150.292682:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787830150.292684:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787830150.292687:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5314
00000100:00080000:1.0:1787830150.292691:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787830150.292695:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787830150.292699:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787830150.292715:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a30c0 x1874670273351808/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787830150.292724:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787830150.292727:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787830150.292730:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787830150.292733:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5314
00000100:00080000:1.0:1787830150.292736:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787830150.292740:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787830150.292744:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787830150.292753:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0f00 x1874670273351936/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787830150.292761:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787830150.292764:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787830150.292766:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787830150.292769:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5314
00000100:00080000:1.0:1787830150.292772:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787830150.292775:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787830150.292779:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787830150.292788:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0780 x1874670273352064/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787830150.292795:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787830150.292798:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787830150.292800:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787830150.292803:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5314
00000100:00080000:1.0:1787830150.292806:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787830150.292810:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787830150.292814:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787830150.292822:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a2580 x1874670273352192/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787830150.292850:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273351680:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787830150.292878:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787830150.292892:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830150/real 1787830150]  req@ffff9ee0056a3480 x1874670273351680/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830175 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787830150.292902:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a3480 x1874670273351680/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830175 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787830150.292909:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787830150.292912:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787830150.292915:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273351680:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787830150.292920:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273351808:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787830150.292938:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787830150.292947:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830150/real 1787830150]  req@ffff9ee0056a30c0 x1874670273351808/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830175 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787830150.292959:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a30c0 x1874670273351808/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830175 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787830150.292964:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:1.0:1787830150.292966:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787830150.292969:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787830150.292973:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273351808:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787830150.292980:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273351936:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787830150.293000:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787830150.293016:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830150/real 1787830150]  req@ffff9ee0056a0f00 x1874670273351936/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830175 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787830150.293028:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0f00 x1874670273351936/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830175 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787830150.293036:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787830150.293039:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787830150.293043:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273351936:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787830150.293051:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273352064:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787830150.293069:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787830150.293079:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830150/real 1787830150]  req@ffff9ee0056a0780 x1874670273352064/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830175 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787830150.293090:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0780 x1874670273352064/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830175 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787830150.293096:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787830150.293099:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787830150.293102:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273352064:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787830150.293107:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273352192:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787830150.293124:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787830150.293134:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830150/real 1787830150]  req@ffff9ee0056a2580 x1874670273352192/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830175 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787830150.293145:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a2580 x1874670273352192/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830175 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787830150.293153:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787830150.293155:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787830150.293158:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273352192:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787830151.252057:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787830151.315596:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787830152.275475:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787830152.339580:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787830153.300302:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787830153.363415:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787830154.323933:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787830154.387438:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787830155.347584:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787830155.411418:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:3.0:1787830155.411739:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787830155.411744:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:3.0:1787830155.411748:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787830155.411756:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 5319
00000100:00080000:3.0:1787830155.411765:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787830155.411773:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787830155.411807:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005705680 x1874670273352320/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787830155.411834:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787830155.411837:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787830155.411839:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787830155.411843:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5319
00000100:00080000:3.0:1787830155.411847:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787830155.411980:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787830155.411990:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787830155.412006:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707840 x1874670273352448/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787830155.412018:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787830155.412023:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00100000:1.0:1787830155.412024:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273352320:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787830155.412025:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787830155.412034:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5319
00000100:00080000:3.0:1787830155.412039:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787830155.412042:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787830155.412047:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787830155.412059:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005704000 x1874670273352576/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787830155.412068:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787830155.412071:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787830155.412074:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787830155.412077:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5319
00000100:00080000:3.0:1787830155.412081:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787830155.412084:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000800:00000100:1.0:1787830155.412088:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000008:00100000:3.0:1787830155.412091:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787830155.412104:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707480 x1874670273352704/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787830155.412112:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787830155.412115:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:3.0:1787830155.412117:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787830155.412121:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5319
00000100:00080000:3.0:1787830155.412125:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1787830155.412128:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830155/real 1787830155]  req@ffff9ee005705680 x1874670273352320/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787830180 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787830155.412132:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787830155.412141:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787830155.412148:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005705680 x1874670273352320/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787830180 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787830155.412154:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005707c00 x1874670273352832/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787830155.412157:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787830155.412164:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787830155.412171:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005705680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273352320:192.168.203.121@tcp:250:kworker.0
00000100:00080000:3.0:1787830155.412172:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:3.0:1787830155.412177:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:3.0:1787830155.412179:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:3.0:1787830155.412184:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5319
00000100:00080000:3.0:1787830155.412188:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00100000:1.0:1787830155.412190:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273352448:192.168.203.121@tcp:38:kworker.0
00000100:00080000:3.0:1787830155.412195:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:3.0:1787830155.412201:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:1.0:1787830155.412210:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787830155.412215:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057052c0 x1874670273352960/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:1.0:1787830155.412220:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830155/real 1787830155]  req@ffff9ee005707840 x1874670273352448/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830180 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787830155.412237:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:1.0:1787830155.412239:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707840 x1874670273352448/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830180 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787830155.412243:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:3.0:1787830155.412247:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787830155.412249:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787830155.412254:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00080000:3.0:1787830155.412255:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5319
00000100:00100000:1.0:1787830155.412269:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273352448:192.168.203.121@tcp:38:kworker.0
00000100:00080000:3.0:1787830155.412271:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787830155.412278:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787830155.412283:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273352576:192.168.203.121@tcp:8:kworker.0
00000008:00100000:3.0:1787830155.412284:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787830155.412301:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057070c0 x1874670273353088/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:1.0:1787830155.412311:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787830155.412358:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830155/real 1787830155]  req@ffff9ee005704000 x1874670273352576/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830180 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787830155.412370:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005704000 x1874670273352576/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830180 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787830155.412388:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787830155.412391:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787830155.412395:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005704000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273352576:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787830155.412401:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273352704:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787830155.412420:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787830155.412430:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830155/real 1787830155]  req@ffff9ee005707480 x1874670273352704/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830180 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787830155.412440:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707480 x1874670273352704/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830180 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787830155.412447:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787830155.412450:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787830155.412453:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273352704:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787830155.412458:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273352832:192.168.203.121@tcp:38:kworker.0
00000800:00000100:1.0:1787830155.412475:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787830155.412485:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830155/real 1787830155]  req@ffff9ee005707c00 x1874670273352832/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830180 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787830155.412495:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005707c00 x1874670273352832/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830180 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787830155.412502:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787830155.412505:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787830155.412508:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005707c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273352832:192.168.203.121@tcp:38:kworker.0
00000100:00100000:1.0:1787830155.412523:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273352960:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787830155.412540:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787830155.412549:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830155/real 1787830155]  req@ffff9ee0057052c0 x1874670273352960/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830180 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787830155.412572:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057052c0 x1874670273352960/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830180 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787830155.412578:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787830155.412581:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787830155.412591:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057052c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273352960:192.168.203.121@tcp:8:kworker.0
00000100:00100000:1.0:1787830155.412596:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273353088:192.168.203.121@tcp:8:kworker.0
00000800:00000100:1.0:1787830155.412613:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:1.0:1787830155.412624:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830155/real 1787830155]  req@ffff9ee0057070c0 x1874670273353088/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830180 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:1.0:1787830155.412634:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057070c0 x1874670273353088/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830180 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:1.0:1787830155.412646:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:1.0:1787830155.412649:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:1.0:1787830155.412652:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057070c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273353088:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787830156.371606:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787830156.435617:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787830157.395567:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787830157.459401:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787830158.419562:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787830158.484281:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787830159.444373:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787830159.507701:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787830160.468356:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787830160.531949:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:2.0:1787830160.533573:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787830160.533582:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787830160.533586:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787830160.533596:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 5324
00000100:00080000:2.0:1787830160.533605:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787830160.533613:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787830160.533657:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729e00 x1874670273353216/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787830160.533689:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787830160.533693:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787830160.533695:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787830160.533699:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5324
00000100:00080000:2.0:1787830160.533702:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787830160.533706:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787830160.533714:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787830160.533726:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728780 x1874670273353344/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787830160.533735:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787830160.533738:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787830160.533741:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787830160.533744:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5324
00000100:00080000:2.0:1787830160.533747:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787830160.533751:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787830160.533756:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787830160.533765:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057292c0 x1874670273353472/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787830160.533774:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787830160.533777:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787830160.533779:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787830160.533782:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5324
00000100:00080000:2.0:1787830160.533784:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787830160.533788:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787830160.533791:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787830160.533802:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a580 x1874670273353600/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787830160.533810:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787830160.533813:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787830160.533815:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787830160.533818:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5324
00000100:00080000:2.0:1787830160.533822:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787830160.533825:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787830160.533830:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787830160.533840:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572bc00 x1874670273353728/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787830160.533848:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787830160.533851:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787830160.533852:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787830160.533856:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5324
00000100:00080000:2.0:1787830160.533859:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787830160.533863:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787830160.533867:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787830160.533877:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a940 x1874670273353856/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787830160.533887:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787830160.533903:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00100000:0.0:1787830160.533904:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273353216:192.168.203.121@tcp:250:kworker.0
00000100:00080000:2.0:1787830160.533905:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787830160.533914:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5324
00000100:00080000:2.0:1787830160.533926:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787830160.533931:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787830160.533943:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787830160.533957:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057283c0 x1874670273353984/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:0.0:1787830160.533977:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787830160.534019:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830160/real 1787830160]  req@ffff9ee005729e00 x1874670273353216/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787830185 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787830160.534035:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729e00 x1874670273353216/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787830185 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787830160.534045:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787830160.534049:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787830160.534054:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273353216:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787830160.534061:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273353344:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787830160.534084:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787830160.534096:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830160/real 1787830160]  req@ffff9ee005728780 x1874670273353344/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830185 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787830160.534108:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728780 x1874670273353344/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830185 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787830160.534117:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787830160.534121:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787830160.534123:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273353344:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787830160.534130:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057292c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273353472:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787830160.534149:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787830160.534161:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830160/real 1787830160]  req@ffff9ee0057292c0 x1874670273353472/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830185 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787830160.534172:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057292c0 x1874670273353472/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830185 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787830160.534180:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787830160.534183:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787830160.534186:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057292c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273353472:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787830160.534192:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273353600:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787830160.534210:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787830160.534230:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830160/real 1787830160]  req@ffff9ee00572a580 x1874670273353600/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830185 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787830160.534242:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a580 x1874670273353600/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830185 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787830160.534249:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787830160.534252:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787830160.534254:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273353600:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787830160.534260:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273353728:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787830160.534279:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787830160.534290:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830160/real 1787830160]  req@ffff9ee00572bc00 x1874670273353728/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830185 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787830160.534301:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572bc00 x1874670273353728/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830185 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787830160.534308:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787830160.534311:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787830160.534338:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273353728:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787830160.534346:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273353856:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787830160.534366:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787830160.534378:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830160/real 1787830160]  req@ffff9ee00572a940 x1874670273353856/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830185 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787830160.534389:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a940 x1874670273353856/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830185 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787830160.534397:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787830160.534400:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787830160.534403:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273353856:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787830160.534433:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273353984:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787830160.534453:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787830160.534463:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830160/real 1787830160]  req@ffff9ee0057283c0 x1874670273353984/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830185 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787830160.534479:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057283c0 x1874670273353984/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830185 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787830160.534487:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787830160.534490:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787830160.534493:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273353984:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787830161.491959:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787830161.557425:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787830162.515513:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787830162.579430:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787830163.539680:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787830163.605271:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787830164.563584:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787830164.627510:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787830165.587801:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787830165.651491:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:1.0:1787830165.651607:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787830165.651613:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1787830165.651617:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787830165.651627:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 5329
00000100:00080000:1.0:1787830165.651638:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787830165.651645:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787830165.651684:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a2580 x1874670273354112/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787830165.651715:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787830165.651719:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787830165.651720:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787830165.651723:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5329
00000100:00080000:1.0:1787830165.651727:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787830165.651731:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787830165.651740:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787830165.651751:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0780 x1874670273354240/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787830165.651760:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787830165.651763:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787830165.651764:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787830165.651767:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5329
00000100:00080000:1.0:1787830165.651770:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787830165.651774:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787830165.651777:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787830165.651786:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0f00 x1874670273354368/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787830165.651794:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787830165.651797:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787830165.651798:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787830165.651801:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5329
00000100:00080000:1.0:1787830165.651805:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787830165.651808:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787830165.651812:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787830165.651820:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a30c0 x1874670273354496/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787830165.651829:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787830165.651832:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787830165.651833:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787830165.651837:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5329
00000100:00080000:1.0:1787830165.651840:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787830165.651844:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787830165.651848:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787830165.651858:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a3480 x1874670273354624/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787830165.651867:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787830165.651870:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787830165.651871:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787830165.651875:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5329
00000100:00080000:1.0:1787830165.651878:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787830165.651881:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787830165.651885:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787830165.651893:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a0000 x1874670273354752/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787830165.651900:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787830165.651902:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787830165.651903:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787830165.651906:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5329
00000100:00080000:1.0:1787830165.651909:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787830165.651912:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787830165.651916:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787830165.651923:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a3c00 x1874670273354880/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787830165.652231:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273354112:192.168.203.121@tcp:250:kworker.0
00000800:00000100:0.0:1787830165.652292:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787830165.652358:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830165/real 1787830165]  req@ffff9ee0056a2580 x1874670273354112/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787830190 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787830165.652375:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a2580 x1874670273354112/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787830190 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787830165.652385:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787830165.652389:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787830165.652392:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a2580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273354112:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787830165.652399:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273354240:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787830165.652420:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787830165.652432:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830165/real 1787830165]  req@ffff9ee0056a0780 x1874670273354240/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830190 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787830165.652442:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0780 x1874670273354240/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830190 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787830165.652456:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787830165.652459:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787830165.652462:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273354240:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787830165.652468:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273354368:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787830165.652487:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787830165.652497:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830165/real 1787830165]  req@ffff9ee0056a0f00 x1874670273354368/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830190 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787830165.652508:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0f00 x1874670273354368/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830190 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787830165.652515:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787830165.652518:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787830165.652520:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273354368:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787830165.652525:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273354496:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787830165.652540:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787830165.652548:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830165/real 1787830165]  req@ffff9ee0056a30c0 x1874670273354496/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830190 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787830165.652558:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a30c0 x1874670273354496/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830190 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787830165.652564:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787830165.652567:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787830165.652570:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a30c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273354496:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787830165.652575:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273354624:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787830165.652590:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787830165.652598:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830165/real 1787830165]  req@ffff9ee0056a3480 x1874670273354624/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830190 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787830165.652608:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a3480 x1874670273354624/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830190 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787830165.652615:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787830165.652617:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787830165.652620:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273354624:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787830165.652625:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273354752:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787830165.652640:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787830165.652649:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830165/real 1787830165]  req@ffff9ee0056a0000 x1874670273354752/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830190 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787830165.652659:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a0000 x1874670273354752/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830190 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787830165.652666:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787830165.652668:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787830165.652671:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273354752:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787830165.652676:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273354880:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787830165.652691:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787830165.652700:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830165/real 1787830165]  req@ffff9ee0056a3c00 x1874670273354880/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830190 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787830165.652710:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a3c00 x1874670273354880/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830190 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787830165.652717:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787830165.652719:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787830165.652722:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a3c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273354880:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787830166.611486:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787830166.675412:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787830167.635755:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787830167.699432:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787830168.660013:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787830168.723537:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787830169.683552:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787830169.747431:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787830170.708685:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:1.0:1787830170.771440:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787830170.771450:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:1.0:1787830170.771454:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787830170.771465:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 5334
00000100:00080000:1.0:1787830170.771476:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787830170.771484:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:1.0:1787830170.771518:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a2940 x1874670273355008/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787830170.771603:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273355008:192.168.203.121@tcp:250:kworker.0
00000100:00100000:2.0:1787830170.771657:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000800:00000100:0.0:1787830170.771809:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:1.0:1787830170.771841:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787830170.771845:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787830170.771847:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787830170.771852:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5334
00000100:00080000:1.0:1787830170.771856:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787830170.771860:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787830170.771869:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787830170.771883:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a21c0 x1874670273355136/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787830170.771942:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830170/real 1787830170]  req@ffff9ee0056a2940 x1874670273355008/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787830195 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787830170.771958:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a2940 x1874670273355008/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787830195 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787830170.771968:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787830170.771971:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787830170.771975:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a2940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273355008:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787830170.771996:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273355136:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787830170.772020:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787830170.772046:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830170/real 1787830170]  req@ffff9ee0056a21c0 x1874670273355136/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830195 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787830170.772059:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a21c0 x1874670273355136/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830195 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787830170.772067:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787830170.772071:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787830170.772074:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273355136:192.168.203.121@tcp:38:kworker.0
00000100:00080000:1.0:1787830170.772124:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787830170.772128:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787830170.772130:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787830170.772133:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5334
00000100:00080000:1.0:1787830170.772137:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787830170.772142:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787830170.772147:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787830170.772173:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1680 x1874670273355264/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787830170.772189:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787830170.772192:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787830170.772194:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787830170.772197:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5334
00000100:00080000:1.0:1787830170.772201:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787830170.772204:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787830170.772209:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787830170.772220:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a03c0 x1874670273355392/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787830170.772242:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787830170.772245:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:1.0:1787830170.772246:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787830170.772250:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5334
00000100:00080000:1.0:1787830170.772253:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787830170.772257:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787830170.772262:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:1.0:1787830170.772272:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a1a40 x1874670273355520/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787830170.772280:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787830170.772283:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:1.0:1787830170.772285:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787830170.772288:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5334
00000100:00080000:1.0:1787830170.772292:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787830170.772295:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787830170.772300:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787830170.772309:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a12c0 x1874670273355648/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:1.0:1787830170.772339:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:1.0:1787830170.772342:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:1.0:1787830170.772344:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:1.0:1787830170.772348:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5334
00000100:00080000:1.0:1787830170.772352:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:1.0:1787830170.772355:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:1.0:1787830170.772360:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:1.0:1787830170.772370:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056a21c0 x1874670273355776/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787830170.772744:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273355264:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787830170.772770:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787830170.772782:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830170/real 1787830170]  req@ffff9ee0056a1680 x1874670273355264/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830195 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787830170.772794:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1680 x1874670273355264/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830195 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787830170.772801:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787830170.772805:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787830170.772808:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273355264:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787830170.772814:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273355392:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787830170.772830:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787830170.772840:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830170/real 1787830170]  req@ffff9ee0056a03c0 x1874670273355392/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830195 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787830170.772851:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a03c0 x1874670273355392/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830195 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787830170.772857:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787830170.772860:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787830170.772863:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a03c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273355392:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787830170.772867:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273355520:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787830170.772882:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787830170.772890:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830170/real 1787830170]  req@ffff9ee0056a1a40 x1874670273355520/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830195 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787830170.772900:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a1a40 x1874670273355520/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830195 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787830170.772907:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787830170.772910:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787830170.772913:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a1a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273355520:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787830170.772917:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273355648:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787830170.772931:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787830170.772939:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830170/real 1787830170]  req@ffff9ee0056a12c0 x1874670273355648/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830195 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787830170.772948:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a12c0 x1874670273355648/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830195 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787830170.772954:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787830170.772957:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787830170.772959:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a12c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273355648:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787830170.772963:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056a21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273355776:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787830170.772975:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787830170.772983:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830170/real 1787830170]  req@ffff9ee0056a21c0 x1874670273355776/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830195 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787830170.772992:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056a21c0 x1874670273355776/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830195 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787830170.772998:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787830170.773000:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787830170.773003:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056a21c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273355776:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787830171.731627:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787830171.796518:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787830172.755653:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787830172.819406:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787830173.781374:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787830173.843425:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787830174.803621:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787830174.867453:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787830175.827614:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787830175.892129:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:2.0:1787830175.892396:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787830175.892402:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787830175.892405:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787830175.892414:0:487:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 5339
00000100:00080000:2.0:1787830175.892434:0:487:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787830175.892440:0:487:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787830175.892480:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728000 x1874670273355904/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787830175.892524:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787830175.892528:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787830175.892529:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787830175.892534:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5339
00000100:00080000:2.0:1787830175.892538:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787830175.892543:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787830175.892554:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787830175.892568:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a1c0 x1874670273356032/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787830175.892578:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:0.0:1787830175.892581:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273355904:192.168.203.121@tcp:250:kworker.0
00000100:00080000:2.0:1787830175.892582:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787830175.892586:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787830175.892593:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5339
00000100:00080000:2.0:1787830175.892596:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787830175.892599:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787830175.892604:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787830175.892614:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729680 x1874670273356160/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787830175.892624:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787830175.892627:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787830175.892629:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787830175.892633:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5339
00000100:00080000:2.0:1787830175.892637:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787830175.892641:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787830175.892645:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:0.0:1787830175.892647:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787830175.892658:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728b40 x1874670273356288/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787830175.892668:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787830175.892671:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787830175.892673:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787830175.892678:0:487:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5339
00000100:00080000:2.0:1787830175.892681:0:487:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787830175.892688:0:487:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787830175.892689:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830175/real 1787830175]  req@ffff9ee005728000 x1874670273355904/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787830200 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:2.0:1787830175.892694:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787830175.892711:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728f00 x1874670273356416/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787830175.892713:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728000 x1874670273355904/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787830200 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787830175.892733:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787830175.892737:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787830175.892739:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787830175.892743:0:487:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5339
00000100:00080000:0.0:1787830175.892747:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:2.0:1787830175.892748:0:487:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787830175.892756:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00080000:2.0:1787830175.892757:0:487:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787830175.892764:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273355904:192.168.203.121@tcp:250:kworker.0
00000008:00100000:2.0:1787830175.892764:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787830175.892782:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b840 x1874670273356544/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787830175.892791:0:487:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787830175.892794:0:487:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787830175.892796:0:487:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787830175.892799:0:487:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5339
00000100:00080000:2.0:1787830175.892802:0:487:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787830175.892805:0:487:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787830175.892810:0:487:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787830175.892819:0:487:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729a40 x1874670273356672/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787830175.892849:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273356032:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787830175.892872:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787830175.892896:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830175/real 1787830175]  req@ffff9ee00572a1c0 x1874670273356032/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830200 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787830175.892907:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a1c0 x1874670273356032/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830200 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787830175.892914:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787830175.892917:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787830175.892920:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273356032:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787830175.892925:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273356160:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787830175.892941:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787830175.892950:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830175/real 1787830175]  req@ffff9ee005729680 x1874670273356160/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830200 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787830175.892961:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729680 x1874670273356160/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830200 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787830175.892968:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787830175.892971:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787830175.892973:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273356160:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787830175.892979:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273356288:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787830175.892995:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787830175.893004:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830175/real 1787830175]  req@ffff9ee005728b40 x1874670273356288/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830200 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787830175.893013:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728b40 x1874670273356288/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830200 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787830175.893020:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787830175.893022:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787830175.893025:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273356288:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787830175.893030:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273356416:192.168.203.121@tcp:38:kworker.0
00000800:00000100:0.0:1787830175.893043:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787830175.893050:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830175/real 1787830175]  req@ffff9ee005728f00 x1874670273356416/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830200 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787830175.893059:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728f00 x1874670273356416/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830200 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787830175.893065:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787830175.893068:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787830175.893070:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273356416:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787830175.893075:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273356544:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787830175.893087:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787830175.893094:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830175/real 1787830175]  req@ffff9ee00572b840 x1874670273356544/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830200 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787830175.893104:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b840 x1874670273356544/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830200 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787830175.893109:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787830175.893112:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787830175.893127:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273356544:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787830175.893133:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273356672:192.168.203.121@tcp:8:kworker.0
00000800:00000100:0.0:1787830175.893148:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:0.0:1787830175.893158:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830175/real 1787830175]  req@ffff9ee005729a40 x1874670273356672/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830200 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787830175.893168:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729a40 x1874670273356672/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830200 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787830175.893174:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787830175.893177:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787830175.893180:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273356672:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787830176.853347:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787830176.915651:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787830177.875489:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787830177.939412:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787830178.902267:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787830178.963488:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787830179.924653:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787830179.987463:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787830180.949369:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:2.0:1787830181.011430:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787830181.011443:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787830181.011448:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787830181.011457:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 5344
00000100:00080000:2.0:1787830181.011467:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787830181.011476:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787830181.011637:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b0c0 x1874670273356800/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787830181.011668:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787830181.011672:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787830181.011674:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787830181.011678:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5344
00000100:00080000:2.0:1787830181.011682:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787830181.011686:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787830181.011696:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787830181.011709:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b480 x1874670273356928/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787830181.011717:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787830181.011720:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787830181.011722:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787830181.011725:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5344
00000100:00080000:2.0:1787830181.011728:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787830181.011732:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787830181.011737:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787830181.011745:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572ad00 x1874670273357056/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787830181.011760:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787830181.011763:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787830181.011765:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787830181.011768:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5344
00000100:00080000:2.0:1787830181.011770:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787830181.011774:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787830181.011777:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787830181.011785:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729a40 x1874670273357184/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787830181.011793:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787830181.011796:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787830181.011798:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787830181.011801:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5344
00000100:00080000:2.0:1787830181.011803:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787830181.011806:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787830181.011810:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787830181.011816:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572b840 x1874670273357312/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787830181.011823:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787830181.011825:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787830181.011827:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787830181.011830:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5344
00000100:00080000:2.0:1787830181.011833:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787830181.011836:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787830181.011839:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787830181.011845:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728f00 x1874670273357440/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787830181.011851:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787830181.011854:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787830181.011855:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787830181.011858:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5344
00000100:00080000:2.0:1787830181.011861:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787830181.011863:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787830181.011867:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787830181.011873:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728b40 x1874670273357568/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:0.0:1787830181.012238:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273356800:192.168.203.121@tcp:250:kworker.0
00000100:00100000:0.0:1787830181.012352:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273356928:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787830181.012374:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273357056:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787830181.012389:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273357184:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787830181.012403:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273357312:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787830181.012417:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273357440:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787830181.012431:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273357568:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787830181.014656:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:2.0:1787830181.971580:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787830182.035436:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787830182.995649:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787830183.059432:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787830184.019542:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000400:00000100:3.0:1787830184.083743:0:2355:0:(lib-socket.c:438:lnet_sock_connect()) Error -113 connecting 1023 -> 192.168.203.121:988
00000400:00000100:3.0:1787830184.083785:0:2355:0:(acceptor.c:117:lnet_connect_console_error()) Connection to 192.168.203.121@tcp at host 192.168.203.121 was unreachable: the network or that node may be down, or Lustre may be misconfigured.
00000100:00100000:2.0:1787830184.083815:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000800:00000100:3.0:1787830184.083958:0:2355:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000100:00100000:0.0:1787830184.084052:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830181/real 1787830184]  req@ffff9ee00572b0c0 x1874670273356800/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787830206 ref 2 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787830184.084083:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b0c0 x1874670273356800/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787830206 ref 2 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787830184.084094:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787830184.084099:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787830184.084103:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273356800:192.168.203.121@tcp:250:kworker.0
00000800:00000100:3.0:1787830184.084242:0:2355:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:3.0:1787830184.084264:0:2355:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:3.0:1787830184.084272:0:2355:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:3.0:1787830184.084279:0:2355:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:3.0:1787830184.084285:0:2355:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000800:00000100:3.0:1787830184.084292:0:2355:0:(socklnd_cb.c:353:ksocknal_txlist_done()) Deleting packet type 1 len 520 0@<0:0>->192.168.203.121@tcp
00000100:00100000:0.0:1787830184.084345:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830181/real 1787830184]  req@ffff9ee00572b480 x1874670273356928/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830206 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787830184.084360:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b480 x1874670273356928/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830206 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787830184.084368:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787830184.084371:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787830184.084375:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273356928:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787830184.084380:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830181/real 1787830184]  req@ffff9ee00572ad00 x1874670273357056/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830206 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787830184.084391:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572ad00 x1874670273357056/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830206 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787830184.084397:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787830184.084400:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787830184.084403:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572ad00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273357056:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787830184.084408:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830181/real 1787830184]  req@ffff9ee005729a40 x1874670273357184/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830206 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787830184.084418:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729a40 x1874670273357184/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830206 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787830184.084424:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787830184.084427:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787830184.084430:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273357184:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787830184.084435:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830181/real 1787830184]  req@ffff9ee00572b840 x1874670273357312/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830206 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787830184.084446:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572b840 x1874670273357312/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830206 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787830184.084453:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787830184.084456:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787830184.084459:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572b840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273357312:192.168.203.121@tcp:38:kworker.0
00000100:00100000:0.0:1787830184.084465:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830181/real 1787830184]  req@ffff9ee005728f00 x1874670273357440/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830206 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787830184.084476:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728f00 x1874670273357440/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830206 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787830184.084484:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787830184.084487:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787830184.084491:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273357440:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787830184.084497:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830181/real 1787830184]  req@ffff9ee005728b40 x1874670273357568/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830206 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:0.0:1787830184.084970:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728b40 x1874670273357568/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830206 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:0.0:1787830184.084980:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:0.0:1787830184.084985:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:0.0:1787830184.084988:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273357568:192.168.203.121@tcp:8:kworker.0
00010000:00010000:0.0:1787830185.043519:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1787830185.107720:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787830186.068682:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00080000:0.0:1787830186.131452:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787830186.131462:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1787830186.131466:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787830186.131476:0:37:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 5349
00000100:00100000:3.0:1787830186.131480:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:0.0:1787830186.131488:0:37:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787830186.131497:0:37:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787830186.131534:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ea580 x1874670273357696/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787830186.131565:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787830186.131568:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787830186.131569:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787830186.131572:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5349
00000100:00080000:0.0:1787830186.131576:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787830186.131579:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787830186.131588:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787830186.131598:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8b40 x1874670273357824/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787830186.131607:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787830186.131610:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787830186.131612:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787830186.131615:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5349
00000100:00080000:0.0:1787830186.131618:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787830186.131621:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787830186.131625:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787830186.131634:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb0c0 x1874670273357952/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787830186.131642:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787830186.131645:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787830186.131647:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787830186.131650:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5349
00000100:00080000:0.0:1787830186.131653:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787830186.131656:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787830186.131660:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787830186.131891:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273357696:192.168.203.121@tcp:250:kworker.0
00000800:00000100:3.0:1787830186.131945:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787830186.131980:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830186/real 1787830186]  req@ffff9ee0056ea580 x1874670273357696/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787830211 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787830186.131997:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ea580 x1874670273357696/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787830211 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787830186.132006:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787830186.132010:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787830186.132015:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ea580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273357696:192.168.203.121@tcp:250:kworker.0
00000100:00100000:3.0:1787830186.132027:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273357824:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787830186.132058:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787830186.132082:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830186/real 1787830186]  req@ffff9ee0056e8b40 x1874670273357824/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830211 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787830186.132096:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8b40 x1874670273357824/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830211 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787830186.132105:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787830186.132107:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787830186.132111:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8b40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273357824:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787830186.132117:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273357952:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787830186.132140:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787830186.132155:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830186/real 1787830186]  req@ffff9ee0056eb0c0 x1874670273357952/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830211 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787830186.132167:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb0c0 x1874670273357952/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830211 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787830186.132181:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787830186.132184:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787830186.132186:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb0c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273357952:192.168.203.121@tcp:8:kworker.0
00000100:00100000:0.0:1787830186.134830:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9a40 x1874670273358080/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787830186.134949:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273358080:192.168.203.121@tcp:8:kworker.0
00000100:00080000:0.0:1787830186.135175:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787830186.135179:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787830186.135182:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787830186.135187:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5349
00000100:00080000:0.0:1787830186.135195:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787830186.135202:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787830186.135212:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787830186.135238:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb840 x1874670273358208/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787830186.135256:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787830186.135260:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787830186.135262:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787830186.135266:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5349
00000100:00080000:0.0:1787830186.135270:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787830186.135274:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787830186.135279:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787830186.135288:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb480 x1874670273358336/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787830186.135295:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787830186.135297:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787830186.135298:0:37:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787830186.135300:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5349
00000100:00080000:0.0:1787830186.135303:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787830186.135304:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787830186.135307:0:37:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787830186.135334:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e92c0 x1874670273358464/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1787830186.135719:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787830186.135793:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830186/real 1787830186]  req@ffff9ee0056e9a40 x1874670273358080/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830211 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787830186.135806:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9a40 x1874670273358080/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830211 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787830186.135815:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787830186.135818:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787830186.135821:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9a40 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273358080:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787830186.135841:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273358208:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787830186.135866:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787830186.135874:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830186/real 1787830186]  req@ffff9ee0056eb840 x1874670273358208/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830211 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787830186.135881:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb840 x1874670273358208/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830211 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787830186.135887:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787830186.135890:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787830186.135894:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273358208:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787830186.135900:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273358336:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787830186.135917:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787830186.135928:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830186/real 1787830186]  req@ffff9ee0056eb480 x1874670273358336/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830211 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787830186.135938:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb480 x1874670273358336/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830211 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787830186.135946:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787830186.135951:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787830186.135953:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273358336:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787830186.135960:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273358464:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787830186.135982:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787830186.135993:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830186/real 1787830186]  req@ffff9ee0056e92c0 x1874670273358464/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830211 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787830186.136078:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e92c0 x1874670273358464/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830211 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787830186.136087:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787830186.136090:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787830186.136093:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273358464:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787830187.091578:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787830187.155543:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787830188.115838:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787830188.179657:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787830189.139650:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787830189.203528:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787830190.163541:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787830190.227851:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787830191.187498:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787830191.251435:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:2.0:1787830191.251754:0:27840:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787830191.251760:0:27840:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:2.0:1787830191.251764:0:27840:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787830191.251774:0:27840:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 5354
00000100:00080000:2.0:1787830191.251785:0:27840:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787830191.251792:0:27840:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:2.0:1787830191.251827:0:27840:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005729680 x1874670273358592/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787830191.251920:0:27840:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787830191.251924:0:27840:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787830191.251926:0:27840:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787830191.251930:0:27840:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5354
00000100:00080000:2.0:1787830191.251934:0:27840:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787830191.251938:0:27840:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787830191.251947:0:27840:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:2.0:1787830191.251960:0:27840:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a1c0 x1874670273358720/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787830191.251969:0:27840:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787830191.251972:0:27840:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787830191.251974:0:27840:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787830191.251977:0:27840:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5354
00000100:00080000:2.0:1787830191.251979:0:27840:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787830191.251982:0:27840:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787830191.251987:0:27840:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787830191.251995:0:27840:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee005728000 x1874670273358848/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:2.0:1787830191.252003:0:27840:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787830191.252017:0:27840:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787830191.252019:0:27840:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787830191.252023:0:27840:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5354
00000100:00080000:2.0:1787830191.252026:0:27840:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787830191.252030:0:27840:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:2.0:1787830191.252035:0:27840:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:2.0:1787830191.252046:0:27840:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0057283c0 x1874670273358976/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787830191.252052:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005729680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273358592:192.168.203.121@tcp:250:kworker.0
00000100:00080000:2.0:1787830191.252060:0:27840:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:2.0:1787830191.252064:0:27840:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:2.0:1787830191.252066:0:27840:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787830191.252071:0:27840:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5354
00000100:00080000:2.0:1787830191.252074:0:27840:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:2.0:1787830191.252078:0:27840:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000800:00000100:3.0:1787830191.252114:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000008:00100000:2.0:1787830191.252150:0:27840:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:3.0:1787830191.252151:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830191/real 1787830191]  req@ffff9ee005729680 x1874670273358592/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787830216 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787830191.252167:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005729680 x1874670273358592/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787830216 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:2.0:1787830191.252171:0:27840:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a940 x1874670273359104/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:3.0:1787830191.252177:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787830191.252184:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787830191.252189:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005729680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273358592:192.168.203.121@tcp:250:kworker.0
00000100:00080000:2.0:1787830191.252190:0:27840:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1787830191.252195:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273358720:192.168.203.121@tcp:38:kworker.0
00000100:00080000:2.0:1787830191.252196:0:27840:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:2.0:1787830191.252201:0:27840:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:2.0:1787830191.252206:0:27840:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5354
00000100:00080000:2.0:1787830191.252213:0:27840:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000800:00000100:3.0:1787830191.252216:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:2.0:1787830191.252221:0:27840:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787830191.252227:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830191/real 1787830191]  req@ffff9ee00572a1c0 x1874670273358720/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830216 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000008:00100000:2.0:1787830191.252228:0:27840:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:3.0:1787830191.252235:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a1c0 x1874670273358720/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830216 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787830191.252241:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787830191.252246:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787830191.252248:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a1c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273358720:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787830191.252253:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273358848:192.168.203.121@tcp:8:kworker.0
00000100:00100000:2.0:1787830191.252258:0:27840:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572bc00 x1874670273359232/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000800:00000100:3.0:1787830191.252267:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00080000:2.0:1787830191.252272:0:27840:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00100000:3.0:1787830191.252277:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830191/real 1787830191]  req@ffff9ee005728000 x1874670273358848/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830216 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787830191.252278:0:27840:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:2.0:1787830191.252282:0:27840:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00100000:3.0:1787830191.252290:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee005728000 x1874670273358848/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830216 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:2.0:1787830191.252292:0:27840:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5354
00000100:00080000:2.0:1787830191.252300:0:27840:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:3.0:1787830191.252301:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787830191.252307:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00080000:2.0:1787830191.252308:0:27840:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:3.0:1787830191.252311:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee005728000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273358848:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787830191.252350:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0057283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273358976:192.168.203.121@tcp:8:kworker.0
00000008:00100000:2.0:1787830191.252351:0:27840:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000800:00000100:3.0:1787830191.252367:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:2.0:1787830191.252368:0:27840:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee00572a580 x1874670273359360/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787830191.252376:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830191/real 1787830191]  req@ffff9ee0057283c0 x1874670273358976/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830216 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787830191.252387:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0057283c0 x1874670273358976/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830216 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787830191.252392:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787830191.252395:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787830191.252398:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0057283c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273358976:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787830191.252402:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273359104:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787830191.252411:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787830191.252416:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830191/real 1787830191]  req@ffff9ee00572a940 x1874670273359104/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830216 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787830191.252423:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a940 x1874670273359104/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830216 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787830191.252427:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787830191.252429:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787830191.252431:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273359104:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787830191.252433:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273359232:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787830191.252442:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787830191.252447:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830191/real 1787830191]  req@ffff9ee00572bc00 x1874670273359232/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830216 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787830191.252453:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572bc00 x1874670273359232/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830216 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787830191.252462:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787830191.252464:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787830191.252465:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572bc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273359232:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787830191.252474:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee00572a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273359360:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787830191.252484:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787830191.252490:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830191/real 1787830191]  req@ffff9ee00572a580 x1874670273359360/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830216 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787830191.252501:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee00572a580 x1874670273359360/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830216 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787830191.252513:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787830191.252515:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787830191.252518:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee00572a580 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273359360:192.168.203.121@tcp:8:kworker.0
00010000:00010000:2.0:1787830192.211549:0:5453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787830192.275378:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787830193.235597:0:5454:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787830193.299431:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787830194.259878:0:14451:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787830194.324911:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:0.0:1787830195.283524:0:14453:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787830195.347433:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00010000:00010000:3.0:1787830196.307916:0:14452:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1787830196.372094:0:27285:0:(client.c:2715:ptlrpc_set_wait()) set ffff9ee00ae36000 going to sleep for 0 seconds
00000100:00080000:0.0:1787830196.373950:0:27840:0:(pinger.c:229:ptlrpc_pinger_process_import()) c46c2643-06bc-43d9-a88f-07f3f5fe1eb6->MGS: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787830196.373959:0:27840:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery
00000100:00080000:0.0:1787830196.373963:0:27840:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787830196.373983:0:27840:0:(import.c:510:import_select_connection()) MGC192.168.203.121@tcp: connect to NID 192.168.203.121@tcp last attempt 5360
00000100:00080000:0.0:1787830196.373994:0:27840:0:(import.c:589:import_select_connection()) MGC192.168.203.121@tcp: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787830196.374001:0:27840:0:(import.c:624:import_select_connection()) MGC192.168.203.121@tcp: import ffff9ee003d91800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000100:00100000:0.0:1787830196.374035:0:27840:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ead00 x1874670273359488/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787830196.374067:0:27840:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787830196.374070:0:27840:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787830196.374072:0:27840:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787830196.374076:0:27840:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5360
00000100:00080000:0.0:1787830196.374080:0:27840:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787830196.374084:0:27840:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee003c8f000: import ffff9ee003141000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787830196.374093:0:27840:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787830196.374105:0:27840:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056ea940 x1874670273359616/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787830196.374115:0:27840:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787830196.374118:0:27840:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787830196.374120:0:27840:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787830196.374123:0:27840:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5360
00000100:00080000:0.0:1787830196.374126:0:27840:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787830196.374130:0:27840:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee003c8f000: import ffff9ee00986b800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787830196.374135:0:27840:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787830196.374145:0:27840:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e8780 x1874670273359744/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787830196.374159:0:27840:0:(pinger.c:229:ptlrpc_pinger_process_import()) b03e141c-10d0-4012-b9b8-d9632d4e5a26->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787830196.374162:0:27840:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787830196.374163:0:27840:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787830196.374167:0:27840:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: connect to NID 192.168.203.121@tcp last attempt 5360
00000100:00080000:0.0:1787830196.374170:0:27840:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787830196.374174:0:27840:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee003c8f000: import ffff9ee00986f800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787830196.374178:0:27840:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787830196.374188:0:27840:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e9680 x1874670273359872/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787830196.374198:0:27840:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787830196.374201:0:27840:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery
00000100:00080000:0.0:1787830196.374202:0:27840:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787830196.374206:0:27840:0:(import.c:510:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5360
00000100:00080000:0.0:1787830196.374209:0:27840:0:(import.c:589:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787830196.374213:0:27840:0:(import.c:624:import_select_connection()) lustre-MDT0000-mdc-ffff9ee00c190000: import ffff9ee0031e9000 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787830196.374218:0:27840:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xae7e7e7be374d3b8 ocd_version: 34683205 ocd_grant: 2097152, lost: 0.
00000100:00100000:0.0:1787830196.374230:0:27840:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056e92c0 x1874670273360000/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787830196.374238:0:27840:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787830196.374242:0:27840:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery
00000100:00080000:0.0:1787830196.374243:0:27840:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787830196.374247:0:27840:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5360
00000100:00080000:0.0:1787830196.374251:0:27840:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787830196.374254:0:27840:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-ffff9ee00c190000: import ffff9ee0031ea800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787830196.374259:0:27840:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787830196.374269:0:27840:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb480 x1874670273360128/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00080000:0.0:1787830196.374277:0:27840:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5176db3c-915a-436c-ad43-aac0fc9a0dfe->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00080000:0.0:1787830196.374280:0:27840:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery
00000100:00080000:0.0:1787830196.374282:0:27840:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING
00000100:00080000:0.0:1787830196.374285:0:27840:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: connect to NID 192.168.203.121@tcp last attempt 5360
00000100:00080000:0.0:1787830196.374288:0:27840:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: tried all connections, increasing latency to 20s
00000100:00080000:0.0:1787830196.374291:0:27840:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-ffff9ee00c190000: import ffff9ee0031ec800 using connection 192.168.203.121@tcp/192.168.203.121@tcp
00000008:00100000:0.0:1787830196.374296:0:27840:0:(osc_request.c:4019:osc_reconnect()) ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 34683205 ocd_grant: 8388608, lost: 0.
00000100:00100000:0.0:1787830196.374305:0:27840:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5)  req@ffff9ee0056eb840 x1874670273360256/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295
00000100:00100000:3.0:1787830196.374893:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273359488:192.168.203.121@tcp:250:kworker.0
00000800:00000100:3.0:1787830196.375009:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787830196.375074:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830196/real 1787830196]  req@ffff9ee0056ead00 x1874670273359488/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787830221 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787830196.375092:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ead00 x1874670273359488/t0(0) o250->MGC192.168.203.121@tcp@192.168.203.121@tcp:26/25 lens 520/544 e 0 to 1 dl 1787830221 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787830196.375103:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003d91800 MGS: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787830196.375107:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787830196.375111:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ead00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c46c2643-06bc-43d9-a88f-07f3f5fe1eb6:2364:1874670273359488:192.168.203.121@tcp:250:kworker.0
00000100:00100000:3.0:1787830196.375119:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273359616:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787830196.375142:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787830196.375155:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830196/real 1787830196]  req@ffff9ee0056ea940 x1874670273359616/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830221 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787830196.375166:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056ea940 x1874670273359616/t0(0) o38->lustre-MDT0000-mdc-ffff9ee003c8f000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830221 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787830196.375173:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee003141000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787830196.375176:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787830196.375179:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056ea940 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273359616:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787830196.375184:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273359744:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787830196.375204:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787830196.375215:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830196/real 1787830196]  req@ffff9ee0056e8780 x1874670273359744/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830221 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787830196.375226:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e8780 x1874670273359744/t0(0) o8->lustre-OST0000-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830221 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787830196.375233:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787830196.375236:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787830196.375239:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e8780 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273359744:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787830196.375245:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273359872:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787830196.375261:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787830196.375270:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830196/real 1787830196]  req@ffff9ee0056e9680 x1874670273359872/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830221 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787830196.375281:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e9680 x1874670273359872/t0(0) o8->lustre-OST0001-osc-ffff9ee003c8f000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830221 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787830196.375293:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee00986f800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787830196.375296:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787830196.375299:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e9680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:b03e141c-10d0-4012-b9b8-d9632d4e5a26:2364:1874670273359872:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787830196.375305:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273360000:192.168.203.121@tcp:38:kworker.0
00000800:00000100:3.0:1787830196.375347:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787830196.375358:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830196/real 1787830196]  req@ffff9ee0056e92c0 x1874670273360000/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830221 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787830196.375367:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056e92c0 x1874670273360000/t0(0) o38->lustre-MDT0000-mdc-ffff9ee00c190000@192.168.203.121@tcp:12/10 lens 520/544 e 0 to 1 dl 1787830221 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787830196.375374:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031e9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787830196.375377:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787830196.375380:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056e92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273360000:192.168.203.121@tcp:38:kworker.0
00000100:00100000:3.0:1787830196.375385:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273360128:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787830196.375402:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787830196.375412:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830196/real 1787830196]  req@ffff9ee0056eb480 x1874670273360128/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830221 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787830196.375422:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb480 x1874670273360128/t0(0) o8->lustre-OST0000-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830221 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787830196.375429:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ea800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787830196.375432:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787830196.375435:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273360128:192.168.203.121@tcp:8:kworker.0
00000100:00100000:3.0:1787830196.375441:0:2364:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273360256:192.168.203.121@tcp:8:kworker.0
00000800:00000100:3.0:1787830196.375458:0:2364:0:(socklnd_cb.c:906:ksocknal_launch_packet()) No usable routes to 12345-192.168.203.121@tcp
00000100:00100000:3.0:1787830196.375469:0:2364:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has failed due to network error: [sent 1787830196/real 1787830196]  req@ffff9ee0056eb840 x1874670273360256/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830221 ref 1 fl Rpc:eXNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00100000:3.0:1787830196.375478:0:2364:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING)  req@ffff9ee0056eb840 x1874670273360256/t0(0) o8->lustre-OST0001-osc-ffff9ee00c190000@192.168.203.121@tcp:28/4 lens 520/544 e 0 to 1 dl 1787830221 ref 1 fl Rpc:eXNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295
00000100:00080000:3.0:1787830196.375484:0:2364:0:(import.c:65:import_set_state_nolock()) ffff9ee0031ec800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN
00000100:00080000:3.0:1787830196.375486:0:2364:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 192.168.203.121@tcp failed (-110)
00000100:00100000:3.0:1787830196.375489:0:2364:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9ee0056eb840 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5176db3c-915a-436c-ad43-aac0fc9a0dfe:2364:1874670273360256:192.168.203.121@tcp:8:kworker.0
Debug log: 77334 lines, 77334 kept, 0 dropped, 0 bad.